00000100:00100000:3.0:1788269787.848291:0:31548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788269787.848308:0:31548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788269787.848313:0:31548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1424a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3610:x1875136262465536:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788269787.848318:0:31548:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788269787.848339:0:31548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1424a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3610:x1875136262465536:12345-0@lo:400:kworker.0 Request processed in 26us (945us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269787.848345:0:31548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788269787.848354:0:31548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788269787.848358:0:31548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3610:x1875136262465920:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788269787.848362:0:31548:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788269787.848719:0:31548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3610:x1875136262465920:12345-0@lo:400:kworker.0 Request processed in 359us (1145us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269787.848726:0:31548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788269787.848842:0:31548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788269787.848849:0:31548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3607:x1875136262465664:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788269787.848854:0:31548:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788269787.848888:0:31548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3607:x1875136262465664:12345-0@lo:400:kworker.0 Request processed in 39us (1230us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269787.848894:0:31548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788269787.848914:0:30266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262465280 00000100:00100000:3.0:1788269787.848918:0:30266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262465280 00000100:00100000:3.0:1788269787.848984:0:30266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262465408 00000100:00100000:3.0:1788269787.848987:0:30266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262465408 00000100:00100000:3.0:1788269787.849011:0:30266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269787.849017:0:30266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262465280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269787.849076:0:30266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262465280:12345-0@lo:400:kworker.0 Request processed in 60us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269787.849083:0:30266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269787.849095:0:30266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269787.849108:0:30266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269787.849137:0:30266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262465408:12345-0@lo:400:kworker.0 Request processed in 30us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269787.849143:0:30266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269787.849165:0:29500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262465152 00000100:00100000:3.0:1788269787.849169:0:29500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262465152 00000100:00100000:3.0:1788269787.849188:0:29500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269787.849193:0:29500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1875136262465152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788269787.849209:0:29500:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788269787.849241:0:29500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1875136262465152:12345-0@lo:38:kworker.0 Request processed in 47us (1613us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269787.849246:0:29500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269787.849283:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262465280:0@lo:400:kworker.0 00010000:00080000:3.0:1788269787.849297:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c25ef09f80 x1875136262465792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269787.849308:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262465792:0@lo:400:kworker.0 00000100:00080000:3.0:1788269787.849348:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269787.849353:0:3607:0:(import.c:65:import_set_state_nolock()) ffff98c247f7b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788269787.849357:0:3607:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788269787.849362:0:3607:0:(import.c:65:import_set_state_nolock()) ffff98c247f7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269787.849366:0:3607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 538 00000100:00080000:3.0:1788269787.849370:0:3607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c247f7b800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269787.849592:0:3607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef76d80 x1875136262466176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269787.849619:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262465664:0@lo:400:kworker.0 00000100:00100000:3.0:1788269787.849655:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262466176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788269787.849688:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269787.849713:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c24589f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269787.849718:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269787.849721:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262465152:0@lo:38:kworker.0 00000100:00100000:3.0:1788269787.849900:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c145282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262465408:0@lo:400:kworker.0 00000100:00080000:3.0:1788269787.849911:0:3610:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269787.849914:0:3610:0:(import.c:65:import_set_state_nolock()) ffff98c142b78000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788269787.849917:0:3610:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788269787.849920:0:3610:0:(import.c:65:import_set_state_nolock()) ffff98c142b78000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269787.849923:0:3610:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1788269787.849928:0:3610:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c142b78000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269787.849942:0:3610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef75880 x1875136262466304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269787.849958:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1424a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262465920:0@lo:400:kworker.0 00000100:00080000:3.0:1788269787.850030:0:3610:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269787.850059:0:3610:0:(import.c:65:import_set_state_nolock()) ffff98c275d99000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788269787.850063:0:3610:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788269787.850067:0:3610:0:(import.c:65:import_set_state_nolock()) ffff98c275d99000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269787.850070:0:3610:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:3.0:1788269787.850081:0:3610:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c275d99000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269787.850095:0:3610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef77800 x1875136262466432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269787.850106:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262465536:0@lo:400:kworker.0 00010000:00080000:3.0:1788269787.850120:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1424a7800 x1875136262466048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269787.850129:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1424a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262466048:0@lo:400:kworker.0 00000100:00100000:3.0:1788269787.850157:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262466304:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788269787.850184:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269787.850201:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262466432:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788269787.850223:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269787.850248:0:28761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262466176 00000100:00100000:3.0:1788269787.850253:0:28761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262466176 00000100:00100000:3.0:1788269787.850268:0:28761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262466304 00000100:00100000:3.0:1788269787.850271:0:28761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262466304 00000100:00100000:3.0:1788269787.850279:0:28761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262466432 00000100:00100000:3.0:1788269787.850282:0:28761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262466432 00000100:00100000:3.0:1788269787.850293:0:28761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788269787.850298:0:28761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262466176:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788269787.850311:0:28761:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788269787.850345:0:28761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262466176:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 46us (657us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269787.850350:0:28761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788269787.850363:0:28761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788269787.850367:0:28761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262466304:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788269787.850915:0:28761:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788269787.850948:0:28761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262466304:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 579us (763us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269787.850955:0:28761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788269787.850982:0:28761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788269787.850988:0:28761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262466432:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788269787.850999:0:28761:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788269787.851025:0:28761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262466432:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35us (800us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269787.851032:0:28761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788269787.851083:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c142b78000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269787.851087:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269787.851090:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262466304:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788269787.851098:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d99000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269787.851101:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269787.851104:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262466432:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788269787.851112:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c247f7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269787.851114:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269787.851117:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262466176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788269787.851707:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262465024:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788269788.420209:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788269789.160492:0:32781:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:3.0:1788269789.165353:0:28748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269789.165360:0:28748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269789.165372:0:28748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269789.165375:0:28748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269789.165383:0:28748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269789.165390:0:28748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269789.165396:0:28748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269789.165398:0:28748:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788269789.165401:0:28748:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788269789.165435:0:28748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269789.165442:0:28748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269789.165464:0:28748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269789.165471:0:28748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e05ee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e05ee8 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269789.165484:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269789.165486:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269789.165489:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269789.165506:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9524a840-9124-42bc-8d3e-a6c32f6a798d:3607:1875136262466560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269789.165597:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269789.165676:0:28745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262466560 00000100:00100000:3.0:1788269789.165686:0:28745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262466560 00000100:00100000:3.0:1788269789.165726:0:28745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269789.165734:0:28745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14419ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3607:x1875136262466560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788269789.165740:0:28745:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269789 with bad export cookie 14264544477344455941 00010000:00010000:3.0:1788269789.173401:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269789.173416:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c142b7f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788269789.173569:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27ebe7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788269789.173660:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c142b7d800 for lustre-MDT0001 00000020:00000080:3.0:1788269789.173667:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27ebe0800 for lustre-MDT0001 00010000:00010000:3.0:1788269789.174203:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269789.174290:0:28745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14419ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3607:x1875136262466560:12345-0@lo:103:ldlm_bl.0 Request processed in 8552us (8703us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269789.174302:0:28745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269789.177244:0:31294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262467200 00000100:00100000:3.0:1788269789.177255:0:31294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262467200 00000100:00100000:3.0:1788269789.177317:0:31294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262467328 00000100:00100000:3.0:1788269789.177320:0:31294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262467328 00000100:00100000:3.0:1788269789.177344:0:31294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269789.177353:0:31294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875136262467200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269789.177377:0:31294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e05feb 00000100:00080000:3.0:1788269789.177384:0:31294:0:(import.c:65:import_set_state_nolock()) ffff98c27ebfd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269789.177422:0:31294:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869190 00000100:00100000:3.0:1788269789.177559:0:31294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3606:x1875136262467200:12345-0@lo:9:umount.0 Request processed in 206us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269789.177566:0:31294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269789.177580:0:31294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269789.177586:0:31294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875136262467328:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269789.177597:0:31294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06093 00000100:00080000:3.0:1788269789.177614:0:31294:0:(import.c:65:import_set_state_nolock()) ffff98c14437a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269789.177635:0:31294:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869196 00000100:00100000:3.0:1788269789.177700:0:31294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3606:x1875136262467328:12345-0@lo:9:umount.0 Request processed in 114us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269789.177707:0:31294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1788269789.177733:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269789.177738:0:28749:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269789.177767:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c24589b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788269789.177779:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788269789.177781:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269789.177785:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262467200:0@lo:9:umount.0 00000100:00080000:3.0:1788269789.177796:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c245cfe800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788269789.177804:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788269789.177805:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269789.177808:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262467328:0@lo:9:umount.0 00000100:00100000:3.0:1788269789.187211:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9524a840-9124-42bc-8d3e-a6c32f6a798d:0:1875136262467072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269789.187237:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9524a840-9124-42bc-8d3e-a6c32f6a798d:3607:1875136262466560:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1788269789.263939:0:29501:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788269789.263944:0:29501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 1 count 1 00000040:00080000:3.0:1788269789.263965:0:29501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 4 count 2 00000020:00000080:3.0:1788269789.265443:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24a203000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269789.266131:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281db7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788269789.266555:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2458b6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788269789.266565:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cfd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269789.266889:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c245cfe800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788269789.267099:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27ebe6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788269789.267109:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24589f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269789.267559:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24589b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788269789.267569:0:466:0:(genops.c:885:class_export_put()) final put ffff98c27ebe5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269789.267572:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27ebe5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788269789.267576:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269789.267632:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27ebe5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788269789.267642:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245898800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788269789.269080:0:32781:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788269789.269085:0:32781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269789.269089:0:32781:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788269789.269163:0:32781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269789.269315:0:32781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269789.269328:0:32781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269789.269332:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c245899800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269789.269339:0:32781:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245899800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788269789.269346:0:32781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269789.269572:0:32781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269789.269578:0:32781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269789.269586:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c143a5a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269789.269589:0:32781:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143a5a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788269789.269604:0:32781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269789.269747:0:32781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e05e71 00000020:00000080:3.0:1788269789.269754:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c281db3000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788269789.270145:0:32781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788269789.270157:0:32781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269789.270162:0:32781:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788269789.270166:0:32781:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98c143788000) has no exports 00000020:00000080:3.0:1788269789.270254:0:32781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269789.270259:0:32781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788269789.270263:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c281db5000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788269789.270275:0:32781:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281db5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788269789.270280:0:32781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788269789.270513:0:32781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e05e78 00000020:00000080:3.0:1788269789.270518:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c281db1800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788269789.270535:0:32781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c27f621000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788269789.270538:0:32781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27f621000 2 00000020:01000004:3.0:1788269789.270545:0:32781:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c27f621000 from lustre-MDT0001 00000020:00000080:3.0:1788269789.270566:0:32781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269789.270572:0:32781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788269789.270574:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c24a203800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788269789.270576:0:32781:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24a203800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788269789.270582:0:32781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788269789.271299:0:32781:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788269789.271302:0:32781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788269789.271305:0:32781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269789.271308:0:32781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788269789.271315:0:32781:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98c275d98000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788269789.271319:0:32781:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff98c276b699b8) has exports, disconnecting them 00000020:00080000:3.0:1788269789.271323:0:32781:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98c275d98000), last request at 1788269739 00000020:00000080:3.0:1788269789.271326:0:32781:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e05ef6 00000020:00080000:3.0:1788269789.271335:0:32781:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c275d98000): rc 0 00000020:00000080:3.0:1788269789.271338:0:32781:0:(genops.c:885:class_export_put()) final put ffff98c275d98000/lustre-MDT0000-lwp-MDT0001 00000100:00100000:3.0:1788269789.289248:0:28761:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98c27b48f800:28761] 1 exiting: rc = 0 00000100:00100000:3.0:1788269789.296007:0:28764:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98c248804a00:28764] 1 exiting: rc = 0 00000100:00100000:3.0:1788269789.297230:0:28766:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98c247f61000:28766] 1 exiting: rc = 0 00000100:00100000:3.0:1788269789.308763:0:28767:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98c247f61c00:28767] 0 exiting: rc = 1 00000100:00100000:3.0:1788269789.310240:0:28769:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98c24a2e9a00:28769] 0 exiting: rc = 1 00000100:00100000:3.0:1788269789.312892:0:28772:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98c24b19e000:28772] 1 exiting: rc = 0 00000100:00100000:3.0:1788269789.314156:0:28774:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98c26aae1600:28774] 1 exiting: rc = 0 00010000:00010000:3.0:1788269790.472915:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788269791.208668:0:32981:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:3.0:1788269791.215378:0:28748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269791.215386:0:28748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c26ab5c600/0xc5f5d7a016e05f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e05f97 expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269791.215395:0:28748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269791.215399:0:28748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c26ab5c600/0xc5f5d7a016e05f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e05f97 expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269791.215409:0:28748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c26ab5c600/0xc5f5d7a016e05f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e05f97 expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269791.215417:0:28748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c26ab5c600/0xc5f5d7a016e05f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e05f97 expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269791.215425:0:28748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269791.215431:0:28748:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788269791.215435:0:28748:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788269791.215450:0:28748:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269791.215454:0:28748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c26ab5c600/0xc5f5d7a016e05f90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e05f97 expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269791.215462:0:28748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c26ab5c600/0xc5f5d7a016e05f90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e05f97 expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269791.215475:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269791.215477:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269791.215480:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269791.492445:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269792.516226:0:28749:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269792.964754:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262467840:0@lo:400:kworker.0 00000400:00000100:3.0:1788269792.964821:0:3608:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262467840 offset 0 length 224: 4 00000100:00100000:3.0:1788269793.989250:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262467968:0@lo:400:kworker.0 00000400:00000100:3.0:1788269793.989304:0:3609:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262467968 offset 0 length 224: 4 00010000:00010000:3.0:1788269794.564217:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269795.014031:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c14437f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788269795.014102:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c14437a800 for lustre-OST0001 00010000:00010000:3.0:1788269795.588307:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269796.612299:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269797.636245:0:28749:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269799.108490:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269799.108505:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262468352:0@lo:400:kworker.0 00000400:00000100:3.0:1788269799.108554:0:3608:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262468352 offset 0 length 224: 4 00010000:00010000:3.0:1788269799.684265:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269800.709529:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269801.157462:0:32580:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269801.157471:0:32580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9e000/0xc5f5d7a016e05f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e05f6d expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157480:0:32580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269801.157484:0:32580:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9e000/0xc5f5d7a016e05f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e05f6d expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157494:0:32580:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9e000/0xc5f5d7a016e05f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e05f6d expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269801.157501:0:32580:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9e000/0xc5f5d7a016e05f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e05f6d expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269801.157586:0:32580:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269801.157589:0:32580:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788269801.157591:0:32580:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788269801.157605:0:32580:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269801.157609:0:32580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9e000/0xc5f5d7a016e05f66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e05f6d expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157616:0:32580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9e000/0xc5f5d7a016e05f66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e05f6d expref: -99 pid: 30259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157630:0:32580:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269801.157645:0:32580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c241542c00/0xc5f5d7a016e06501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06508 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157650:0:32580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269801.157653:0:32580:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c241542c00/0xc5f5d7a016e06501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06508 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157660:0:32580:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c241542c00/0xc5f5d7a016e06501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06508 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269801.157666:0:32580:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c241542c00/0xc5f5d7a016e06501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06508 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269801.157671:0:32580:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788269801.157673:0:32580:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788269801.157675:0:32580:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788269801.157680:0:32580:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269801.157683:0:32580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c241542c00/0xc5f5d7a016e06501 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06508 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157695:0:32580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c241542c00/0xc5f5d7a016e06501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06508 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269801.157704:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269801.157706:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269801.157708:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788269801.168734:0:32981:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788269801.174931:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143969800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788269801.175196:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c247f7d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788269801.178161:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c247f7b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788269801.178878:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c142b7d000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788269801.179480:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c142b7a800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788269801.179643:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27ebfb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:3.0:1788269802.759938:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269802.863433:0:28748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269802.863441:0:28748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0602a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06031 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269802.863451:0:28748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5da00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269802.863456:0:28748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0602a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06031 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269802.863469:0:28748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0602a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06031 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269802.863479:0:28748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0602a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06031 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269802.863508:0:28748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269802.863514:0:28748:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788269802.863518:0:28748:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788269802.863536:0:28748:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269802.863544:0:28748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0602a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06031 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269802.863552:0:28748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0602a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06031 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269802.863566:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269802.863569:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269802.863572:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269802.864804:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262468352:0@lo:400:kworker.0 00000100:00100000:3.0:1788269802.864815:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262467840:0@lo:400:kworker.0 00010000:00010000:3.0:1788269803.780422:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269806.852266:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269807.876240:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269808.900260:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269811.972225:0:29912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269812.040692:0:28748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269812.040706:0:28748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418e800/0xc5f5d7a016e06000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06007 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040715:0:28748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269812.040719:0:28748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e800/0xc5f5d7a016e06000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06007 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040744:0:28748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418e800/0xc5f5d7a016e06000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06007 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269812.040749:0:28748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e800/0xc5f5d7a016e06000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06007 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269812.040753:0:28748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269812.040754:0:28748:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788269812.040765:0:28748:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269812.040768:0:28748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418e800/0xc5f5d7a016e06000 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06007 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040772:0:28748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418e800/0xc5f5d7a016e06000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06007 expref: -99 pid: 31076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040786:0:28748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269812.040789:0:28748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e064ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e064f3 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040793:0:28748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9efc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269812.040794:0:28748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e064ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e064f3 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040798:0:28748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e064ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e064f3 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269812.040801:0:28748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e064ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e064f3 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269812.040809:0:28748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788269812.040811:0:28748:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788269812.040814:0:28748:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269812.040815:0:28748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e064ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e064f3 expref: -99 pid: 28757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.040819:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269812.040820:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269812.040821:0:28748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269812.041885:0:32580:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269812.070819:0:33183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06015 00000020:00000080:3.0:1788269812.070832:0:33183:0:(genops.c:885:class_export_put()) final put ffff98c144b42000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788269812.070854:0:33183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c14396c800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788269812.070858:0:33183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c14396c800 2 00000020:01000004:3.0:1788269812.070862:0:33183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c14396c800 from lustre-OST0001 00000020:00000080:3.0:1788269812.070899:0:33183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269812.070909:0:33183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788269812.070912:0:33183:0:(genops.c:885:class_export_put()) final put ffff98c144b42800/lustre-OST0001_UUID 00000020:00000080:3.0:1788269812.070915:0:33183:0:(genops.c:844:class_export_destroy()) destroying export ffff98c144b42800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788269812.070922:0:33183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788269812.071012:0:33183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9524a840-9124-42bc-8d3e-a6c32f6a798d->MGS 00010000:00010000:3.0:1788269812.071027:0:33183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e05e24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e05e2b expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269812.071068:0:33183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e05e24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e05e2b expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269812.071076:0:33183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788269812.071080:0:33183:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788269812.071083:0:33183:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788269812.071108:0:33183:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269812.071114:0:33183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e05e24 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e05e2b expref: -99 pid: 29491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269812.071131:0:33183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677800/0xc5f5d7a016e05d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e05d1a expref: -99 pid: 28739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269812.071138:0:33183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677800/0xc5f5d7a016e05d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e05d1a expref: -99 pid: 28739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269812.071143:0:33183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269812.071146:0:33183:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788269812.071148:0:33183:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788269812.071157:0:33183:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c142797800 00010000:00010000:3.0:1788269812.071160:0:33183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677800/0xc5f5d7a016e05d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e05d1a expref: -99 pid: 28739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788269812.071180:0:33183:0:(import.c:65:import_set_state_nolock()) ffff98c142797800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788269812.071185:0:33183:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788269812.071187:0:33183:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788269812.071189:0:33183:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788269812.071192:0:33183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788269812.071204:0:33183:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c27a670700 x1875136262468224/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788269814 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788269812.071442:0:33183:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788269812.071446:0:33183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 10000000:01000000:3.0:1788269812.073198:0:33183:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788269812.073207:0:33183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e05cfe 00000020:00000080:3.0:1788269812.073212:0:33183:0:(genops.c:885:class_export_put()) final put ffff98c142796000/9524a840-9124-42bc-8d3e-a6c32f6a798d 00000020:01000000:3.0:1788269812.073228:0:33183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.142@tcp (flags='') 00000020:00000080:3.0:1788269812.073235:0:33183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269812.073239:0:33183:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269812.073252:0:33183:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98c276b68000) has no exports 10000000:01000000:3.0:1788269812.074648:0:33183:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.142@tcp: client import never connected 00000100:00080000:3.0:1788269812.074653:0:33183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788269812.074655:0:33183:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788269812.074658:0:33183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788269812.074660:0:33183:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788269812.074724:0:33183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269812.074732:0:33183:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.142@tcp (uuid 9524a840-9124-42bc-8d3e-a6c32f6a798d) 00000020:01000000:3.0:1788269812.074739:0:33183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788269812.074746:0:33183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269812.074751:0:33183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788269812.074758:0:33183:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98c142b7f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788269812.074765:0:33183:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff98c248a28000) has exports, disconnecting them 00000020:00080000:3.0:1788269812.074771:0:33183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98c142b7f000), last request at 1788269755 00000020:00000080:3.0:1788269812.074776:0:33183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0603f 00000020:00080000:3.0:1788269812.074791:0:33183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c142b7f000): rc 0 00000020:00000080:3.0:1788269812.074795:0:33183:0:(genops.c:885:class_export_put()) final put ffff98c142b7f000/lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788269812.094422:0:29912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788269812.094646:0:28748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:3.0:1788269812.096819:0:32580:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1788269812.098554:0:28745:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98c24de35c00:28745] 0 exiting: rc = 1 00000020:00000080:3.0:1788269812.114858:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788269812.144669:0:31294:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98c14373c600:31294] 3 exiting: rc = 0 00000100:00100000:3.0:1788269812.144749:0:30265:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98c27f04a000:30265] 1 exiting: rc = 0 00000100:00100000:3.0:1788269812.146949:0:30267:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98c27f083e00:30267] 0 exiting: rc = 1 00000100:00100000:3.0:1788269812.148801:0:30269:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98c281d90c00:30269] 0 exiting: rc = 1 00000100:00100000:3.0:1788269812.152763:0:30273:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98c2724d2e00:30273] 1 exiting: rc = 0 00000100:00100000:3.0:1788269812.154285:0:30275:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98c2724d2c00:30275] 1 exiting: rc = 0 00000020:01000004:3.0:1788269827.207240:0:34546:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788269827.207249:0:34546:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788269827.207250:0:34546:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788269827.207324:0:34546:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c27a77c800 00000020:01000004:3.0:1788269827.207337:0:34546:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788269827.207343:0:34546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788269827.207373:0:34546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98c27b803370) 00000020:00000080:3.0:1788269827.207389:0:34546:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1788269827.286513:0:34546:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788269827.286531:0:34546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788269827.287284:0:34546:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269827.287486:0:34546:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788269827.287493:0:34546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788269827.288479:0:34546:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788269827.288488:0:34546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788269827.288810:0:34546:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788269827.288817:0:34546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788269827.292404:0:34546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1788269827.303572:0:34546:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788269827.306510:0:34558:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000100:00100000:3.0:1788269827.373144:0:34546:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788269827.373150:0:34546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788269827.373711:0:34546:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788269827.373718:0:34546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788269827.374361:0:34546:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788269827.374383:0:34546:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788269827.374389:0:34546:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788269827.374473:0:34546:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788269827.374505:0:34546:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788269827.374508:0:34546:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788269827.374509:0:34546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788269827.374510:0:34546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269827.374511:0:34546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269827.374512:0:34546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269827.374513:0:34546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269827.374514:0:34546:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788269827.374517:0:34546:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788269827.374519:0:34546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269827.374520:0:34546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788269827.374521:0:34546:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788269827.374523:0:34546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788269827.374524:0:34546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788269827.374524:0:34546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269827.374525:0:34546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269827.374525:0:34546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269827.374526:0:34546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269827.374527:0:34546:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788269827.374527:0:34546:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788269827.374528:0:34546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269827.374528:0:34546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788269827.374549:0:34546:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788269827.374567:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262468736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788269827.374620:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.374656:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.377635:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262468736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788269827.377649:0:34546:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788269827.377652:0:34546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788269827.377654:0:34546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788269827.377656:0:34546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269827.377657:0:34546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269827.377658:0:34546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269827.377660:0:34546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269827.377661:0:34546:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788269827.377663:0:34546:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788269827.377664:0:34546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269827.377665:0:34546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788269827.377681:0:34546:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c27a77c800 from lustre-MDT0000 10000000:01000000:3.0:1788269827.377700:0:34546:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788269827.377703:0:34546:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788269827.377707:0:34546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c1437899b8 10000000:01000000:3.0:1788269827.377710:0:34546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269827.377717:0:34546:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c1437899b8 from 1 10000000:01000000:3.0:1788269827.377723:0:34546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788269827.377752:0:34546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e06a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.377760:0:34546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e06a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.377767:0:34546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e06a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269827.377781:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262468864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269827.377807:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.377840:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.378004:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262468864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269827.378016:0:34546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e06a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a17 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.378025:0:34546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e06a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06a17 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269827.378095:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262468992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269827.378117:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.378131:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.378677:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a671880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269827.378685:0:34546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.378690:0:34546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269827.378703:0:34546:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788269827.378711:0:34546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.378718:0:34546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269827.378724:0:34546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788269827.378728:0:34546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269827.378732:0:34546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98c27a77c800 10000000:01000000:3.0:1788269827.378735:0:34546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788269827.378737:0:34546:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788269827.378739:0:34546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788269827.378751:0:34546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.378758:0:34546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.378763:0:34546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269827.378772:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269827.378789:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.378803:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.378932:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269827.378942:0:34546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a33 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.378955:0:34546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06a33 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269827.378987:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269827.379004:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.379023:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.379303:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269827.379339:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269827.379386:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.379445:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.380017:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262469504:0@lo:503:mount.lustre.0 00000020:00000080:3.0:1788269827.423748:0:34585:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc5f5d7a016e06a79 00000020:00000080:3.0:1788269827.424669:0:34585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788269827.424681:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269827.424689:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.424691:0:34585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788269827.424694:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788269827.424697:0:34585:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788269827.424699:0:34585:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269827.424701:0:34585:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269827.424703:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788269827.424706:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.424708:0:34585:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788269827.424711:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269827.424718:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.424720:0:34585:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788269827.424726:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788269827.424788:0:34585:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788269827.424810:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269827.424814:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.424815:0:34585:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788269827.424818:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269827.424821:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.424823:0:34585:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788269827.424827:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269827.424832:0:34585:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:3.0:1788269827.424864:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269827.424877:0:34585:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98c27b8019b8) 00000020:00000080:3.0:1788269827.424888:0:34585:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788269827.424891:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269827.424933:0:34585:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788269827.424937:0:34585:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788269827.424941:0:34585:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e06a87 00010000:00080000:3.0:1788269827.424981:0:34585:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c24b002000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269827.426592:0:34585:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000040:00080000:3.0:1788269827.443588:0:34585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269827.443760:0:34585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:3.0:1788269827.446285:0:34585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].1, 64 off8256 00000020:00000080:3.0:1788269827.448209:0:34585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269827.448219:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788269827.448249:0:34585:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788269827.448264:0:34585:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e06aa3 00000100:00080000:3.0:1788269827.448272:0:34585:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269827.448277:0:34585:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c14437a000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269827.448311:0:34585:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef77800 x1875136262469888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269827.448339:0:34585:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788269827.448414:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269827.448419:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.448420:0:34585:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788269827.448422:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788269827.448424:0:34585:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788269827.448425:0:34585:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269827.448426:0:34585:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269827.448428:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788269827.448430:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.448431:0:34585:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788269827.448433:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269827.448436:0:34585:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788269827.448439:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.448440:0:34585:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788269827.448442:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269827.448445:0:34585:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788269827.448467:0:34585:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788269827.448470:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269827.448479:0:34585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98c27b804d28) 00000020:00000080:3.0:1788269827.448488:0:34585:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788269827.448492:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269827.448540:0:34585:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788269827.448544:0:34585:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788269827.448547:0:34585:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e06ab1 00010000:00080000:3.0:1788269827.448568:0:34585:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c247f7d000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269827.449516:0:34585:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788269827.449570:0:34585:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788269827.449581:0:34585:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788269827.457228:0:34585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269827.457584:0:34585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].5, 64 off8512 00000040:00080000:3.0:1788269827.457712:0:34585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 64 off8256 00000020:00000080:3.0:1788269827.459559:0:34585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269827.459579:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788269827.459616:0:34585:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788269827.459637:0:34585:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e06ab8 00000100:00080000:3.0:1788269827.459648:0:34585:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269827.459653:0:34585:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c247f7d000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269827.459686:0:34585:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef75880 x1875136262470016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269827.459716:0:34585:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788269827.459776:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269827.459781:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.459783:0:34585:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788269827.459786:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269827.459791:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.459793:0:34585:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788269827.459796:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788269827.459798:0:34585:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788269827.459802:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269827.459805:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.459806:0:34585:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788269827.459808:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269827.459811:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.459812:0:34585:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788269827.459817:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788269827.459847:0:34585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25a72341-2152-4ec8-9ca0-7a670d594ca1:34585:1875136262470144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269827.459898:0:34585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.459920:0:34585:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.460212:0:34585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25a72341-2152-4ec8-9ca0-7a670d594ca1:34585:1875136262470144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269827.460232:0:34585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269827.460235:0:34585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269827.460236:0:34585:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788269827.460242:0:34585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788269827.461718:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262470400 00000100:00100000:3.0:1788269827.461723:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262470400 00000100:00100000:3.0:1788269827.461759:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269827.461766:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+10:34546:x1875136262470400:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788269827.461779:0:34560:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788269827.461784:0:34560:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788269827.461856:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+10:34546:x1875136262470400:12345-0@lo:256:mount.lustre.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.461865:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269827.463285:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262470528 00000100:00100000:3.0:1788269827.463291:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262470528 00000100:00100000:3.0:1788269827.463322:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269827.463330:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+10:34546:x1875136262470528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269827.463353:0:34562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269827.463369:0:34562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9eea00/0xc5f5d7a016e06ad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e06acd expref: -99 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.463388:0:34562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9eea00/0xc5f5d7a016e06ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e06acd expref: 11 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.463397:0:34562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9eea00/0xc5f5d7a016e06ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e06acd expref: 11 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.463406:0:34562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eea00, rc 0) 00000100:00100000:3.0:1788269827.463446:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262470528:12345-0@lo:101:mount.lustre.0 Request processed in 117us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.463453:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269827.463921:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262470656 00000100:00100000:3.0:1788269827.463993:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262470656 00000100:00100000:3.0:1788269827.464027:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269827.464033:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262470656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269827.464193:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262470656:12345-0@lo:501:mount.lustre.0 Request processed in 160us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.464200:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269827.464698:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262470784 00000100:00100000:3.0:1788269827.464703:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262470784 00000100:00100000:3.0:1788269827.464733:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269827.464740:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262470784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269827.464809:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262470784:12345-0@lo:503:mount.lustre.0 Request processed in 70us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.464814:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269827.467181:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262471040 00000100:00100000:3.0:1788269827.467187:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262471040 00000100:00100000:3.0:1788269827.467217:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269827.467227:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34595:x1875136262471040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269827.467314:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34595:x1875136262471040:12345-0@lo:502:llog_process_th.0 Request processed in 89us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.467322:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:3.0:1788269827.474208:0:34546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788269827.474251:0:34546:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269827.474274:0:34546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c241543800/0xc5f5d7a016e06acd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06ad4 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.474287:0:34546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c241543800/0xc5f5d7a016e06acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06ad4 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269827.474438:0:34546:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269827.474442:0:34546:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c27a77c800 10000000:01000000:3.0:1788269827.474446:0:34546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c27a77c800 10000000:01000000:3.0:1788269827.474450:0:34546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269827.474457:0:34546:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c27a77c800 from 1 10000000:01000000:3.0:1788269827.474459:0:34546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269827.474689:0:34546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.474698:0:34546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.474709:0:34546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269827.474735:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262471168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269827.474802:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.474844:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.474871:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262471168 00000100:00100000:3.0:1788269827.474878:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262471168 00000100:00100000:3.0:1788269827.474924:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269827.474935:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262471168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269827.474949:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269827.474961:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9eec00/0xc5f5d7a016e06ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e06adb expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.474982:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9eec00/0xc5f5d7a016e06ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e06adb expref: 12 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.475004:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9eec00/0xc5f5d7a016e06ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e06adb expref: 12 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.475012:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eec00, rc 0) 00000100:00100000:3.0:1788269827.475080:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+12:34546:x1875136262471168:12345-0@lo:101:mount.lustre.0 Request processed in 147us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.475087:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269827.475135:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262471168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269827.475147:0:34546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06ae2 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269827.475155:0:34546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06ae2 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269827.475209:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262471296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269827.475234:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.475255:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.476571:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262471296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269827.476609:0:34546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262471424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269827.476658:0:34546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269827.480471:0:34546:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269827.481011:0:34546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:34546:1875136262471424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269827.502886:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+11:34546:x1875136262472064:12345-0@lo:253:mount.lustre.0 Request processed in 7106us (7298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269827.502905:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:3.0:1788269828.488523:0:34600:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788269828.488535:0:34600:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788269832.901373:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262472960:0@lo:38:kworker.0 00000100:00100000:3.0:1788269832.901882:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269832.901950:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262473088:0@lo:38:kworker.0 00000100:00100000:3.0:1788269832.901983:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269832.902099:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25a72341-2152-4ec8-9ca0-7a670d594ca1:3609:1875136262472832:0@lo:400:kworker.0 00010000:00080000:3.0:1788269832.902712:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27a670a80 x1875136262473088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269832.902725:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 5 00000100:00080000:3.0:1788269832.902786:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788269832.902792:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788269832.902794:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788269832.902799:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262473088:0@lo:38:kworker.0 00000020:00000080:3.0:1788269834.244513:0:35302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788269834.244525:0:35302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269834.244532:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269834.244534:0:35302:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788269834.244537:0:35302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269834.244542:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269834.244544:0:35302:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788269834.244546:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269834.244552:0:35302:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:3.0:1788269834.244578:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269834.244601:0:35302:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98c27b800000) 00000020:00000080:3.0:1788269834.244637:0:35302:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788269834.244643:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269834.244712:0:35302:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788269834.244719:0:35302:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788269834.244725:0:35302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e06b83 00010000:00080000:3.0:1788269834.249205:0:35302:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c245cfd000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269834.252405:0:35302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000040:00080000:3.0:1788269834.264950:0:35302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269834.265259:0:35302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:3.0:1788269834.265368:0:35302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 64 off8256 00000040:00080000:3.0:1788269834.265752:0:35307:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788269834.265757:0:35307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788269834.266567:0:35302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269834.266579:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788269834.266617:0:35302:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788269834.266641:0:35302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e06ba6 00000100:00080000:3.0:1788269834.266651:0:35302:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269834.266657:0:35302:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98c143776000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269834.266690:0:35302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef74a80 x1875136262474752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269834.266880:0:35302:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788269834.266968:0:35302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269834.266972:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269834.266975:0:35302:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788269834.266978:0:35302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788269834.266980:0:35302:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788269834.266982:0:35302:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269834.266984:0:35302:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269834.266985:0:35302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788269834.266987:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269834.266989:0:35302:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788269834.266999:0:35302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269834.267003:0:35302:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788269834.267007:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269834.267008:0:35302:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788269834.267011:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269834.267014:0:35302:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788269834.267445:0:35302:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788269834.267449:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269834.267461:0:35302:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98c276b68000) 00000020:00000080:3.0:1788269834.267475:0:35302:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788269834.267481:0:35302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269834.267534:0:35302:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788269834.267539:0:35302:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788269834.267543:0:35302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e06bb4 00010000:00080000:3.0:1788269834.267564:0:35302:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c2491eb800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269834.267748:0:35302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788269834.267809:0:35302:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788269834.267893:0:35302:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000020:01000000:3.0:1788269834.273034:0:35298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788269834.273091:0:35298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788269834.273109:0:35298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192200/0xc5f5d7a016e06b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06b44 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269834.273118:0:35298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144192200/0xc5f5d7a016e06b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06b44 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269834.273127:0:35298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c281db5800 from 1 10000000:01000000:3.0:1788269834.273129:0:35298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269834.273154:0:35298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269834.273174:0:35298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269834.273185:0:35298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269834.273200:0:35298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:35298:1875136262475136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269834.273251:0:35298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269834.273272:0:35298:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269834.274533:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262475264 00000100:00100000:3.0:1788269834.274537:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262475264 00000100:00100000:3.0:1788269834.274557:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269834.274562:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+16:35298:x1875136262475264:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788269834.274572:0:34561:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788269834.274634:0:34561:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788269834.274636:0:34561:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 19 00000100:00100000:3.0:1788269834.274802:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+16:35298:x1875136262475264:12345-0@lo:256:mount.lustre.0 Request processed in 239us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.274808:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269834.277650:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262475648 00000100:00100000:3.0:1788269834.277653:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262475648 00000100:00100000:3.0:1788269834.277675:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788269834.277680:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+17:35298:x1875136262475648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269834.277737:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+17:35298:x1875136262475648:12345-0@lo:503:mount.lustre.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.277742:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788269834.278176:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262475776 00000100:00100000:3.0:1788269834.278180:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262475776 00000100:00100000:3.0:1788269834.278197:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788269834.278203:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+17:35298:x1875136262475776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269834.278285:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+17:35298:x1875136262475776:12345-0@lo:502:mount.lustre.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.278290:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788269834.290267:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262476288 00000100:00100000:3.0:1788269834.290276:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262476288 00000100:00100000:3.0:1788269834.290957:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269834.290969:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:35298:x1875136262476288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269834.291720:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:35298:x1875136262476288:12345-0@lo:503:mount.lustre.0 Request processed in 591us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.291732:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269834.295678:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262476544 00000100:00100000:3.0:1788269834.295684:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262476544 00000100:00100000:3.0:1788269834.295721:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269834.295729:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:35298:x1875136262476544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269834.295916:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:35298:x1875136262476544:12345-0@lo:502:mount.lustre.0 Request processed in 188us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.295923:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000020:01000004:3.0:1788269834.298025:0:35316:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788269834.299579:0:35316:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98c276b6b370) 00000020:00000080:3.0:1788269834.299610:0:35316:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788269834.299732:0:35316:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c281db5800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788269834.299737:0:35316:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c281db5800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788269834.299739:0:35316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c281db5800 3 00010000:00080000:3.0:1788269834.299783:0:35316:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c143bc6000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269834.301574:0:35316:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788269834.302563:0:35316:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788269834.302614:0:35316:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788269834.302630:0:35316:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc5f5d7a016e06bf3 00000100:00080000:3.0:1788269834.302641:0:35316:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269834.302648:0:35316:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c143bc6000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269834.302684:0:35316:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef74380 x1875136262476800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269834.302719:0:35316:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788269834.302749:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788269834.302753:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788269834.302756:0:38:0:(import.c:65:import_set_state_nolock()) ffff98c24b002000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269834.302763:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c24b002000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269834.302778:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef74700 x1875136262476928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269834.302788:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269834.302791:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269834.302794:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269834.302797:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269834.303631:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269834.303636:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269834.303639:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269834.303642:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788269834.303671:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262477056:0@lo:400:kworker.0 00000100:00100000:3.0:1788269834.303711:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269834.303758:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262477056 00000100:00100000:3.0:1788269834.303764:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262477056 00000100:00100000:3.0:1788269834.303803:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269834.303880:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262477056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269834.303926:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262477056:12345-0@lo:400:kworker.0 Request processed in 114us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.303934:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269834.303964:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c25ef76680 x1875136262477056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269834.303974:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262477056:0@lo:400:kworker.0 20000000:01000000:3.0:1788269834.309518:0:34560:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788269834.309532:0:34560:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788269834.309836:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:35298:x1875136262477312:12345-0@lo:253:mount.lustre.0 Request processed in 3663us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269834.309846:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788269834.309949:0:35298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a671180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:35298:1875136262477312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788269834.309960:0:35298:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788269834.309962:0:35298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788269834.309963:0:35298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788269834.309964:0:35298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269834.309965:0:35298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269834.309966:0:35298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269834.309967:0:35298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269834.309968:0:35298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788269834.309969:0:35298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269834.309970:0:35298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788269834.309981:0:35298:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788269834.313492:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269834.313494:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269834.313496:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788269834.318330:0:35322:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788269834.318335:0:35322:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788269836.356852:0:35325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788269836.671897:0:35567:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788269837.095964:0:35619:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269837.096291:0:35619:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788269837.382294:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788269837.382356:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269837.382385:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269837.382396:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262478976:0@lo:400:kworker.0 00000100:00100000:3.0:1788269837.382433:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788269837.385448:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c14409ad80 x1875136262479744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269837.385467:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788269837.385511:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262478976 00000100:00100000:3.0:1788269837.385517:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262478976 00000100:00100000:3.0:1788269837.385573:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269837.385582:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:3607:x1875136262478976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269837.385651:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:3607:x1875136262478976:12345-0@lo:400:kworker.0 Request processed in 70us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269837.385659:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269837.385700:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262478976:0@lo:400:kworker.0 00010000:00010000:3.0:1788269838.157662:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269839.556395:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262480768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269839.556586:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269839.557359:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262480768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269840.071273:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262481024 00000100:00100000:3.0:1788269840.071279:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262481024 00000100:00100000:3.0:1788269840.071315:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269840.071321:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+17:34564:x1875136262481024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269840.071434:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+17:34564:x1875136262481024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269840.071440:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000020:01000000:3.0:1788269840.073804:0:34564:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788269840.073832:0:34564:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269840.073845:0:34564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269840.073856:0:34564:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269840.073866:0:34564:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269840.073869:0:34564:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27a77c800 from 13 10000000:01000000:3.0:1788269840.073872:0:34564:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269840.073908:0:34564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269840.073916:0:34564:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269840.073926:0:34564:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269840.073961:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262481280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269840.074020:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269840.074236:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269840.074386:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262481280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269840.074399:0:34564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c47 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269840.074407:0:34564:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06c47 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269840.074446:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262481408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269840.074463:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269840.074491:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269840.074698:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262481408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269840.074723:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262481536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269840.074762:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269840.074785:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269840.074953:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262481536:0@lo:503:ll_cfg_requeue.0 00000020:01000000:3.0:1788269840.075646:0:34564:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788269840.075662:0:34564:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269840.075670:0:34564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c47 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269840.075679:0:34564:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e06c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c47 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269840.645199:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269841.965674:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262481920 00000100:00100000:3.0:1788269841.965678:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262481920 00000100:00100000:3.0:1788269841.965701:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788269841.965707:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+18:36066:x1875136262481920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269841.965714:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269841.965725:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e06c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e06c63 expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269841.965743:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e06c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e06c63 expref: 19 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269841.965752:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e06c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e06c63 expref: 19 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269841.965759:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee200, rc 0) 00000100:00100000:3.0:1788269841.965797:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+19:36066:x1875136262481920:12345-0@lo:101:mount.lustre.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269841.965802:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788269841.969519:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262482048 00000100:00100000:3.0:1788269841.969527:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262482048 00000100:00100000:3.0:1788269841.969610:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788269841.969620:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26aca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+19:36066:x1875136262482048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269841.969758:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26aca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+19:36066:x1875136262482048:12345-0@lo:501:mount.lustre.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269841.969767:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788269841.972998:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262482432 00000100:00100000:3.0:1788269841.973010:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262482432 00000020:01000000:3.0:1788269841.982084:0:36066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788269841.982131:0:36066:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788269841.982151:0:36066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269841.982161:0:36066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269841.982167:0:36066:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c250df2800 from 1 10000000:01000000:3.0:1788269841.982168:0:36066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269841.982203:0:36066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269841.982208:0:36066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269841.982217:0:36066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269841.982237:0:36066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36066:1875136262482560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269841.982293:0:36066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269841.982331:0:36066:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788269841.988281:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262482944 00000100:00100000:3.0:1788269841.988286:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262482944 00000100:00100000:3.0:1788269841.988308:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269841.988314:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:36066:x1875136262482944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269841.988417:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:36066:x1875136262482944:12345-0@lo:502:mount.lustre.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269841.988424:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269841.989422:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262483072 00000100:00100000:3.0:1788269841.989427:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262483072 00000100:00100000:3.0:1788269841.989495:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788269841.989501:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:36066:x1875136262483072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269841.989575:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:36066:x1875136262483072:12345-0@lo:502:mount.lustre.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269841.989581:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788269842.024328:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262484608:0@lo:400:kworker.0 00000100:00100000:3.0:1788269842.024656:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269842.024735:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262484352 00000100:00100000:3.0:1788269842.024739:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262484352 00000100:00100000:3.0:1788269842.024760:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262484608 00000100:00100000:3.0:1788269842.024763:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262484608 00000100:00100000:3.0:1788269842.024774:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269842.024779:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262484352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269842.024812:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262484352:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269842.024818:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269842.024830:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269842.024836:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262484608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269842.024866:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262484608:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269842.024872:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788269842.024897:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c27a671500 x1875136262484608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269842.024907:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262484608:0@lo:400:kworker.0 00010000:00080000:3.0:1788269842.024938:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c27a673800 x1875136262484352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269842.024947:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262484352:0@lo:400:kworker.0 00000020:01000000:3.0:1788269842.029840:0:36066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788269842.029887:0:36066:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788269842.029919:0:36066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.029932:0:36066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788269842.029988:0:36066:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788269842.029990:0:36066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788269842.029992:0:36066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269842.029993:0:36066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269842.029994:0:36066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269842.029996:0:36066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269842.029997:0:36066:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269842.029999:0:36066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269842.030000:0:36066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788269842.030004:0:36066:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788269842.030007:0:36066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788269842.030008:0:36066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788269842.030009:0:36066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269842.030010:0:36066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269842.030011:0:36066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269842.030012:0:36066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269842.030014:0:36066:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269842.030015:0:36066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269842.030015:0:36066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788269842.030060:0:36066:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788269842.030083:0:36066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36066:1875136262484736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788269842.031268:0:36066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269842.031297:0:36066:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a69c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788269842.036456:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269842.036463:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036471:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269842.036480:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036490:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269842.036498:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269842.036503:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269842.036537:0:34556:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036543:0:34556:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269842.036565:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036571:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c241543200/0xc5f5d7a016e06c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c1d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036582:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269842.036585:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036591:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269842.036599:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036605:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269842.036611:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269842.036616:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269842.036629:0:34556:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036633:0:34556:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269842.036649:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036654:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c0f expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269842.036667:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269842.036669:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269842.036670:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269842.036677:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269842.036687:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25a72341-2152-4ec8-9ca0-7a670d594ca1:3608:1875136262485120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269842.036718:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269842.036761:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269842.036769:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25a72341-2152-4ec8-9ca0-7a670d594ca1:3610:1875136262485248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269842.036793:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269842.036824:0:35719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262485120 00000100:00100000:3.0:1788269842.036832:0:35719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262485120 00010000:00010000:3.0:1788269842.036850:0:35719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c241543e00/0xc5f5d7a016e06c1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c16 expref: 22 pid: 34562 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269842.038783:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25a72341-2152-4ec8-9ca0-7a670d594ca1:3610:1875136262485248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269842.038814:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25a72341-2152-4ec8-9ca0-7a670d594ca1:3608:1875136262485120:0@lo:103:ldlm_bl.0 00002000:00080000:3.0:1788269842.039807:0:36066:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788269842.039815:0:36066:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788269842.039849:0:36066:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788269842.039892:0:36066:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788269842.039912:0:36066:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788269842.039935:0:36066:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788269842.040825:0:36066:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269842.041030:0:36066:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788269842.631402:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262485376 00000100:00100000:3.0:1788269842.631412:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262485376 00000100:00100000:3.0:1788269842.631472:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269842.631482:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262485376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788269842.631517:0:34573:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788269842.631576:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262485376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269842.631582:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269843.526188:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262485632 00000100:00100000:3.0:1788269843.526195:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262485632 00000100:00100000:3.0:1788269843.526239:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788269843.526247:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:34564:x1875136262485632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788269843.526265:0:34560:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788269843.526281:0:34560:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788269843.526284:0:34560:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 21 00000100:00100000:3.0:1788269843.526372:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:34564:x1875136262485632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269843.526380:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788269843.526979:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262485760 00000100:00100000:3.0:1788269843.526984:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262485760 00000100:00100000:3.0:1788269843.527023:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788269843.527031:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:34564:x1875136262485760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269843.527076:0:34561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269843.527088:0:34561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9ef000/0xc5f5d7a016e06ce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e06cda expref: -99 pid: 34561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269843.527108:0:34561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ef000/0xc5f5d7a016e06ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e06cda expref: 21 pid: 34561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269843.527118:0:34561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9ef000/0xc5f5d7a016e06ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e06cda expref: 21 pid: 34561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269843.527126:0:34561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ef000, rc 0) 00000100:00100000:3.0:1788269843.527252:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:34564:x1875136262485760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269843.527259:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788269843.717279:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269844.100363:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269834/real 1788269834] req@ffff98c144098700 x1875136262475008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.100390:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c144098700 x1875136262475008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.100400:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269834/real 1788269834] req@ffff98c25ef74a80 x1875136262474752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.100436:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c25ef74a80 x1875136262474752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269844.100457:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269844.100483:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788269844.100487:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262475008:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788269844.100497:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143776000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269844.100502:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788269844.100504:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262474752:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788269844.101700:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262486400:0@lo:8:kworker.0 00000100:00100000:3.0:1788269844.101785:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269844.101816:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262486528:0@lo:8:kworker.0 00000100:00100000:3.0:1788269844.101846:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269844.101888:0:36072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262486400 00000100:00100000:3.0:1788269844.101891:0:36072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262486400 00000100:00100000:3.0:1788269844.101908:0:36072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262486528 00000100:00100000:3.0:1788269844.101910:0:36072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262486528 00000100:00100000:3.0:1788269844.101925:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269844.101930:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1875136262486400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788269844.101954:0:36072:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:3.0:1788269844.101987:0:36072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e06ce8 00002000:00100000:3.0:1788269844.102000:0:36072:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98c144937000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788269844.102005:0:36072:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788269844.102008:0:36072:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788269844.102292:0:36072:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788269844.102316:0:36072:0:(import.c:65:import_set_state_nolock()) ffff98c144937800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269844.102790:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3606:x1875136262486400:12345-0@lo:8:kworker.0 Request processed in 857us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269844.102799:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269844.102818:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269844.102860:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1875136262486528:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788269844.102876:0:36072:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788269844.102904:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1875136262486528:12345-0@lo:8:kworker.0 Request processed in 80us (1057us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269844.102911:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269844.103271:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27a670380 x1875136262486400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.103282:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269844.103289:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 5 00000100:00080000:3.0:1788269844.103296:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788269844.103300:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788269844.103303:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143776000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788269844.103315:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788269844.103319:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262486400:0@lo:8:kworker.0 00000100:00080000:3.0:1788269844.103329:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269844.103332:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269844.103335:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262486528:0@lo:8:kworker.0 00000004:00080000:3.0:1788269844.103378:0:35308:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788269844.103394:0:35308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:35308:1875136262487168:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788269844.103432:0:35308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269844.103451:0:35308:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000004:00080000:3.0:1788269844.104202:0:35307:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788269844.104273:0:35307:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 635811233492ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788269844.104279:0:35307:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788269844.105346:0:36072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262487168 00000100:00100000:3.0:1788269844.105359:0:36072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262487168 00000100:00100000:3.0:1788269844.105447:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269844.105458:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:35308:x1875136262487168:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788269844.107164:0:35299:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1788269844.108645:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef76a00 x1875136262487040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.108664:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262487040:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788269844.111607:0:35308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef75180 x1875136262487168/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788269860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.111623:0:35308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:35308:1875136262487168:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788269844.111636:0:35308:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x81:0x0] 00000100:00100000:3.0:1788269844.111674:0:35308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:35308:1875136262487296:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788269844.111708:0:35308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269844.111784:0:35308:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00010000:00080000:3.0:1788269844.117282:0:35308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef75180 x1875136262487296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269844.117302:0:35308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:35308:1875136262487296:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788269844.117318:0:35308:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x81:0x0] from OST, last_created [0x280000400:0x81:0x0]last_used is [0x280000400:0x81:0x0] 00000100:00100000:3.0:1788269844.117375:0:35308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:35308:1875136262487424:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788269844.117429:0:35308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269844.117470:0:35308:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269844.146265:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:35308:x1875136262487424:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28714us (28832us total) trans 21474836481 rc 0/0 00000100:00100000:3.0:1788269844.146278:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269844.146600:0:34579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262487552 00000100:00100000:3.0:1788269844.146607:0:34579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262487552 00000100:00100000:3.0:1788269844.146690:0:34579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269844.146700:0:34579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:35308:x1875136262487552:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788269844.146755:0:34579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:35308:x1875136262487552:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269844.146762:0:34579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269844.676449:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262487680 00000100:00100000:3.0:1788269844.676459:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262487680 00000100:00100000:3.0:1788269844.676516:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269844.676527:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262487680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788269844.676560:0:34573:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1788269844.676613:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262487680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269844.676622:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269844.676664:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262487680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788269844.740124:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788269845.815453:0:36490:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269845.815640:0:36490:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788269846.788200:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269849.286684:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262488064:0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.286817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269849.286841:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.286887:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262488320 00000100:00100000:3.0:1788269849.286893:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262488320 00000100:00100000:3.0:1788269849.286922:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262488064 00000100:00100000:3.0:1788269849.286924:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262488064 00000100:00100000:3.0:1788269849.286941:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788269849.286952:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262488320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.287018:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262488320:12345-0@lo:400:kworker.0 Request processed in 67us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269849.287026:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788269849.287067:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269849.287077:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262488064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.287114:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262488064:12345-0@lo:400:kworker.0 Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269849.287121:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269849.287144:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262488960 00000100:00100000:3.0:1788269849.287149:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262488960 00000100:00100000:3.0:1788269849.287191:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269849.287201:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262488960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.287245:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262488960:12345-0@lo:400:kworker.0 Request processed in 45us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269849.287252:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269849.287277:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269849.287313:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262488064:0@lo:400:kworker.0 00010000:00080000:3.0:1788269849.287385:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27a670000 x1875136262488960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269849.287397:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.287447:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262489088 00000100:00100000:3.0:1788269849.287453:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262489088 00000100:00100000:3.0:1788269849.287491:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269849.287501:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262489088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788269849.287527:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788269849.287577:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262489088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269849.287585:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269849.287628:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27a672680 x1875136262488704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269849.287644:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262488704:0@lo:400:kworker.0 00010000:00080000:3.0:1788269849.287671:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14483aa00 x1875136262489088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269849.287683:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262489088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269849.287691:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262487936:0@lo:400:kworker.0 00000100:00100000:3.0:1788269849.289110:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788269849.289767:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27a670380 x1875136262488832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269849.289774:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262488832:0@lo:400:kworker.0 00010000:00010000:3.0:1788269849.861159:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269850.155521:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262489344 00000100:00100000:3.0:1788269850.155530:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262489344 00000100:00100000:3.0:1788269850.155638:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788269850.155650:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:36884:x1875136262489344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788269850.155680:0:34562:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788269850.155684:0:34562:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788269850.155688:0:34562:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788269850.155940:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:36884:x1875136262489344:12345-0@lo:253:mount.lustre.0 Request processed in 292us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.155964:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788269850.156769:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262489600 00000100:00100000:3.0:1788269850.156775:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262489600 00000100:00100000:3.0:1788269850.156802:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788269850.156809:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:36884:x1875136262489600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269850.156824:0:34562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269850.156836:0:34562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9eee00/0xc5f5d7a016e06d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e06cfd expref: -99 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.156857:0:34562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9eee00/0xc5f5d7a016e06d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e06cfd expref: 22 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.156868:0:34562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9eee00/0xc5f5d7a016e06d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e06cfd expref: 22 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.156877:0:34562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eee00, rc 0) 00000100:00100000:3.0:1788269850.156911:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:36884:x1875136262489600:12345-0@lo:101:mount.lustre.0 Request processed in 102us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.156918:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788269850.166991:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788269850.167011:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:36884:x1875136262489856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269850.167860:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:36884:x1875136262489856:12345-0@lo:503:mount.lustre.0 Request processed in 849us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.167871:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000040:00080000:3.0:1788269850.168481:0:36884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269850.168578:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262489984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269850.168620:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.168646:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24888dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.171419:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262489984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269850.171684:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:3.0:1788269850.171715:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:3.0:1788269850.171729:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:3.0:1788269850.171739:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:3.0:1788269850.171751:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:3.0:1788269850.171764:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:3.0:1788269850.171777:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:3.0:1788269850.171788:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:3.0:1788269850.171800:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:3.0:1788269850.171846:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269850.171888:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.171928:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244180 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.172146:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269850.172196:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:3.0:1788269850.172204:0:36884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788269850.179870:0:36884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788269850.179902:0:36884:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788269850.179921:0:36884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.179936:0:36884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269850.179942:0:36884:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c1451b9800 from 1 10000000:01000000:3.0:1788269850.179957:0:36884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269850.179994:0:36884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.180003:0:36884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.180013:0:36884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269850.180035:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269850.180113:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.180156:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24888dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.180403:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269850.180418:0:36884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.180427:0:36884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269850.181200:0:36884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 13 count 13 00000040:00080000:3.0:1788269850.181425:0:36884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269850.181607:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788269850.181628:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788269850.181644:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788269850.181652:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788269850.181661:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788269850.181669:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788269850.181678:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788269850.181712:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788269850.181734:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788269850.181754:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10112 00000040:00080000:3.0:1788269850.181777:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 128 off10240 00000040:00080000:3.0:1788269850.181801:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10464 00000040:00080000:3.0:1788269850.181808:0:36884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 12 count 13 00000100:00100000:3.0:1788269850.181867:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269850.181911:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.181940:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.182910:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269850.183480:0:36884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269850.183541:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269850.183608:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.183634:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244180 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.183894:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269850.184183:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:3.0:1788269850.184212:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:3.0:1788269850.184226:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:3.0:1788269850.184239:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:3.0:1788269850.184252:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:3.0:1788269850.184273:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:3.0:1788269850.184367:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:3.0:1788269850.184384:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:3.0:1788269850.184397:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:3.0:1788269850.184418:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:3.0:1788269850.184452:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:3.0:1788269850.184481:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269850.184527:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.184556:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244180 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.184724:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269850.184775:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:3.0:1788269850.184786:0:36884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788269850.185672:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269850.185682:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185685:0:36892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788269850.185691:0:36892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c1451b9800 00000020:00000080:3.0:1788269850.185694:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269850.185702:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269850.185705:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185706:0:36892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788269850.185709:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269850.185711:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185713:0:36892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788269850.185716:0:36892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c1451b9800 00000020:00000080:3.0:1788269850.185719:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269850.185772:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269850.185775:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185777:0:36892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788269850.185780:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269850.185783:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185785:0:36892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788269850.185788:0:36892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c1451b9800 00000020:00000080:3.0:1788269850.185791:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269850.185807:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269850.185810:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185817:0:36892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788269850.185820:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269850.185823:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185825:0:36892:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788269850.185828:0:36892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c1451b9800 00000020:00000080:3.0:1788269850.185830:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269850.185856:0:36892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269850.185860:0:36892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269850.185861:0:36892:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788269850.185864:0:36892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 10000000:01000000:3.0:1788269850.186193:0:36884:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269850.186198:0:36884:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c1451b9800 10000000:01000000:3.0:1788269850.186202:0:36884:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c1451b9800 10000000:01000000:3.0:1788269850.186207:0:36884:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269850.186213:0:36884:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c1451b9800 from 1 10000000:01000000:3.0:1788269850.186216:0:36884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269850.186248:0:36884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.186257:0:36884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.186267:0:36884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269850.186357:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269850.186409:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.186454:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.186678:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262490880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269850.186693:0:36884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269850.186713:0:36884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269850.191548:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262491136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269850.191996:0:36884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269850.192125:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262491264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269850.192173:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.192213:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269850.193176:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262491264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269850.193462:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:3.0:1788269850.193494:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:3.0:1788269850.193514:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:3.0:1788269850.193530:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:3.0:1788269850.193546:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:3.0:1788269850.193565:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:3.0:1788269850.193586:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:3.0:1788269850.193619:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:3.0:1788269850.193640:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:3.0:1788269850.193660:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:3.0:1788269850.193679:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:3.0:1788269850.193695:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:3.0:1788269850.193710:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:3.0:1788269850.193729:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:3.0:1788269850.193749:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:3.0:1788269850.193766:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:3.0:1788269850.193785:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:3.0:1788269850.193804:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:3.0:1788269850.193821:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:3.0:1788269850.193852:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:3.0:1788269850.193874:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:3.0:1788269850.193898:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:3.0:1788269850.193920:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:3.0:1788269850.193976:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:3.0:1788269850.193994:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 160 off12472 00000040:00080000:3.0:1788269850.194007:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12696 00000040:00080000:3.0:1788269850.194019:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12920 00000040:00080000:3.0:1788269850.194032:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off13000 00000040:00080000:3.0:1788269850.194071:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13224 00000040:00080000:3.0:1788269850.194162:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13448 00000040:00080000:3.0:1788269850.194179:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13536 00000040:00080000:3.0:1788269850.194193:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13664 00000040:00080000:3.0:1788269850.194209:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13808 00000040:00080000:3.0:1788269850.194225:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13936 00000040:00080000:3.0:1788269850.194242:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14160 00000040:00080000:3.0:1788269850.194259:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14384 00000040:00080000:3.0:1788269850.194276:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14464 00000040:00080000:3.0:1788269850.194310:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14688 00000040:00080000:3.0:1788269850.194327:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14912 00000040:00080000:3.0:1788269850.194356:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 88 off15000 00000040:00080000:3.0:1788269850.194377:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 128 off15128 00000040:00080000:3.0:1788269850.194396:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 144 off15272 00000040:00080000:3.0:1788269850.194415:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 128 off15400 00000040:00080000:3.0:1788269850.194436:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 224 off15624 00000040:00080000:3.0:1788269850.194459:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off15848 00000040:00080000:3.0:1788269850.194483:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].46, 80 off15928 00000040:00080000:3.0:1788269850.194506:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].47, 224 off16152 00000040:00080000:3.0:1788269850.194530:0:36884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].48, 232 off16384 00000100:00100000:3.0:1788269850.194589:0:36884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262491392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269850.194658:0:36884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.194700:0:36884:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244840 going to sleep for 11 seconds 00000020:00000080:3.0:1788269850.201186:0:36896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5f5d7a016e06d3c 00000100:00080000:3.0:1788269850.201199:0:36896:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269850.201206:0:36896:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c144353000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269850.201239:0:36896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef74700 x1875136262491648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269850.201266:0:36896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1788269850.201536:0:36896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1788269850.201560:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262491904:0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.201605:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.201642:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262492544:0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.201675:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.201700:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269850.201709:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.201750:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269850.201793:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788269850.201809:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262492544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.201861:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262492544:12345-0@lo:400:kworker.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.201877:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788269850.201902:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269850.201914:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262492288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.201971:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262492288:12345-0@lo:400:kworker.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.201979:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269850.201997:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262492416 00000100:00100000:3.0:1788269850.202009:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262492416 00000100:00100000:3.0:1788269850.202065:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269850.202134:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262492416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.202387:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262492416:12345-0@lo:400:kworker.0 Request processed in 312us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.202397:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788269850.202444:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27a61b800 x1875136262492416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269850.202457:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262492416:0@lo:400:kworker.0 00000100:00100000:3.0:1788269850.202490:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262491776:0@lo:400:kworker.0 00000020:00000080:3.0:1788269850.202535:0:36896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98c276b699b8) 00000020:00000080:3.0:1788269850.202555:0:36896:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788269850.202650:0:36896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c1451b9800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788269850.202654:0:36896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c1451b9800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788269850.202657:0:36896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c1451b9800 3 00010000:00080000:3.0:1788269850.202683:0:36896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c1435b6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269850.205154:0:36896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788269850.205437:0:36896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788269850.205483:0:36896:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788269850.205495:0:36896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc5f5d7a016e06d51 00000100:00080000:3.0:1788269850.205504:0:36896:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269850.205510:0:36896:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98c1435b6800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269850.205554:0:36896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef74700 x1875136262492672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269850.205579:0:36896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788269850.205608:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269850.205619:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269850.205623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269850.205626:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788269850.205836:0:36896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 20000000:01000000:3.0:1788269850.210451:0:34562:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788269850.210474:0:34562:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788269850.210709:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:36884:x1875136262492800:12345-0@lo:253:mount.lustre.0 Request processed in 4415us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269850.210721:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788269850.210802:0:36884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25a72341-2152-4ec8-9ca0-7a670d594ca1:36884:1875136262492800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788269850.210817:0:36884:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788269850.210821:0:36884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788269850.210823:0:36884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788269850.210825:0:36884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269850.210829:0:36884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269850.210833:0:36884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269850.210835:0:36884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269850.210837:0:36884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269850.210839:0:36884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269850.210841:0:36884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788269850.210859:0:36884:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788269850.212174:0:36884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836480 00010000:00010000:3.0:1788269850.884251:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788269851.460164:0:34564:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269851.460173:0:34564:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c281db5800 from 22 10000000:01000000:3.0:1788269851.460179:0:34564:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269851.460246:0:34564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269851.460257:0:34564:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269851.460295:0:34564:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269851.460323:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262493440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269851.460397:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269851.460450:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dc513c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269851.461690:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262493568 00000100:00100000:3.0:1788269851.461695:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262493568 00000100:00100000:3.0:1788269851.461812:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788269851.461820:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+23:34564:x1875136262493568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788269851.461835:0:34562:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788269851.461851:0:34562:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788269851.461854:0:34562:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 22 00000100:00100000:3.0:1788269851.461950:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+23:34564:x1875136262493568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269851.461965:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788269851.462811:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262493696 00000100:00100000:3.0:1788269851.462816:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262493696 00000100:00100000:3.0:1788269851.462847:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788269851.462854:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+23:34564:x1875136262493696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269851.462864:0:34562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269851.462875:0:34562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9efa00/0xc5f5d7a016e06d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e06d74 expref: -99 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269851.462894:0:34562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9efa00/0xc5f5d7a016e06d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e06d74 expref: 24 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269851.462915:0:34562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9efa00/0xc5f5d7a016e06d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e06d74 expref: 24 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269851.462932:0:34562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9efa00, rc 0) 00000100:00100000:3.0:1788269851.463108:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:34564:x1875136262493696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269851.463115:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788269852.293433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269852.293439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788269852.293442:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c14437a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269852.293449:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788269852.293454:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788269852.293461:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c14437a000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269852.293487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14483aa00 x1875136262494080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269852.293510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269852.293513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788269852.293515:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c247f7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269852.293519:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788269852.293522:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788269852.293526:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c247f7d000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269852.293541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1437b0380 x1875136262494208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269852.293590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269852.293600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788269852.293602:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269852.293608:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c2491eb800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269852.293623:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1437b0e00 x1875136262494720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269852.293691:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262495232:0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.293730:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.293765:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262494080:0@lo:8:kworker.0 00000100:00100000:3.0:1788269852.293792:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.293816:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262494208:0@lo:8:kworker.0 00000100:00100000:3.0:1788269852.293840:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.293854:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262494720:0@lo:8:kworker.0 00000100:00100000:3.0:1788269852.293873:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.293893:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.293924:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.293951:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262494976:0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.293978:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.293996:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788269852.294004:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262494464:0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294028:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.294073:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262495104:0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294105:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.294136:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262494848 00000100:00100000:3.0:1788269852.294142:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262494848 00000100:00100000:3.0:1788269852.294182:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262495232 00000100:00100000:3.0:1788269852.294187:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262495232 00000100:00100000:3.0:1788269852.294213:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262495360 00000100:00100000:3.0:1788269852.294218:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262495360 00000100:00100000:3.0:1788269852.294241:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262494336 00000100:00100000:3.0:1788269852.294246:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262494336 00000100:00100000:3.0:1788269852.294446:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262494976 00000100:00100000:3.0:1788269852.294451:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262494976 00000100:00100000:3.0:1788269852.294478:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262495104 00000100:00100000:3.0:1788269852.294482:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262495104 00000100:00100000:3.0:1788269852.294501:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269852.294512:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262494848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294554:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262494848:12345-0@lo:400:kworker.0 Request processed in 44us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.294562:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269852.294577:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269852.294585:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262495232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294625:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262495232:12345-0@lo:400:kworker.0 Request processed in 41us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.294632:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269852.294647:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269852.294654:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262495360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294691:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262495360:12345-0@lo:400:kworker.0 Request processed in 35us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.294698:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269852.294711:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269852.294719:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262494336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294755:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262494336:12345-0@lo:400:kworker.0 Request processed in 37us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.294768:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269852.294790:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269852.294800:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262494976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.294838:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262494976:12345-0@lo:400:kworker.0 Request processed in 40us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.294906:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269852.294972:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269852.294980:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262495104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.295019:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262495104:12345-0@lo:400:kworker.0 Request processed in 39us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.295028:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788269852.295158:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1437b1f80 x1875136262495232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.295174:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262495232:0@lo:400:kworker.0 00000100:00100000:3.0:1788269852.295216:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262494464:0@lo:400:kworker.0 00010000:00080000:3.0:1788269852.295230:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1437b0000 x1875136262495104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.295242:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262495104:0@lo:400:kworker.0 00010000:00080000:3.0:1788269852.295326:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1437b3b80 x1875136262494336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.295343:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262494336:0@lo:400:kworker.0 00010000:00080000:3.0:1788269852.295364:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1437b0a80 x1875136262494976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.295383:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262494976:0@lo:400:kworker.0 00000004:00080000:3.0:1788269852.295448:0:34594:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x63:0x0] 00000100:00100000:3.0:1788269852.295471:0:34594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34594:1875136262495616:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788269852.295509:0:34594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.295533:0:34594:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269852.295551:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262495744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788269852.295588:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.295613:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269852.295622:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262495488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269852.295649:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.295679:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262495744 00000100:00100000:3.0:1788269852.295683:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262495744 00000100:00100000:3.0:1788269852.295716:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262495488 00000100:00100000:3.0:1788269852.295720:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262495488 00000100:00100000:3.0:1788269852.295739:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269852.295747:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262495744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788269852.295767:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788269852.295816:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262495744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.295826:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269852.295839:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269852.295901:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262495488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269852.295918:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788269852.295952:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262495488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.295971:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788269852.296000:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269852.296013:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262496000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269852.296124:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.296163:0:36070:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788269852.296173:0:36070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262496128 00000100:00100000:3.0:1788269852.296177:0:36070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262496128 00000100:00080000:3.0:1788269852.296211:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788269852.296238:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1437b0a80 x1875136262495488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.296255:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262495488:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788269852.296339:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a61bb80 x1875136262495744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.296363:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262495744:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788269852.296415:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a650e00 x1875136262496000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269852.296430:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262496000:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788269852.297815:0:35299:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788269852.301471:0:37084:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788269852.301479:0:37084:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x81:0x0] 00000100:00100000:3.0:1788269852.301574:0:37084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:35310:x1875136262495872:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5124us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.301585:0:37084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269852.301614:0:37084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269852.301625:0:37084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:34592:x1875136262496128:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788269852.301920:0:36070:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788269852.301928:0:36070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788269852.302286:0:36070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262496256 00000100:00100000:3.0:1788269852.302291:0:36070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262496256 00010000:00010000:3.0:1788269852.313699:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.313709:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e06d97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.313719:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.313724:0:34555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e06d97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.313734:0:34555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e06d97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.313754:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e06d97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.313762:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e06d97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.313780:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.313782:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.313783:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269852.314032:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.314523:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db921970/0xc5f5d7a016e06d9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.314546:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x80:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.314550:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.314555:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db921970/0xc5f5d7a016e06d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.314567:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db921970/0xc5f5d7a016e06d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.314575:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db921970/0xc5f5d7a016e06d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.314583:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db921970/0xc5f5d7a016e06d9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.314601:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269852.315959:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.315964:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e06dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.315971:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.315974:0:34555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e06dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.315980:0:34555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e06dac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.316000:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e06dac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.316006:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e06dac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.316023:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.316027:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.316028:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269852.325998:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.326008:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326024:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x81:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.326028:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.326035:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326070:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326081:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326089:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326121:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269852.326145:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.326152:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326161:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.326166:0:34555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326177:0:34555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326196:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326204:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06dc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326226:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.326229:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.326231:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269852.326531:0:34579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262496512 00000100:00100000:3.0:1788269852.326538:0:34579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262496512 00000100:00100000:3.0:1788269852.326596:0:34579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269852.326606:0:34579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:35310:x1875136262496512:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788269852.326673:0:34579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:35310:x1875136262496512:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269852.326680:0:34579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:3.0:1788269852.326727:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.326732:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e06dc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326740:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x80:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.326744:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.326748:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e06dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326756:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e06dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326763:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e06dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326769:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e06dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.326780:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269852.327589:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.327595:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4e8781/0xc5f5d7a016e06dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.327603:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7f:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.327612:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.327616:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c4e8781/0xc5f5d7a016e06dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.327626:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c4e8781/0xc5f5d7a016e06dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.327633:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4e8781/0xc5f5d7a016e06dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.327639:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c4e8781/0xc5f5d7a016e06dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.327940:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269852.327946:0:37084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c4e8781/0xc5f5d7a016e06dd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.327966:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269852.329364:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.329374:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000689a972/0xc5f5d7a016e06de4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.329386:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.329391:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.329396:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000689a972/0xc5f5d7a016e06de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.329408:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000689a972/0xc5f5d7a016e06de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.329425:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000689a972/0xc5f5d7a016e06de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.329433:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000689a972/0xc5f5d7a016e06de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.329460:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269852.329877:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269852.331113:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.331119:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f821cc/0xc5f5d7a016e06df9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331179:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.331184:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.331189:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f821cc/0xc5f5d7a016e06df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331200:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f821cc/0xc5f5d7a016e06df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331209:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f821cc/0xc5f5d7a016e06df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331217:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099f821cc/0xc5f5d7a016e06df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331288:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269852.331867:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.331873:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099b93b97/0xc5f5d7a016e06e07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331881:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.331884:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.331888:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099b93b97/0xc5f5d7a016e06e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331896:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099b93b97/0xc5f5d7a016e06e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331903:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099b93b97/0xc5f5d7a016e06e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331922:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099b93b97/0xc5f5d7a016e06e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.331940:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269852.332295:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.332302:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e06e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332310:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.332321:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.332326:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e06e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332336:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e06e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332345:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e06e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332353:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e06e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332369:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269852.332821:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.332827:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9559d6f/0xc5f5d7a016e06e15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332836:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.332839:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.332843:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9559d6f/0xc5f5d7a016e06e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332853:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9559d6f/0xc5f5d7a016e06e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332861:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9559d6f/0xc5f5d7a016e06e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332876:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9559d6f/0xc5f5d7a016e06e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.332891:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269852.333296:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269852.333303:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000577c8483/0xc5f5d7a016e06e1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.333312:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74:0x0].0x0 since=644s v=(0 0) 00010000:00010000:3.0:1788269852.333315:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269852.333320:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000577c8483/0xc5f5d7a016e06e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.333330:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000577c8483/0xc5f5d7a016e06e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.333339:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000577c8483/0xc5f5d7a016e06e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.333347:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000577c8483/0xc5f5d7a016e06e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.333421:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269852.339651:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e06e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.339666:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e06e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.339674:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e06e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.339680:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e06e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.339699:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269852.340816:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269852.340825:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e06e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.340839:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.340846:0:34556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e06e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.340871:0:34556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e06e7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.340886:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e06e7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.340896:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e06e7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.340928:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.340930:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.340932:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269852.340974:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.340980:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e06e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.340988:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.340991:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.340996:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e06e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341006:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e06e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341014:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e06e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341021:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e06e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341053:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788269852.341571:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.341577:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e06e93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341590:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.341593:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.341598:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e06e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341607:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e06e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341615:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e06e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341622:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e06e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.341640:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788269852.342971:0:36072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.342979:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e06eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.342989:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.342993:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.342998:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e06eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.343009:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e06eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.343024:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e06eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.343032:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e06eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.343078:0:36072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788269852.343283:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.344318:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269852.344331:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344340:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.344344:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344352:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344365:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06eb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344372:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000868a12e2/0xc5f5d7a016e06eb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344385:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.344389:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e06ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344395:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.344397:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e06ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344404:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e06ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344424:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e06ebd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344431:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e06ebd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344442:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.344444:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.344446:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.344495:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.344502:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db921970/0xc5f5d7a016e06ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344509:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.344512:0:34556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db921970/0xc5f5d7a016e06ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344520:0:34556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db921970/0xc5f5d7a016e06ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344531:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db921970/0xc5f5d7a016e06ec4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344537:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db921970/0xc5f5d7a016e06ec4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.344561:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.344563:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.344565:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.344940:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269852.344947:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e06ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.344954:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.344957:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e06ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.344966:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e06ecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.344977:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e06ecb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.344984:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e06ecb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345000:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269852.345004:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e06ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345010:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.345013:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e06ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345020:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e06ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345029:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e06ed2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345034:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e06ed2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345074:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.345075:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.345077:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.345186:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269852.345554:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.345560:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e06ee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345569:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.345572:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.345576:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e06ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345589:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e06ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345596:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e06ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345603:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e06ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345631:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788269852.345937:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.345943:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038165e63/0xc5f5d7a016e06ee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345951:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.345955:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.345958:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038165e63/0xc5f5d7a016e06ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345968:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038165e63/0xc5f5d7a016e06ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345975:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038165e63/0xc5f5d7a016e06ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.345988:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038165e63/0xc5f5d7a016e06ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.346011:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269852.346763:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269852.346770:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5a8fb5a/0xc5f5d7a016e06ef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.346777:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.346781:0:34556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a8fb5a/0xc5f5d7a016e06ef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.346788:0:34556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a8fb5a/0xc5f5d7a016e06ef5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.346798:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5a8fb5a/0xc5f5d7a016e06ef5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.346805:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a8fb5a/0xc5f5d7a016e06ef5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.346820:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.346822:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.346826:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.348127:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269852.348133:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e06f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.348141:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.348145:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e06f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.348153:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e06f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.348165:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e06f0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.348172:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e06f0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.348186:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.348188:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.348190:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269852.349189:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.349197:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e06f11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.349208:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.349211:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.349215:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e06f11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.349231:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e06f11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.349240:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e06f11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.349248:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e06f11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.349263:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269852.349471:0:34594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34594:1875136262495616:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788269852.349488:0:34594:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x81:0x0] from OST, last_created [0x2c0000401:0x81:0x0]last_used is [0x2c0000401:0x63:0x0] 00000100:00100000:3.0:1788269852.349530:0:34594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34594:1875136262496640:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788269852.349568:0:34594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269852.349602:0:34594:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269852.349649:0:36073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262496640 00000100:00100000:1.0:1788269852.349655:0:36073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262496640 00000100:00100000:1.0:1788269852.349702:0:36073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269852.349712:0:36073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:34594:x1875136262496640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788269852.349746:0:36073:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 130 00000100:00100000:1.0:1788269852.352839:0:36073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:34594:x1875136262496640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3124us (3265us total) trans 21474836482 rc 0/0 00000100:00100000:1.0:1788269852.352850:0:36073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269852.352928:0:34594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34594:1875136262496640:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788269852.352943:0:34594:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x81:0x0]-[0x2c0000401:0xa1:0x0] 00010000:00010000:1.0:1788269852.352964:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269852.352971:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e06f18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.352988:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.352992:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e06f18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.353002:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e06f18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.353019:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e06f18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.353028:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e06f18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.353064:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.353067:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.353068:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.355361:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269852.355369:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e06f1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.355377:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269852.355382:0:34556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e06f1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.355391:0:34556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e06f1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.355408:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e06f1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.355416:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e06f1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.355431:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.355433:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269852.355435:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.356190:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.356196:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d68754/0xc5f5d7a016e06f26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.356204:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.356208:0:34555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d68754/0xc5f5d7a016e06f26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.356216:0:34555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d68754/0xc5f5d7a016e06f26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.356228:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d68754/0xc5f5d7a016e06f26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.356235:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d68754/0xc5f5d7a016e06f26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.356263:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.356265:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.356267:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269852.357068:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.357076:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.357086:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.357089:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.357094:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.357104:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.357113:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.357120:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.357150:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269852.357854:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269852.357861:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.357870:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269852.357874:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.357882:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.357896:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.357903:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e06f2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269852.357932:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.357934:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269852.357936:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269852.358088:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.358095:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e06f34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358104:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.358108:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.358112:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e06f34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358121:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e06f34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358139:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e06f34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358147:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e06f34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358165:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788269852.358776:0:37084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269852.358783:0:37084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e06f3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358792:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=644s v=(0 0) 00010000:00010000:1.0:1788269852.358796:0:37084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269852.358801:0:37084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e06f3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358811:0:37084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e06f3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358819:0:37084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e06f3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358827:0:37084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e06f3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269852.358846:0:37084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788269852.358892:0:37084:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:98 00000100:00100000:1.0:1788269852.359008:0:37084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:34592:x1875136262496128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 57383us (62989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269852.359019:0:37084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000001:00080000:3.0:1788269852.364507:0:36067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836482 is committed 00000001:00100000:3.0:1788269852.364557:0:36067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788269852.365136:0:34592:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836482 gen 2 00000100:00100000:1.0:1788269852.365145:0:34592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34592:1875136262496768:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788269852.365163:0:34592:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x81:0x0]-[0x280000401:0xa1:0x0] 00010000:00010000:1.0:1788269852.933998:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788269854.384749:0:37344:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269854.384954:0:37344:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788269854.405779:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262497024 00000100:00100000:3.0:1788269854.405787:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262497024 00000100:00100000:3.0:1788269854.405924:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269854.405937:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262497024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788269854.405967:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788269854.406024:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262497024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.406031:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269854.499707:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253023104 00000100:00100000:3.0:1788269854.499719:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253023104 00000100:00100000:3.0:1788269854.499771:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:3.0:1788269854.499780:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875136253023104:12345-192.168.201.42@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788269854.499807:0:34562:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 101677dd-db4e-4988-b466-0ec83e00f72e@192.168.201.42@tcp t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:3.0:1788269854.499836:0:34562:0:(genops.c:1385:class_connect()) connect: client 101677dd-db4e-4988-b466-0ec83e00f72e, cookie 0xc5f5d7a016e06f42 00000100:00080000:3.0:1788269854.499991:0:34562:0:(import.c:65:import_set_state_nolock()) ffff98c1435b5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269854.500091:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+5:2399:x1875136253023104:12345-192.168.201.42@tcp:250:mount.lustre.0 Request processed in 309us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.500100:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:1.0:1788269854.503026:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253023232 00000100:00100000:1.0:1788269854.503035:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253023232 00000100:00100000:1.0:1788269854.503154:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:1.0:1788269854.503164:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+5:26291:x1875136253023232:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269854.503179:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269854.503195:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9e600/0xc5f5d7a016e06f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101223 expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.503221:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9e600/0xc5f5d7a016e06f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101223 expref: 6 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.503231:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9e600/0xc5f5d7a016e06f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101223 expref: 6 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.503239:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e600, rc 0) 00000100:00100000:1.0:1788269854.503326:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+6:26291:x1875136253023232:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269854.503333:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:3.0:1788269854.504766:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253023360 00000100:00100000:3.0:1788269854.504774:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253023360 00000100:00100000:3.0:1788269854.504826:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:3.0:1788269854.504836:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+6:26291:x1875136253023360:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269854.504995:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+6:26291:x1875136253023360:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 159us (274us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269854.505003:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:3.0:1788269854.510889:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253023616 00000100:00100000:3.0:1788269854.510899:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253023616 00000100:00100000:3.0:1788269854.510950:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:3.0:1788269854.510960:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+7:26291:x1875136253023616:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269854.511246:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+8:26291:x1875136253023616:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 287us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.511254:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:3.0:1788269854.517670:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253023872 00000100:00100000:3.0:1788269854.517681:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253023872 00000100:00100000:3.0:1788269854.517785:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788269854.517794:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+8:26310:x1875136253023872:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269854.517951:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+8:26310:x1875136253023872:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 157us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.517959:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788269854.534976:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253024128 00000100:00100000:3.0:1788269854.534985:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253024128 00000100:00100000:1.0:1788269854.540385:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253024256 00000100:00100000:1.0:1788269854.540395:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253024256 00000100:00100000:1.0:1788269854.540451:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:1.0:1788269854.540462:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+8:26291:x1875136253024256:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269854.540478:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269854.540495:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9f400/0xc5f5d7a016e06f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610125b expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.540524:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9f400/0xc5f5d7a016e06f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610125b expref: 9 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.540534:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9f400/0xc5f5d7a016e06f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610125b expref: 9 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.540547:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f400, rc 0) 00000100:00100000:1.0:1788269854.540601:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+9:26291:x1875136253024256:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 142us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269854.540608:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:3.0:1788269854.546993:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269854.547078:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253024512 00000100:00100000:1.0:1788269854.547087:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253024512 00000100:00100000:1.0:1788269854.547131:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788269854.547142:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+9:26291:x1875136253024512:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269854.547156:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269854.547172:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9ee00/0xc5f5d7a016e06f5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101262 expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.547191:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9ee00/0xc5f5d7a016e06f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101262 expref: 10 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.547198:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9ee00/0xc5f5d7a016e06f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101262 expref: 10 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269854.547204:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ee00, rc 0) 00000100:00100000:1.0:1788269854.547238:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+10:26291:x1875136253024512:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269854.547245:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788269854.550179:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253024768 00000100:00100000:1.0:1788269854.550184:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253024768 00000100:00100000:1.0:1788269854.550221:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:1.0:1788269854.550229:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+10:26291:x1875136253024768:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788269854.550349:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+10:26291:x1875136253024768:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 120us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269854.550357:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788269854.551745:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269854.556926:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253025024 00000100:00100000:1.0:1788269854.556934:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253025024 00000100:00100000:1.0:1788269854.556981:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:1.0:1788269854.556989:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+10:26315:x1875136253025024:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269854.557153:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+10:26315:x1875136253025024:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 163us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269854.557162:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788269854.570963:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253025536 00000100:00100000:3.0:1788269854.570974:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253025536 00000100:00100000:1.0:1788269854.571062:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253025664 00000100:00100000:1.0:1788269854.571067:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253025664 00000100:00100000:3.0:1788269854.571072:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788269854.571088:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:0:x1875136253025536:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788269854.571124:0:34567:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788269854.571627:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:0:x1875136253025536:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 545us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.571634:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788269854.576550:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269854.576585:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269854.576608:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269854.576992:0:34579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253026176 00000100:00100000:3.0:1788269854.576998:0:34579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253026176 00000100:00100000:3.0:1788269854.577035:0:34579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788269854.577063:0:34579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26291:x1875136253026176:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788269854.577132:0:34579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26291:x1875136253026176:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 70us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.577139:0:34579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788269854.577159:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788269854.577163:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875136253026048:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788269854.577195:0:36072:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ad12a1e2-5e6e-4db2-844b-4676c5d604e3@192.168.201.42@tcp t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:3.0:1788269854.577223:0:36072:0:(genops.c:1385:class_connect()) connect: client ad12a1e2-5e6e-4db2-844b-4676c5d604e3, cookie 0xc5f5d7a016e06f73 00002000:00100000:3.0:1788269854.577233:0:36072:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad12a1e2-5e6e-4db2-844b-4676c5d604e3/ffff98c1435b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269854.577249:0:36072:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269854.577403:0:36072:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788269854.577439:0:36072:0:(import.c:65:import_set_state_nolock()) ffff98c1435b7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269854.577470:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:2399:x1875136253026048:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 304us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.577478:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788269854.580725:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000004:00080000:1.0:1788269854.581977:0:34570:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 865us 00000004:00200000:3.0:1788269854.591991:0:34570:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788269854.592170:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26291:x1875136253026304:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 11165us (11448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269854.592329:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269854.667364:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269854.916931:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262497152:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788269856.004399:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269856.168373:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253026560 00000100:00100000:1.0:1788269856.168384:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253026560 00000100:00100000:1.0:1788269856.168553:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788269856.168565:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+7:26391:x1875136253026560:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:1.0:1788269856.168603:0:34568:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:1.0:1788269856.168697:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+7:26391:x1875136253026560:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 134us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269856.168708:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788269856.171349:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253026688 00000100:00100000:3.0:1788269856.171369:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253026688 00000100:00100000:3.0:1788269856.171508:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788269856.171518:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26391:x1875136253026688:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:3.0:1788269856.171551:0:34569:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788269856.171648:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26391:x1875136253026688:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 131us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.171656:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788269856.173645:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253026816 00000100:00100000:3.0:1788269856.173653:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253026816 00000100:00100000:3.0:1788269856.173716:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269856.173726:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26391:x1875136253026816:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:3.0:1788269856.173745:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788269856.173809:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26391:x1875136253026816:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.173817:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269856.174665:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253026944 00000100:00100000:3.0:1788269856.174669:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253026944 00000100:00100000:3.0:1788269856.174705:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269856.174712:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26391:x1875136253026944:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:3.0:1788269856.174721:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788269856.174758:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26391:x1875136253026944:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.174762:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269856.260136:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253027200 00000100:00100000:3.0:1788269856.260142:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253027200 00000100:00100000:3.0:1788269856.260217:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:3.0:1788269856.260239:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+11:26423:x1875136253027200:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269856.260382:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+11:26423:x1875136253027200:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.260389:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:3.0:1788269856.267410:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253027456 00000100:00100000:3.0:1788269856.267419:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253027456 00000100:00100000:1.0:1788269856.267513:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:1.0:1788269856.267540:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+11:26430:x1875136253027456:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269856.267702:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+11:26430:x1875136253027456:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 179us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269856.267710:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:1.0:1788269856.276066:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269856.278358:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253027712 00000100:00100000:1.0:1788269856.278364:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253027712 00000100:00100000:1.0:1788269856.278399:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788269856.278407:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26aca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+11:26430:x1875136253027712:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269856.278510:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26aca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+11:26430:x1875136253027712:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269856.278518:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788269856.282125:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253027968 00000100:00100000:1.0:1788269856.282131:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253027968 00000100:00100000:3.0:1788269856.282568:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788269856.282581:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26aca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+12:26423:x1875136253027968:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788269856.282603:0:34562:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788269856.282628:0:34562:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788269856.282632:0:34562:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788269856.282636:0:34562:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788269856.282638:0:34562:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788269856.282640:0:34562:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 22 00000100:00100000:3.0:1788269856.284025:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26aca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+12:26423:x1875136253027968:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 1441us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.284037:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788269856.287952:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253028224 00000100:00100000:3.0:1788269856.287958:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253028224 00000100:00100000:3.0:1788269856.288121:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:3.0:1788269856.288129:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+13:26423:x1875136253028224:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269856.288256:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+13:26423:x1875136253028224:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 126us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.288265:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:3.0:1788269856.291245:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253028480 00000100:00100000:3.0:1788269856.291253:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253028480 00000100:00100000:3.0:1788269856.291302:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788269856.291308:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+13:26434:x1875136253028480:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269856.291405:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:101677dd-db4e-4988-b466-0ec83e00f72e+13:26434:x1875136253028480:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.291411:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788269856.292804:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253028608 00000100:00100000:1.0:1788269856.292812:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253028608 00000100:00100000:1.0:1788269856.292873:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:1.0:1788269856.292881:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+13:26434:x1875136253028608:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269856.293102:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+13:26434:x1875136253028608:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 221us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269856.293109:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:1.0:1788269856.300024:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253028992 00000100:00100000:1.0:1788269856.300029:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253028992 00000100:00100000:1.0:1788269856.300257:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788269856.300263:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875136253028992:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788269856.300278:0:34568:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 506e0ad4-cf80-4f01-9357-704d4850a25b@192.168.201.42@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:1.0:1788269856.300301:0:34568:0:(genops.c:1385:class_connect()) connect: client 506e0ad4-cf80-4f01-9357-704d4850a25b, cookie 0xc5f5d7a016e06fab 00000004:00100000:1.0:1788269856.300314:0:34568:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788269856.300358:0:34568:0:(import.c:65:import_set_state_nolock()) ffff98c277e31000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269856.300497:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:506e0ad4-cf80-4f01-9357-704d4850a25b+6:2399:x1875136253028992:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 232us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269856.300505:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788269856.302345:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253029248 00000100:00100000:3.0:1788269856.302352:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253029248 00000100:00100000:3.0:1788269856.302406:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253028864 00000100:00100000:3.0:1788269856.302409:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253028864 00000100:00100000:3.0:1788269856.302430:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788269856.302438:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+7:26423:x1875136253029248:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788269856.302468:0:34569:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1788269856.302519:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+7:26423:x1875136253029248:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.302527:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788269856.302543:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788269856.302555:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+6:0:x1875136253028864:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788269856.302567:0:34569:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1788269856.302601:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+6:0:x1875136253028864:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 35us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.302607:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788269856.303534:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269856.304072:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269856.305989:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269856.306035:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269856.306089:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269856.309624:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269856.396906:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269856.396963:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253030016 00000100:00100000:3.0:1788269856.396972:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253030016 00000100:00100000:3.0:1788269856.397021:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788269856.397028:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+6:26457:x1875136253030016:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:3.0:1788269856.397065:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269856.397084:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e06fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101303 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269856.397135:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269856.397145:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269856.397154:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269856.397186:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788269856.397189:0:34569:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788269856.397204:0:34569:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269856.397225:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e06fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101303 expref: 8 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269856.397257:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101303 expref: 7 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269856.397266:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240800) 00010000:00010000:3.0:1788269856.397278:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269856.397282:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677600, rc 0) 00000100:00100000:3.0:1788269856.397346:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+7:26457:x1875136253030016:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 318us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269856.397353:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000040:00080000:1.0:1788269856.836592:0:35325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788269857.476601:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262497536:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.476715:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477403:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262498048:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477444:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477583:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262498560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477609:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477634:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262499072:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477664:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477710:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262497536:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477723:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788269857.477731:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262497664:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477766:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477790:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262498176:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477831:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477855:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262498688:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477886:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477905:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262499200:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.477951:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269857.477986:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262497664:0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.478056:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269857.478067:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262498560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.478101:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262498560:12345-0@lo:400:kworker.0 Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269857.478110:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269857.478133:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788269857.478143:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262498688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269857.478182:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262498688:12345-0@lo:400:kworker.0 Request processed in 40us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269857.478190:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000001:02000400:3.0:1788269857.635535:0:37441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788269857.988241:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262499328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788269857.988326:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269857.988694:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262499328:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788269858.502404:0:36885:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 506e0ad4-cf80-4f01-9357-704d4850a25b 00000001:00100000:1.0:1788269858.502417:0:36885:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad12a1e2-5e6e-4db2-844b-4676c5d604e3 00000001:00080000:1.0:1788269858.502426:0:36885:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836482 is committed 00000001:00100000:3.0:1788269858.506949:0:36067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 506e0ad4-cf80-4f01-9357-704d4850a25b 00000001:00100000:3.0:1788269858.506977:0:36067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad12a1e2-5e6e-4db2-844b-4676c5d604e3 00010000:00010000:1.0:1788269859.077428:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269859.254829:0:34550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262499712 00000100:00100000:3.0:1788269859.254837:0:34550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262499712 00000100:00100000:3.0:1788269859.254869:0:34550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262499840 00000100:00100000:3.0:1788269859.254872:0:34550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262499840 00000100:00100000:3.0:1788269859.254882:0:34550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262499968 00000100:00100000:3.0:1788269859.254884:0:34550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262499968 00000100:00100000:3.0:1788269859.254892:0:34550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262500096 00000100:00100000:3.0:1788269859.254895:0:34550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262500096 00010000:00010000:3.0:1788269859.255077:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269859.255083:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255090:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269859.255094:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255118:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269859.255126:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269859.255132:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269859.255170:0:34556:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255176:0:34556:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269859.255196:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255203:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee000/0xc5f5d7a016e06d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06d20 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255215:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269859.255218:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255224:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269859.255227:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255234:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269859.255240:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269859.255251:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269859.255264:0:34556:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255270:0:34556:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269859.255285:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255292:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e06c7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c86 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255314:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269859.255317:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255323:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269859.255325:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255332:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269859.255338:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269859.255343:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269859.255355:0:34556:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255361:0:34556:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269859.255373:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255379:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144192e00/0xc5f5d7a016e06c32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e06c39 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255391:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269859.255392:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269859.255394:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269859.255413:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25a72341-2152-4ec8-9ca0-7a670d594ca1:3610:1875136262500224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269859.255439:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269859.255472:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269859.255477:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25a72341-2152-4ec8-9ca0-7a670d594ca1:3610:1875136262500608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269859.255744:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269859.255773:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262500352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269859.255807:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269859.255824:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269859.255830:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262500480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269859.255834:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269859.255846:0:34553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262500608 00000100:00100000:3.0:1788269859.255849:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269859.255850:0:34553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262500608 00010000:00010000:1.0:1788269859.255863:0:34553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c143b9fa00/0xc5f5d7a016e06c39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c32 expref: 24 pid: 34562 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269859.255869:0:35719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262500352 00000100:00100000:3.0:1788269859.255872:0:35719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262500352 00000100:00100000:1.0:1788269859.255873:0:34553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262500480 00000100:00100000:1.0:1788269859.255875:0:34553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262500480 00010000:00010000:1.0:1788269859.255884:0:34553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e06c47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c40 expref: 26 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255885:0:35719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27a0bf600/0xc5f5d7a016e06c86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c7f expref: 26 pid: 34562 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269859.255895:0:34553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269859.255898:0:35719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269859.255901:0:34553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25a72341-2152-4ec8-9ca0-7a670d594ca1+26:3610:x1875136262500608:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269859.255903:0:35719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25a72341-2152-4ec8-9ca0-7a670d594ca1+26:3607:x1875136262500480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269859.255907:0:34553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269859.255908:0:35719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269859.255911:0:34553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c143b9fa00/0xc5f5d7a016e06c39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c32 expref: 26 pid: 34562 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255912:0:35719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e06c47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c40 expref: 26 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.255919:0:34553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c143b9fa00/0xc5f5d7a016e06c39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c32 expref: 26 pid: 34562 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.255926:0:35719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e06c47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e06c40 expref: 26 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.258648:0:34553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269859.258691:0:34553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:3610:x1875136262500608:12345-0@lo:103:ldlm_bl.0 Request processed in 2789us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269859.258698:0:34553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269859.259020:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:3.0:1788269859.259550:0:35719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e06c47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e06c40 expref: 21 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.259560:0:35719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269859.259590:0:35719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:3607:x1875136262500480:12345-0@lo:103:ldlm_bl.0 Request processed in 3686us (3739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269859.259597:0:35719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269859.259728:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262500480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269859.259737:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262500352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269859.259905:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269859.259964:0:34554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253030272 00000100:00100000:3.0:1788269859.259968:0:34554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253030272 00010000:00010000:3.0:1788269859.259987:0:34554:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030000/0xc5f5d7a016e06f9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561012d2 expref: 13 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269859.260016:0:34554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788269859.260024:0:34554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:101677dd-db4e-4988-b466-0ec83e00f72e+13:2401:x1875136253030272:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269859.260033:0:34554:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269859.260068:0:34554:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030000/0xc5f5d7a016e06f9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561012d2 expref: 13 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260079:0:34554:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030000/0xc5f5d7a016e06f9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561012d2 expref: 13 pid: 34561 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260091:0:34554:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260109:0:34554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260123:0:34554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260130:0:34554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260135:0:34554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260141:0:34554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260148:0:34554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269859.260152:0:34554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260160:0:34554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260168:0:34554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c240030800/0xc5f5d7a016e06fce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.260179:0:34554:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269859.260211:0:34554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:101677dd-db4e-4988-b466-0ec83e00f72e+13:2401:x1875136253030272:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 187us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269859.260217:0:34554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788269859.524882:0:36075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262500736 00000100:00100000:1.0:1788269859.524890:0:36075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262500736 00000100:00100000:1.0:1788269859.524952:0:36075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269859.524963:0:36075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262500736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269859.524991:0:36075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788269859.525066:0:36075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262500736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269859.525073:0:36075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269859.904175:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253030400 00000100:00100000:3.0:1788269859.904212:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253030400 00000100:00100000:3.0:1788269859.904291:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788269859.904302:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+7:26917:x1875136253030400:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269859.904321:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269859.904342:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e06fd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610130a expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904406:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904420:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904431:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904446:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904453:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904458:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904548:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676800/0xc5f5d7a016e06fea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904557:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676800/0xc5f5d7a016e06fea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904562:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676800/0xc5f5d7a016e06fea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269859.904600:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788269859.904604:0:34569:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788269859.904643:0:34569:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676800/0xc5f5d7a016e06fea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904654:0:34569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904661:0:34569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904669:0:34569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904675:0:34569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269859.904678:0:34569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904686:0:34569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904698:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240800) 00010000:00010000:3.0:1788269859.904701:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269859.904705:0:34569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904711:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e06fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904724:0:34569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904739:0:34569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904745:0:34569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904750:0:34569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269859.904753:0:34569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904759:0:34569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904767:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98c1429f7600) 00010000:00010000:3.0:1788269859.904770:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269859.904773:0:34569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904795:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e06fe3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904827:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e06fd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610130a expref: 9 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904840:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676800/0xc5f5d7a016e06fea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610130a expref: 8 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.904848:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c1429f7f00) 00010000:00010000:3.0:1788269859.904850:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269859.904859:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676800, rc 0) 00000100:00100000:3.0:1788269859.904925:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26917:x1875136253030400:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 626us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269859.904931:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788269859.911135:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269859.917830:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253030912 00000100:00100000:3.0:1788269859.917838:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253030912 00000100:00100000:3.0:1788269859.917898:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:3.0:1788269859.917909:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26917:x1875136253030912:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788269859.917989:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26917:x1875136253030912:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269859.917998:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788269859.918871:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269859.962229:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253031168 00000100:00100000:3.0:1788269859.962240:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253031168 00000100:00100000:3.0:1788269859.962305:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788269859.962314:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26926:x1875136253031168:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269859.962332:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269859.962362:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e07014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101318 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962426:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962440:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962451:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962465:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962487:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962494:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962532:0:34569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962538:0:34569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962545:0:34569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962551:0:34569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269859.962555:0:34569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962562:0:34569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962573:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240800) 00010000:00010000:3.0:1788269859.962576:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269859.962580:0:34569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962586:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e0701b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962598:0:34569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962624:0:34569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962630:0:34569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962635:0:34569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269859.962638:0:34569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962644:0:34569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962651:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff98c1429f7600) 00010000:00010000:3.0:1788269859.962653:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269859.962656:0:34569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962662:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962693:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e07014 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101318 expref: 9 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962702:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240800) 00010000:00010000:3.0:1788269859.962704:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269859.962708:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e07014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101318 expref: 9 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.962727:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677000, rc 0) 00000100:00100000:3.0:1788269859.962804:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26926:x1875136253031168:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 491us (650us total) trans 0 rc 301/301 00000100:00100000:3.0:1788269859.962809:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788269859.968856:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269859.970821:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269859.970886:0:35719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253031680 00000100:00100000:3.0:1788269859.970893:0:35719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253031680 00010000:00010000:3.0:1788269859.970935:0:35719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101303 expref: 6 pid: 34569 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269859.970965:0:35719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788269859.970975:0:35719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+6:2400:x1875136253031680:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269859.970987:0:35719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269859.970993:0:35719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101303 expref: 6 pid: 34569 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.971006:0:35719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101303 expref: 6 pid: 34569 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.971022:0:35719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e06fc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101303 expref: 6 pid: 34569 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.971034:0:35719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240800) 00010000:00010000:3.0:1788269859.971064:0:35719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.971075:0:35719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.971095:0:35719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.971116:0:35719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269859.971166:0:35719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2400:x1875136253031680:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 191us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269859.971175:0:35719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788269859.971750:0:34567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:34567:1875136262500992:0@lo:700:mdt00_000.0 00000100:00100000:1.0:1788269859.972021:0:34567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:34567:1875136262501120:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788269859.972084:0:34567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269859.972106:0:34567:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251111240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269859.972322:0:34567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:34567:1875136262501120:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1788269859.972387:0:34567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269859.972434:0:34567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1788269859.972441:0:34567:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98c24888d540 with version 1 00000040:00080000:1.0:1788269859.972498:0:34567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269859.972510:0:34567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1788269859.972517:0:34567:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98c24bb06900 with version 2 00000040:00080000:1.0:1788269859.973937:0:34567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269859.974199:0:34567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1788269859.974348:0:34567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200002340:0x2:0x0].1, 2152 off34920 00000040:00080000:1.0:1788269859.974432:0:34567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x2:0x0].1, 2352 off35120 00000004:00080000:1.0:1788269859.974438:0:34567:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98c24888d840 with version 3 00000100:00100000:3.0:1788269859.975695:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262501632 00000100:00100000:3.0:1788269859.975701:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262501632 00000100:00100000:3.0:1788269859.975743:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269859.975752:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:34589:x1875136262501632:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:3.0:1788269859.980256:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836482 is committed 00010000:00010000:1.0:1788269859.984719:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e07037 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984740:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e07037 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984752:0:34567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e07037 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984771:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e0703e lrc: 3/0,1 mode: --/PW res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984791:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e0703e lrc: 3/0,1 mode: PW/PW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984799:0:34567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e0703e lrc: 3/0,1 mode: PW/PW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984846:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984853:0:34567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.984862:0:34567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269859.984883:0:34567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:34567:1875136262502016:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1788269859.984926:0:34567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269859.984953:0:34567:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269859.984981:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262502016 00000100:00100000:3.0:1788269859.984989:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262502016 00000100:00100000:3.0:1788269859.985058:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788269859.985069:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34567:x1875136262502016:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788269859.985088:0:34573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269859.985180:0:34573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677600/0xc5f5d7a016e0704c lrc: 2/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07045 expref: -99 pid: 34573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.985201:0:34573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677600/0xc5f5d7a016e0704c lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07045 expref: 7 pid: 34573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.985228:0:34573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677600/0xc5f5d7a016e0704c lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07045 expref: 7 pid: 34573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269859.985237:0:34573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:3.0:1788269859.985248:0:34573:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269859.985252:0:34573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677600, rc 0) 00000100:00100000:3.0:1788269859.985289:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:34567:x1875136262502016:12345-0@lo:101:mdt00_000.0 Request processed in 223us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269859.985295:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269859.985884:0:34567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:34567:1875136262502016:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788269859.985901:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 4/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.985927:0:34567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 4/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269859.985948:0:34567:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a45b216 reply state 00000000b84d49b5 transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e0703e lrc: 3/0,1 mode: PW/PW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.985961:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e0703e lrc: 3/0,1 mode: TXN/TXN res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.985969:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002340:0x1:0x0].0x0 (ffff98c143878700) 00010000:00010000:1.0:1788269859.985972:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269859.985975:0:34567:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788269859.985980:0:34567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 4/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.985989:0:34567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269859.985999:0:34567:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002340:0x1:0x0] 00000004:00010000:1.0:1788269859.986005:0:34567:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a45b216 reply state 00000000b84d49b5 transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e07037 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986012:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e07037 lrc: 3/0,1 mode: TXN/TXN res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986018:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269859.986021:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269859.986023:0:34567:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1788269859.986027:0:34567:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788269859.986035:0:34567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986057:0:34567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986064:0:34567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986070:0:34567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269859.986074:0:34567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986082:0:34567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986092:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240800) 00010000:00010000:1.0:1788269859.986094:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269859.986098:0:34567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986104:0:34567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e07029 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269859.986122:0:34567:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a45b216 reply state 00000000b84d49b5 transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff98c240031a00/0xc5f5d7a016e07030 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986130:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c240031a00/0xc5f5d7a016e07030 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.986136:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff98c259240e00) 00010000:00010000:1.0:1788269859.986138:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269859.986140:0:34567:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1788269859.986221:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+9:26926:x1875136253031552:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 17208us (17375us total) trans 21474836482 rc 0/0 00000100:00100000:1.0:1788269859.986229:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788269859.994401:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269859.997798:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253031936 00000100:00100000:1.0:1788269859.997808:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253031936 00000100:00100000:1.0:1788269859.997975:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788269859.997989:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+10:26927:x1875136253031936:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788269859.998011:0:36273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269859.998034:0:36273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e07061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101326 expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998420:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998434:0:36273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998458:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998468:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998475:0:36273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998481:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998556:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e07076 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998563:0:36273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e07076 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998569:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e07076 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269859.998645:0:36273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269859.998650:0:36273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1788269859.998671:0:36273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e07076 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998688:0:36273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998694:0:36273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998700:0:36273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998706:0:36273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269859.998710:0:36273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.998717:0:36273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999114:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240000) 00010000:00010000:1.0:1788269859.999117:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269859.999122:0:36273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999128:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999141:0:36273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999147:0:36273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999151:0:36273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999156:0:36273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269859.999159:0:36273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999164:0:36273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999170:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff98c259240e00) 00010000:00010000:1.0:1788269859.999173:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269859.999184:0:36273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999190:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0706f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999215:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e07061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101326 expref: 12 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999227:0:36273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e07076 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101326 expref: 11 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269859.999234:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269859.999236:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788269859.999238:0:36273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f600, rc 0) 00000100:00100000:1.0:1788269859.999302:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26927:x1875136253031936:12345-192.168.201.42@tcp:101:rm.0 Request processed in 1317us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269859.999309:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269860.001805:0:34578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253032064 00000100:00100000:3.0:1788269860.001814:0:34578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253032064 00000100:00100000:3.0:1788269860.001877:0:34578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269860.001887:0:34578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26927:x1875136253032064:12345-192.168.201.42@tcp:900:rm.0 00000100:00100000:3.0:1788269860.002006:0:34578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26927:x1875136253032064:12345-192.168.201.42@tcp:900:rm.0 Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.002013:0:34578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269860.003239:0:34578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253032192 00000100:00100000:3.0:1788269860.003245:0:34578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253032192 00000100:00100000:3.0:1788269860.003281:0:34578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269860.003291:0:34578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26927:x1875136253032192:12345-192.168.201.42@tcp:900:rm.0 00000100:00100000:3.0:1788269860.003352:0:34578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26927:x1875136253032192:12345-192.168.201.42@tcp:900:rm.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.003360:0:34578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269860.005079:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253032320 00000100:00100000:3.0:1788269860.005088:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253032320 00000100:00100000:3.0:1788269860.005135:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788269860.005144:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26927:x1875136253032320:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:3.0:1788269860.005161:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269860.005181:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e0707d lrc: 2/0,0 mode: --/CR res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610132d expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.005253:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 3/1,0 mode: --/PR res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.005264:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 3/1,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.005272:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 3/1,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269860.005319:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002340:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788269860.005324:0:34569:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788269860.005360:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e0707d lrc: 0/0,0 mode: --/CR res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610132d expref: 13 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.005375:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 3/0,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610132d expref: 12 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.005381:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002340:0x1:0x0].0x0 (ffff98c143878700) 00010000:00010000:3.0:1788269860.005383:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788269860.005385:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677c00, rc 0) 00000100:00100000:3.0:1788269860.005441:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+12:26927:x1875136253032320:12345-192.168.201.42@tcp:101:rm.0 Request processed in 298us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.005447:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788269860.008377:0:34550:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788269860.008390:0:34550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262502144 00000100:00100000:3.0:1788269860.008394:0:34550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262502144 00000100:00100000:3.0:1788269860.008440:0:34550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269860.008449:0:34550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c277ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:34567:x1875136262502144:12345-0@lo:104: 00010000:00010000:3.0:1788269860.008469:0:34550:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.008551:0:34550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269860.008558:0:34550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c277ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:34567:x1875136262502144:12345-0@lo:104: Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.008565:0:34550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788269860.008572:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269860.008580:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.008589:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:1.0:1788269860.008595:0:34555:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 4/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269860.008606:0:34555:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 4/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.008645:0:34555:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 2/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.008651:0:34555:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269860.008675:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 1/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.008683:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e800/0xc5f5d7a016e07045 lrc: 0/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0704c expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.008704:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269860.008706:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269860.008708:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269860.008718:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269860.008729:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262502272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269860.008760:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788269860.011025:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836483 is committed 00000100:00100000:1.0:1788269860.011579:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262502272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269860.036762:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262502400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269860.036850:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.037129:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262502400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269860.040797:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253032704 00000100:00100000:1.0:1788269860.040807:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253032704 00000100:00100000:1.0:1788269860.040868:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788269860.040878:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+12:26933:x1875136253032704:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269860.040897:0:36273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269860.040918:0:36273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e070ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101342 expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.040985:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e070b5 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.040999:0:36273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e070b5 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.041011:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e070b5 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269860.041115:0:36273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269860.041120:0:36273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1788269860.041139:0:36273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e070b5 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.041160:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e070ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101342 expref: 14 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.041172:0:36273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e070b5 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101342 expref: 13 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.041188:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269860.041190:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269860.041194:0:36273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fc00, rc 0) 00000100:00100000:1.0:1788269860.041250:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+13:26933:x1875136253032704:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 374us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269860.041257:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788269860.043380:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253032960 00000100:00100000:3.0:1788269860.043389:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253032960 00000100:00100000:3.0:1788269860.043476:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788269860.043484:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+13:26933:x1875136253032960:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269860.043495:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269860.043510:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e070bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101349 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269860.043632:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788269860.043740:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e070bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101349 expref: 15 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.043755:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240000) 00010000:00010000:3.0:1788269860.043758:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269860.043762:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e070bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101349 expref: 15 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.043786:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677000, rc 0) 00000100:00100000:3.0:1788269860.043839:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:26933:x1875136253032960:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 356us (507us total) trans 21474836483 rc 301/301 00000100:00100000:3.0:1788269860.043859:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:1.0:1788269860.045036:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253033216 00000100:00100000:1.0:1788269860.045068:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253033216 00000100:00100000:1.0:1788269860.045118:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:1.0:1788269860.045126:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:26933:x1875136253033216:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:1.0:1788269860.045158:0:36273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269860.045175:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e070b5 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101342 expref: 14 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045190:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269860.045194:0:36273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269860.045220:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e070ca lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045232:0:36273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e070ca lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045241:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e070ca lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045257:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e070d1 lrc: 3/0,1 mode: --/PW res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045271:0:36273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 2/0,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610132d expref: 13 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045280:0:36273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e070d1 lrc: 4/0,1 mode: --/PW res: [0x200002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045309:0:36273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 3/0,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610132d expref: 13 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.045321:0:36273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677c00/0xc5f5d7a016e07084 lrc: 4/0,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610132d expref: 13 pid: 34569 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269860.045335:0:36273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:36273:1875136262502528:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269860.045400:0:36273:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.046525:0:36273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:36273:1875136262502528:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269860.046546:0:36273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e070d1 lrc: 3/0,1 mode: --/PW res: [0x200002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.046825:0:36273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e070d1 lrc: 3/0,1 mode: PW/PW res: [0x200002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.046847:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e070d1 lrc: 3/0,1 mode: PW/PW res: [0x200002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.046890:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.046899:0:36273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x0 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.046909:0:36273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269860.046927:0:36273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:36273:1875136262502656:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1788269860.046964:0:36273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.046993:0:36273:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.048798:0:34572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:34572:1875136262502784:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269860.048833:0:34572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 3/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 6 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269860.048834:0:35719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253033472 00000100:00100000:3.0:1788269860.048840:0:35719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253033472 00010000:00010000:1.0:1788269860.048844:0:34572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269860.048847:0:34572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788269860.048851:0:34572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 3/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 6 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.048859:0:34572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 3/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 6 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.048864:0:35719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e07092 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101334 expref: 6 pid: 34567 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.048865:0:34572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fa00, rc 0) 00000100:00100000:3.0:1788269860.048899:0:35719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788269860.048907:0:35719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:2400:x1875136253033472:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788269860.048910:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:36273:x1875136262502656:12345-0@lo:101:mdt00_003.0 Request processed in 1816us (1945us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269860.048917:0:35719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788269860.048917:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788269860.048923:0:35719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e07092 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101334 expref: 6 pid: 34567 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.048938:0:35719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e07092 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101334 expref: 6 pid: 34567 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.048957:0:35719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e07092 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101334 expref: 6 pid: 34567 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.048973:0:35719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:3.0:1788269860.048978:0:35719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 2/0,0 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 5 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.048988:0:35719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 2/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 5 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049005:0:35719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 5 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049086:0:35719:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 5 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269860.049100:0:35719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:35719:1875136262502912:0@lo:105: 00000100:00100000:3.0:1788269860.049220:0:34550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262502912 00000100:00100000:3.0:1788269860.049225:0:34550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262502912 00000100:00100000:3.0:1788269860.049257:0:34550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269860.049265:0:34550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:35719:x1875136262502912:12345-0@lo:105: 00010000:00010000:3.0:1788269860.049274:0:34550:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 5/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e070df expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049282:0:34550:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 5/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e070df expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049290:0:34550:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 5/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e070df expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049298:0:34550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 5/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e070df expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049304:0:34550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 6/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e070df expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049313:0:34550:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff98c143b9e400/0xc5f5d7a016e070d8 lrc: 6/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc5f5d7a016e070df expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.049338:0:34550:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98c143b9e400) 00000100:00100000:3.0:1788269860.049378:0:34550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:35719:x1875136262502912:12345-0@lo:105: Request processed in 111us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.049391:0:34550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269860.049821:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262503040 00000100:00100000:3.0:1788269860.049827:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262503040 00000100:00100000:3.0:1788269860.049858:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788269860.049867:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36273:x1875136262503040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788269860.049941:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36273:x1875136262503040:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.049947:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788269860.050229:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262503296 00000100:00100000:1.0:1788269860.050234:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262503296 00000100:00100000:1.0:1788269860.050265:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788269860.050274:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34589:x1875136262503296:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788269860.050498:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:34589:x1875136262503296:12345-0@lo:1000:osp_up1-0.0 Request processed in 226us (350us total) trans 21474836484 rc 0/0 00000100:00100000:1.0:1788269860.050506:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788269860.053439:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253033728 00000100:00100000:3.0:1788269860.053446:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253033728 00000100:00100000:3.0:1788269860.053491:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788269860.053502:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:26933:x1875136253033728:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269860.053666:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+15:26933:x1875136253033728:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 165us (272us total) trans 21474836485 rc 0/0 00000100:00100000:3.0:1788269860.053678:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788269860.057589:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269860.059563:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253034240 00000100:00100000:3.0:1788269860.059570:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253034240 00000100:00100000:3.0:1788269860.059617:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:3.0:1788269860.059627:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+18:26933:x1875136253034240:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269860.059641:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269860.059657:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e07109 lrc: 2/0,0 mode: --/CR res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610135e expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.059721:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07110 lrc: 3/1,0 mode: --/PR res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.059732:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07110 lrc: 3/1,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.059742:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07110 lrc: 3/1,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269860.059787:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002340:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788269860.059792:0:34569:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788269860.059819:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677000/0xc5f5d7a016e07109 lrc: 0/0,0 mode: --/CR res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610135e expref: 20 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.059848:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07110 lrc: 3/0,0 mode: PR/PR res: [0x200002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610135e expref: 19 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.059856:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002340:0x1:0x0].0x0 (ffff98c143878700) 00010000:00010000:3.0:1788269860.059859:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788269860.059862:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676a00, rc 0) 00000100:00100000:3.0:1788269860.059914:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:26933:x1875136253034240:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 289us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.059921:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:1.0:1788269860.062147:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253034368 00000100:00100000:1.0:1788269860.062155:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253034368 00000100:00100000:1.0:1788269860.062202:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788269860.062212:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+5:26933:x1875136253034368:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269860.062228:0:36273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269860.062247:0:36273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07117 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101365 expref: -99 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.062297:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 3/1,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.062310:0:36273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 2/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 6 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.062319:0:36273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 4/1,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.062351:0:36273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fa00/0xc5f5d7a016e070df lrc: 3/0,0 mode: PW/PW res: [0x240002340:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e070d8 expref: 6 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269860.062366:0:36273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:36273:1875136262503424:0@lo:104: 00000100:00100000:1.0:1788269860.062411:0:36273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.062455:0:36273:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.062733:0:36273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:36273:1875136262503424:0@lo:104: 00010000:00010000:1.0:1788269860.062758:0:36273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 3/1,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269860.062890:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262503552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269860.062923:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788269860.065748:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836484 is committed 00010000:00010000:1.0:1788269860.066011:0:36273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.066018:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269860.066079:0:36273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269860.066084:0:36273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1788269860.066131:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07117 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101365 expref: 7 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.066146:0:36273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101365 expref: 6 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.066153:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269860.066157:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269860.066159:0:36273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fe00, rc 0) 00000100:00100000:1.0:1788269860.066215:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26933:x1875136253034368:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 4005us (4137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269860.066222:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788269860.066230:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262503552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269860.068579:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269860.078692:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253034624 00000100:00100000:3.0:1788269860.078717:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253034624 00000100:00100000:3.0:1788269860.078785:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788269860.078797:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b5a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26933:x1875136253034624:12345-192.168.201.42@tcp:37:lfs.0 00000100:00100000:3.0:1788269860.081264:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b5a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26933:x1875136253034624:12345-192.168.201.42@tcp:37:lfs.0 Request processed in 2463us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.081277:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00010000:00010000:1.0:1788269860.102181:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269860.285252:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253035008 00000100:00100000:1.0:1788269860.285257:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253035008 00000100:00100000:1.0:1788269860.285297:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788269860.285305:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:26950:x1875136253035008:12345-192.168.201.42@tcp:101:multiop.0 00010000:00010000:1.0:1788269860.285319:0:34568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269860.285322:0:34568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788269860.285347:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e0711e lrc: 0/0,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101365 expref: 6 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.285363:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269860.285371:0:34568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269860.285382:0:34568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9f000/0xc5f5d7a016e07125 lrc: 2/0,0 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610136c expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269860.285487:0:34568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:34568:1875136262503680:0@lo:900:mdt00_001.0 00000100:00100000:1.0:1788269860.285520:0:34568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.285570:0:34568:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.285729:0:34568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:34568:1875136262503680:0@lo:900:mdt00_001.0 00000100:00100000:1.0:1788269860.285793:0:34568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:34568:1875136262503808:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788269860.285844:0:34568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.285868:0:34568:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269860.285894:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262503808 00000100:00100000:3.0:1788269860.285900:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262503808 00000100:00100000:3.0:1788269860.285924:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788269860.285929:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:34568:x1875136262503808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788269860.285982:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:34568:x1875136262503808:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.285989:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269860.286011:0:34568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:34568:1875136262503808:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788269860.286102:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286112:0:34568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286121:0:34568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269860.286133:0:34568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:34568:1875136262503936:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1788269860.286163:0:34568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.286183:0:34568:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.286390:0:34568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:34568:1875136262503936:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788269860.286405:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07133 expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286429:0:34568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07133 expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269860.286442:0:34568:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788269860.286448:0:34568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07133 expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286455:0:34568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c143b9ec00/0xc5f5d7a016e0712c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07133 expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286505:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 3/0,1 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286513:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 3/0,1 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286521:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 3/0,1 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286532:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07141 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286539:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07141 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.286550:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07141 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269860.286880:0:34568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:34568:1875136262504064:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788269860.286905:0:34568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269860.286926:0:34568:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269860.286951:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262504064 00000100:00100000:3.0:1788269860.286961:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262504064 00000100:00100000:3.0:1788269860.286988:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269860.286996:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:34568:x1875136262504064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788269860.287079:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:34568:x1875136262504064:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.287087:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269860.287096:0:34568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:34568:1875136262504064:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788269860.287418:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07148 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287429:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07148 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287437:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07148 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269860.287448:0:34568:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00010000:00010000:1.0:1788269860.287470:0:34568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 3/0,1 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287477:0:34568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 2/0,0 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287484:0:34568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 3/0,0 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287490:0:34568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269860.287494:0:34568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 3/0,0 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287505:0:34568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 4/0,0 mode: CW/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287514:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c143876c00) 00010000:00010000:1.0:1788269860.287517:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269860.287520:0:34568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 2/0,0 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287526:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e0713a lrc: 0/0,0 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269860.287536:0:34568:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9508d1a reply state 00000000583b5082 transno 21474836485 ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07141 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287546:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07141 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287552:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x4453f327 (ffff98c143876200) 00010000:00010000:1.0:1788269860.287554:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269860.287557:0:34568:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788269860.287581:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9f000/0xc5f5d7a016e07125 lrc: 0/0,0 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610136c expref: 8 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287597:0:34568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07148 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610136c expref: 7 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.287606:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269860.287608:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788269860.287610:0:34568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e400, rc 0) 00000100:00100000:1.0:1788269860.287660:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26950:x1875136253035008:12345-192.168.201.42@tcp:101:multiop.0 Request processed in 2356us (2486us total) trans 21474836485 rc 0/0 00000100:00100000:1.0:1788269860.287667:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788269860.289076:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269860.289118:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253035136 00000100:00100000:3.0:1788269860.289124:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253035136 00000100:00100000:3.0:1788269860.289160:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788269860.289167:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+11:26305:x1875136253035136:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269860.289178:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269860.289191:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b677000/0xc5f5d7a016e07156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101373 expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.289220:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b677000/0xc5f5d7a016e07156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101373 expref: 12 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.289230:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b677000/0xc5f5d7a016e07156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101373 expref: 12 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.289238:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677000, rc 0) 00000100:00100000:3.0:1788269860.289272:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+12:26305:x1875136253035136:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 105us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.289278:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788269860.294189:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253035392 00000100:00100000:3.0:1788269860.294200:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253035392 00000100:00100000:3.0:1788269860.294251:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788269860.294273:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+12:26305:x1875136253035392:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.294426:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+12:26305:x1875136253035392:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 155us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.294434:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:1.0:1788269860.296217:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269860.297147:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253035648 00000100:00100000:3.0:1788269860.297152:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253035648 00000100:00100000:3.0:1788269860.297181:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:3.0:1788269860.297187:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+13:26305:x1875136253035648:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.297280:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+13:26305:x1875136253035648:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.297286:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 10000000:01000000:3.0:1788269860.804411:0:34564:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269860.804418:0:34564:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c1451b9800 from 13 10000000:01000000:3.0:1788269860.804424:0:34564:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269860.804472:0:34564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.804483:0:34564:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.804495:0:34564:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269860.804523:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.804594:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269860.804652:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.804694:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262504192 00000100:00100000:1.0:1788269860.804702:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262504192 00000100:00100000:1.0:1788269860.804754:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788269860.804787:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+20:34564:x1875136262504192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269860.804802:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269860.804815:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e0716b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07164 expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.804840:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e0716b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07164 expref: 21 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.804851:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e0716b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07164 expref: 21 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.804860:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f000, rc 0) 00000100:00100000:1.0:1788269860.804907:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:34564:x1875136262504192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269860.804915:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788269860.804942:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269860.804959:0:34564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.804968:0:34564:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269860.805066:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.805092:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269860.805117:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269860.805363:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.805395:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.805443:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269860.805461:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269860.805510:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262504448 00000100:00100000:1.0:1788269860.805516:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262504448 00000100:00100000:1.0:1788269860.805544:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788269860.805551:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:34564:x1875136262504448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269860.805731:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+21:34564:x1875136262504448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269860.805738:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788269860.805821:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788269860.806819:0:37606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1788269860.807754:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262504704 00000100:00100000:1.0:1788269860.807771:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262504704 00000100:00100000:1.0:1788269860.807805:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788269860.807811:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:34564:x1875136262504704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269860.807893:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:34564:x1875136262504704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269860.807899:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000040:00080000:3.0:1788269860.808929:0:37607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1788269860.809241:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262504960 00000100:00100000:1.0:1788269860.809246:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262504960 00000100:00100000:1.0:1788269860.809279:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788269860.809286:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+22:34564:x1875136262504960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269860.809294:0:34560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269860.809304:0:34560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9fa00/0xc5f5d7a016e07187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07180 expref: -99 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.809319:0:34560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9fa00/0xc5f5d7a016e07187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07180 expref: 23 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.809328:0:34560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9fa00/0xc5f5d7a016e07187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07180 expref: 23 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269860.809336:0:34560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fa00, rc 0) 00000100:00100000:1.0:1788269860.809373:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25a72341-2152-4ec8-9ca0-7a670d594ca1+23:34564:x1875136262504960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269860.809380:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788269860.809446:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262504960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269860.809460:0:34564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c275b56a00/0xc5f5d7a016e07180 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07187 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269860.809469:0:34564:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c275b56a00/0xc5f5d7a016e07180 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07187 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269860.809507:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262505088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.809535:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269860.809560:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269860.809847:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262505088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.809870:0:34564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262505216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.809906:0:34564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269860.809925:0:34564:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269860.810116:0:34564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25a72341-2152-4ec8-9ca0-7a670d594ca1:34564:1875136262505216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788269860.810861:0:37608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1788269860.812234:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262505600 00000100:00100000:1.0:1788269860.812239:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262505600 00000100:00100000:3.0:1788269860.812343:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788269860.812361:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:34564:x1875136262505600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269860.812477:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:34564:x1875136262505600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269860.812485:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000040:00080000:3.0:1788269860.813721:0:37609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00010000:00010000:1.0:1788269861.124277:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269861.377741:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269861.377831:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269861.377862:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269861.377888:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253036032 00000100:00100000:1.0:1788269861.377889:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269861.377898:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253036032 00000100:00100000:1.0:1788269861.377908:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269861.377927:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269861.377947:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269861.377950:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253036160 00000100:00100000:3.0:1788269861.377953:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253036160 00000100:00100000:1.0:1788269861.377959:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269861.377973:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253036672 00000100:00100000:3.0:1788269861.377976:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253036672 00000100:00100000:1.0:1788269861.377981:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269861.377995:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253036544 00000100:00100000:3.0:1788269861.377999:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253036544 00000100:00100000:1.0:1788269861.378007:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269861.378015:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788269861.378016:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:2403:x1875136253036032:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269861.378021:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:2403:x1875136253036160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269861.378109:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:2403:x1875136253036160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269861.378109:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:2403:x1875136253036032:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269861.378121:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788269861.378128:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269861.378142:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788269861.378150:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2403:x1875136253036672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269861.378150:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788269861.378161:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2402:x1875136253036544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269861.378192:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2402:x1875136253036544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269861.378204:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788269861.378238:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788269861.378264:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+5:2403:x1875136253036416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269861.378370:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+5:2403:x1875136253036416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 122us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269861.378380:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788269861.378395:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788269861.378402:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2402:x1875136253036800:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269861.379778:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2403:x1875136253036672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1626us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269861.379787:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788269861.380866:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2402:x1875136253036800:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2462us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269861.380878:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788269862.599922:0:34562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262505984 00000100:00100000:1.0:1788269862.599931:0:34562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262505984 00000100:00100000:1.0:1788269862.599977:0:34562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788269862.599989:0:34562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:3608:x1875136262505984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.600073:0:34562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:3608:x1875136262505984:12345-0@lo:400:kworker.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269862.600082:0:34562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788269862.600136:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25a72341-2152-4ec8-9ca0-7a670d594ca1:3608:1875136262505984:0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.600219:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262507008:0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.600298:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262506368:0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.600374:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262506880:0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.600917:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262506752 00000100:00100000:1.0:1788269862.600925:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262506752 00000100:00100000:1.0:1788269862.600955:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262507264 00000100:00100000:1.0:1788269862.600960:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262507264 00000100:00100000:1.0:1788269862.600990:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269862.600999:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262506752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.601075:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262506752:12345-0@lo:400:kworker.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269862.601088:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269862.601105:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262507136 00000100:00100000:1.0:1788269862.601110:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262507136 00000100:00100000:1.0:1788269862.601135:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788269862.601145:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262507264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.601191:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262507264:12345-0@lo:400:kworker.0 Request processed in 47us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269862.601206:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788269862.601226:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269862.601233:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262507136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.601258:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262507136:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269862.601263:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269862.601303:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262506496 00000100:00100000:1.0:1788269862.601306:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262506496 00000100:00100000:1.0:1788269862.601322:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262506112 00000100:00100000:1.0:1788269862.601325:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262506112 00000100:00100000:1.0:1788269862.601336:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269862.601342:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262506496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.601393:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262506496:12345-0@lo:400:kworker.0 Request processed in 50us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269862.601406:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269862.601430:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269862.601445:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262506112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.601494:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262506112:12345-0@lo:400:kworker.0 Request processed in 53us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269862.601507:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269862.601547:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262506496:0@lo:400:kworker.0 00000100:00100000:1.0:1788269862.605804:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262507392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269863.109242:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269863.109264:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262507520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788269863.109337:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269863.109717:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262507520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788269863.172337:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269863.179927:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269863.179994:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253037184 00000100:00100000:1.0:1788269863.180003:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253037184 00000100:00100000:1.0:1788269863.180114:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788269863.180126:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:26977:x1875136253037184:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269863.180152:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269863.180174:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0719c lrc: 2/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101381 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.180280:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071a3 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.180290:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071a3 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.180299:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071a3 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269863.180310:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00010000:00010000:1.0:1788269863.180418:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0719c lrc: 0/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101381 expref: 11 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.180443:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071a3 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101381 expref: 10 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.180451:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269863.180454:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269863.180458:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fc00, rc 0) 00000100:00100000:1.0:1788269863.180522:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+10:26977:x1875136253037184:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 398us (601us total) trans 21474836486 rc 0/0 00000100:00100000:1.0:1788269863.180529:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788269863.183297:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253037312 00000100:00100000:1.0:1788269863.183304:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253037312 00000100:00100000:1.0:1788269863.183351:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:1.0:1788269863.183357:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+10:26977:x1875136253037312:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:1.0:1788269863.183407:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183418:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183426:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183450:0:34568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183458:0:34568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 2/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183469:0:34568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183475:0:34568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269863.183479:0:34568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183485:0:34568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 4/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183494:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269863.183496:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269863.183499:0:34568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 2/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.183503:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071b1 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269863.183568:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+10:26977:x1875136253037312:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 210us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269863.183574:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788269863.227461:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269863.229878:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253037952 00000100:00100000:3.0:1788269863.229885:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253037952 00000100:00100000:3.0:1788269863.229933:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788269863.229943:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+12:26987:x1875136253037952:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:3.0:1788269863.229987:0:34567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269863.230022:0:34567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071a3 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101381 expref: 12 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.230067:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:3.0:1788269863.230072:0:34567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269863.230277:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677200/0xc5f5d7a016e071c6 lrc: 3/0,1 mode: --/PW res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.230290:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677200/0xc5f5d7a016e071c6 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.230299:0:34567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677200/0xc5f5d7a016e071c6 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788269863.230342:0:34567:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836488 00000004:00010000:3.0:1788269863.230378:0:34567:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e29b977 reply state 0000000083e79916 transno 21474836489 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677200/0xc5f5d7a016e071c6 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.230390:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677200/0xc5f5d7a016e071c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.230396:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:3.0:1788269863.230399:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788269863.230402:0:34567:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269863.230491:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:26987:x1875136253037952:12345-192.168.201.42@tcp:36:bash.0 Request processed in 550us (709us total) trans 21474836489 rc 0/0 00000100:00100000:3.0:1788269863.230499:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000020:00080000:3.0:1788269863.230504:0:34567:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788269863.236201:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253038080 00000100:00100000:1.0:1788269863.236210:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253038080 00000100:00100000:1.0:1788269863.236270:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788269863.236280:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:26987:x1875136253038080:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269863.236304:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269863.236327:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071cd lrc: 2/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610138f expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.236435:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e071d4 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.236451:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e071d4 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.236462:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e071d4 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269863.236492:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00000004:00200000:1.0:1788269863.236496:0:34569:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269863.236517:0:34569:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e071d4 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.236543:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071cd lrc: 0/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610138f expref: 16 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.236560:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e071d4 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610138f expref: 15 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.236569:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269863.236572:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269863.236575:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ee00, rc 0) 00000100:00100000:1.0:1788269863.236640:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+15:26987:x1875136253038080:12345-192.168.201.42@tcp:101:bash.0 Request processed in 361us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269863.236647:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788269863.257544:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253038208 00000100:00100000:1.0:1788269863.257553:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253038208 00000100:00100000:1.0:1788269863.257611:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788269863.257623:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+15:26990:x1875136253038208:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269863.257797:0:34568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269863.257878:0:34568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071db lrc: 2/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101396 expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.257945:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 3/1,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.257959:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 3/1,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.257969:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 3/1,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.257981:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.257988:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.257994:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258097:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e071f0 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258105:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e071f0 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258112:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e071f0 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269863.258154:0:34568:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00000004:00200000:1.0:1788269863.258159:0:34568:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269863.258178:0:34568:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e071f0 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258188:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e071f0 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258197:0:34568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 3/1,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258202:0:34568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 2/0,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258209:0:34568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 3/0,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258214:0:34568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269863.258218:0:34568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 3/0,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258225:0:34568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 4/0,0 mode: CR/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258242:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c14387fe00) 00010000:00010000:1.0:1788269863.258246:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269863.258250:0:34568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258256:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9e800/0xc5f5d7a016e071e2 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258273:0:34568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258279:0:34568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258285:0:34568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258290:0:34568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269863.258293:0:34568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258299:0:34568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258306:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x4453f327 (ffff98c143876200) 00010000:00010000:1.0:1788269863.258316:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269863.258320:0:34568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 2/0,0 mode: --/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258326:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e071e9 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258353:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e071db lrc: 0/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101396 expref: 17 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258371:0:34568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e071f0 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101396 expref: 16 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.258384:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269863.258387:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269863.258390:0:34568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be000, rc 0) 00000100:00100000:1.0:1788269863.258465:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+16:26990:x1875136253038208:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 844us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269863.258473:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:3.0:1788269863.416767:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269863.419561:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253038848 00000100:00100000:3.0:1788269863.419570:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253038848 00000100:00100000:3.0:1788269863.419617:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269863.419627:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+17:27020:x1875136253038848:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:3.0:1788269863.419851:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+18:27020:x1875136253038848:12345-192.168.201.42@tcp:35:cat.0 Request processed in 226us (361us total) trans 21474836491 rc 0/0 00000100:00100000:3.0:1788269863.419857:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269863.442652:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253039232 00000100:00100000:3.0:1788269863.442662:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253039232 00000100:00100000:3.0:1788269863.442801:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788269863.442812:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+17:27023:x1875136253039232:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269863.442835:0:34567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269863.442857:0:34567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677400/0xc5f5d7a016e0720c lrc: 2/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013a4 expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.442957:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07213 lrc: 3/1,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.442972:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07213 lrc: 3/1,0 mode: CR/CR res: [0x240002341:0x1:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.442983:0:34567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07213 lrc: 3/1,0 mode: CR/CR res: [0x240002341:0x1:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269863.442996:0:34567:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00010000:00010000:3.0:1788269863.443136:0:34567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677400/0xc5f5d7a016e0720c lrc: 0/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013a4 expref: 20 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.443154:0:34567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07213 lrc: 3/0,0 mode: CR/CR res: [0x240002341:0x1:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013a4 expref: 19 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.443164:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:3.0:1788269863.443167:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788269863.443171:0:34567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676e00, rc 0) 00000100:00100000:3.0:1788269863.443245:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27023:x1875136253039232:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 432us (696us total) trans 21474836492 rc 0/0 00000100:00100000:3.0:1788269863.443253:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788269863.444541:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269863.444691:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253039360 00000100:00100000:1.0:1788269863.444699:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253039360 00000100:00100000:1.0:1788269863.444799:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788269863.444809:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27023:x1875136253039360:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:1.0:1788269863.444854:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444867:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444877:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444902:0:34569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444909:0:34569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 2/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444916:0:34569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444921:0:34569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269863.444927:0:34569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444934:0:34569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 4/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444943:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269863.444945:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269863.444949:0:34569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 2/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.444956:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07221 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269863.445017:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27023:x1875136253039360:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 210us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269863.445024:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788269863.499333:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253039488 00000100:00100000:1.0:1788269863.499348:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253039488 00000100:00100000:1.0:1788269863.499426:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788269863.499438:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27033:x1875136253039488:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269863.499458:0:34568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269863.499484:0:34568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07228 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013ab expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.499535:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be600/0xc5f5d7a016e0722f lrc: 3/1,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.499545:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be600/0xc5f5d7a016e0722f lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.499556:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be600/0xc5f5d7a016e0722f lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269863.499589:0:34568:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269863.499592:0:34568:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1788269863.499624:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07228 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ab expref: 21 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.499644:0:34568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be600/0xc5f5d7a016e0722f lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ab expref: 20 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269863.499653:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c14387fe00) 00010000:00010000:1.0:1788269863.499655:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269863.499658:0:34568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be600, rc 0) 00000100:00100000:1.0:1788269863.499732:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:27033:x1875136253039488:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 297us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269863.499739:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:3.0:1788269863.509590:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269863.518905:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253040256 00000100:00100000:3.0:1788269863.518914:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253040256 00000100:00100000:3.0:1788269863.519004:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788269863.519016:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+18:27033:x1875136253040256:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269863.519036:0:34567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269863.519099:0:34567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677400/0xc5f5d7a016e0723d lrc: 2/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013b2 expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.519150:0:34567:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e07236 lrc: 2/0,1 mode: EX/EX res: [0x240002341:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.519162:0:34567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677400/0xc5f5d7a016e0723d lrc: 4/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013b2 expref: 19 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.519181:0:34567:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e07236 lrc: 3/0,1 mode: EX/EX res: [0x240002341:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 36273 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.519194:0:34567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677400/0xc5f5d7a016e0723d lrc: 3/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013b2 expref: 19 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.519378:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:3.0:1788269863.519382:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269863.519387:0:34567:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677400/0xc5f5d7a016e0723d lrc: 3/0,0 mode: --/CR res: [0x240002341:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013b2 expref: 19 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269863.519395:0:34567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677400, rc 0) 00000100:00100000:3.0:1788269863.519459:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27033:x1875136253040256:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 445us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269863.519466:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000040:00080000:1.0:1788269864.004288:0:35325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269864.004299:0:35325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269864.004328:0:35325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 2 count 2 00000040:00080000:1.0:1788269864.004339:0:35325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269864.004483:0:35325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:35325:1875136262507648:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269864.004569:0:35325:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269864.007313:0:35325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:35325:1875136262507648:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269864.011103:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253040384 00000100:00100000:1.0:1788269864.011112:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253040384 00000100:00100000:1.0:1788269864.011229:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788269864.011241:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040384:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269864.011270:0:34569:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x240002341:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269864.011405:0:34569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:34569:1875136262507776:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269864.011457:0:34569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269864.011490:0:34569:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269864.011596:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262507776 00000100:00100000:3.0:1788269864.011601:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262507776 00000100:00100000:3.0:1788269864.011634:0:34573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788269864.011641:0:34573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:34569:x1875136262507776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269864.011819:0:34573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:34569:x1875136262507776:12345-0@lo:1000:mdt00_002.0 Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.011827:0:34573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788269864.012345:0:34569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:34569:1875136262507776:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269864.012426:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040384:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 1187us (1408us total) trans 0 rc -66/-66 00000100:00100000:1.0:1788269864.012433:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788269864.013974:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253040512 00000100:00100000:1.0:1788269864.013981:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253040512 00000100:00100000:1.0:1788269864.014062:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:1.0:1788269864.014073:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269864.014093:0:34568:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x1:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1788269864.014218:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 147us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.014226:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788269864.016081:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.016499:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262507904 00000100:00100000:3.0:1788269864.016505:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262507904 00000100:00100000:3.0:1788269864.016543:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788269864.016552:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36273:x1875136262507904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788269864.016626:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36273:x1875136262507904:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.016633:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788269864.016875:0:36273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:36273:1875136262507904:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788269864.016921:0:36273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.016931:0:36273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.016939:0:36273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269864.016960:0:36273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.016971:0:36273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.016977:0:36273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.016984:0:36273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.016990:0:36273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269864.016994:0:36273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017002:0:36273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017014:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c259240c00) 00010000:00010000:1.0:1788269864.017017:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269864.017021:0:36273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017027:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e07244 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017090:0:36273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017097:0:36273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017104:0:36273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017109:0:36273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269864.017112:0:36273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017118:0:36273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017126:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xd1db749c (ffff98c1429fbc00) 00010000:00010000:1.0:1788269864.017129:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269864.017132:0:36273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017137:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0724b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd1db749c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017151:0:36273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017158:0:36273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 2/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017163:0:36273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017168:0:36273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269864.017171:0:36273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017181:0:36273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 4/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017188:0:36273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c14387f100) 00010000:00010000:1.0:1788269864.017191:0:36273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269864.017193:0:36273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 2/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.017199:0:36273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e07252 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269864.017264:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040640:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 1070us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.017272:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788269864.018588:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253040768 00000100:00100000:3.0:1788269864.018595:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253040768 00000100:00100000:3.0:1788269864.018634:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788269864.018644:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040768:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788269864.018689:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018717:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018727:0:34567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269864.018777:0:34567:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00000004:00200000:3.0:1788269864.018781:0:34567:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788269864.018808:0:34567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018815:0:34567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 2/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018834:0:34567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018839:0:34567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269864.018843:0:34567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018849:0:34567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 4/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018859:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:3.0:1788269864.018862:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788269864.018866:0:34567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 2/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.018872:0:34567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07259 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269864.018934:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253040768:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 291us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.018942:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788269864.021241:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253041024 00000100:00100000:1.0:1788269864.021249:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253041024 00000100:00100000:1.0:1788269864.021307:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:1.0:1788269864.021316:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253041024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269864.021333:0:34569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269864.021411:0:34569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e07260 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013b9 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021503:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 3/1,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021517:0:34569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021528:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269864.021540:0:34569:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002341:0x1:0x0]: returning size 0 00010000:00010000:1.0:1788269864.021612:0:34569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021620:0:34569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 2/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021627:0:34569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021633:0:34569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269864.021637:0:34569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021645:0:34569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 4/0,0 mode: PR/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021657:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x1:0x0].0x0 (ffff98c143876a00) 00010000:00010000:1.0:1788269864.021660:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269864.021664:0:34569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 2/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021670:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be200/0xc5f5d7a016e07267 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021721:0:34569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e07260 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013b9 expref: 21 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021731:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c14387ff00) 00010000:00010000:1.0:1788269864.021734:0:34569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269864.021747:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e07260 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013b9 expref: 21 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.021762:0:34569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf800, rc 0) 00000100:00100000:1.0:1788269864.021814:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:27034:x1875136253041024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 499us (644us total) trans 21474836494 rc 301/301 00000100:00100000:1.0:1788269864.021821:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:3.0:1788269864.023881:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253041152 00000100:00100000:3.0:1788269864.023889:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253041152 00000100:00100000:3.0:1788269864.023938:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:3.0:1788269864.023948:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:27034:x1875136253041152:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788269864.023977:0:34567:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x240002341:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788269864.024102:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:27034:x1875136253041152:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 155us (537us total) trans 0 rc -66/-66 00000100:00100000:3.0:1788269864.024111:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788269864.026029:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253041280 00000100:00100000:1.0:1788269864.026087:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253041280 00000100:00100000:1.0:1788269864.026138:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788269864.026147:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253041280:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269864.026171:0:34569:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x1:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1788269864.026298:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+19:27034:x1875136253041280:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 151us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.026306:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:3.0:1788269864.034332:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253041536 00000100:00100000:3.0:1788269864.034342:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253041536 00000100:00100000:3.0:1788269864.034418:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788269864.034429:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:27034:x1875136253041536:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269864.034447:0:34567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269864.034451:0:34567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788269864.034477:0:34567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be600/0xc5f5d7a016e0722f lrc: 0/0,0 mode: --/PR res: [0x240002340:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ab expref: 20 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.034496:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x1:0x0].0x0 (ffff98c14387fe00) 00010000:00010000:3.0:1788269864.034507:0:34567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269864.034524:0:34567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07275 lrc: 2/0,0 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013c0 expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269864.034985:0:34567:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x82:0x0], index 1: 0 00010000:00010000:3.0:1788269864.035548:0:34567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677a00/0xc5f5d7a016e0727c lrc: 3/1,0 mode: --/PR res: [0x240002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34567 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.035561:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677a00/0xc5f5d7a016e0727c lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.035572:0:34567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677a00/0xc5f5d7a016e0727c lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34567 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.035623:0:34567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677e00/0xc5f5d7a016e07275 lrc: 0/0,0 mode: --/CW res: [0x240002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013c0 expref: 22 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.035643:0:34567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677a00/0xc5f5d7a016e0727c lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013c0 expref: 21 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.035651:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x2:0x0].0x0 (ffff98c1429f7b00) 00010000:00010000:3.0:1788269864.035666:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269864.035669:0:34567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677a00, rc 0) 00000100:00100000:3.0:1788269864.035736:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+21:27034:x1875136253041536:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1309us (1525us total) trans 21474836495 rc 0/0 00000100:00100000:3.0:1788269864.035745:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788269864.038501:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.038570:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253041792 00000100:00100000:1.0:1788269864.038580:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253041792 00000100:00100000:1.0:1788269864.038655:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788269864.038668:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+21:27034:x1875136253041792:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269864.038746:0:34569:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269864.038772:0:34569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b677a00/0xc5f5d7a016e0727c lrc: 0/0,0 mode: --/PR res: [0x240002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013c0 expref: 21 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.038798:0:34569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x2:0x0].0x0 (ffff98c1429f7b00) 00010000:00010000:1.0:1788269864.038808:0:34569:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269864.038959:0:34569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:34569:1875136262508032:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269864.039030:0:34569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269864.039085:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262508032 00000100:00100000:3.0:1788269864.039090:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262508032 00000100:00100000:1.0:1788269864.039104:0:34569:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269864.039129:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788269864.039138:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:34569:x1875136262508032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269864.039225:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:34569:x1875136262508032:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.039232:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788269864.039291:0:34569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:34569:1875136262508032:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788269864.039360:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 3/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.039367:0:34569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 3/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.039373:0:34569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 3/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269864.039381:0:34569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:34569:1875136262508160:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1788269864.039397:0:34569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269864.039414:0:34569:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e480 going to sleep for 11 seconds 00000020:00080000:1.0:1788269864.041246:0:34607:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17179869276 committed batchid 12884902055 00000020:00080000:1.0:1788269864.041306:0:34607:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902055 00000100:00100000:1.0:1788269864.043611:0:34569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:34569:1875136262508160:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1788269864.043620:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:1.0:1788269864.043632:0:34569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 4/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.043644:0:34569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 4/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269864.044113:0:34551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262508416 00000100:00100000:1.0:1788269864.044118:0:34551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262508416 00000100:00100000:1.0:1788269864.044153:0:34551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269864.044162:0:34551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:37591:x1875136262508416:12345-0@lo:105: 00010000:00010000:1.0:1788269864.044173:0:34551:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 5/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.044182:0:34551:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 5/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.044191:0:34551:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 5/0,1 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.044198:0:34551:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 5/0,1 mode: CW/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.044204:0:34551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 6/0,1 mode: CW/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.044212:0:34551:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 6/0,1 mode: CW/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.044267:0:34551:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98c27a0bf800) 00000100:00100000:1.0:1788269864.044307:0:34551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:37591:x1875136262508416:12345-0@lo:105: Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.044316:0:34551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269864.044333:0:37591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:37591:1875136262508416:0@lo:105: 00010000:00010000:3.0:1788269864.044343:0:37591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269864.044383:0:37591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:2401:x1875136253041920:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 568us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.044388:0:37591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788269864.044634:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262508544 00000100:00100000:3.0:1788269864.044638:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262508544 00000100:00100000:3.0:1788269864.044667:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269864.044671:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:34569:x1875136262508544:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788269864.044682:0:34572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269864.044693:0:34572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e0729f lrc: 2/0,0 mode: --/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07298 expref: -99 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.044720:0:34572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e0729f lrc: 3/0,0 mode: PW/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07298 expref: 8 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.044730:0:34572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e0729f lrc: 3/0,0 mode: PW/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07298 expref: 8 pid: 34572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.044737:0:34572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002340:0x1:0x0].0x8a17a187 (ffff98c1429f7c00) 00010000:00010000:3.0:1788269864.044740:0:34572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269864.044742:0:34572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676200, rc 0) 00000100:00100000:3.0:1788269864.044777:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:34569:x1875136262508544:12345-0@lo:101:mdt00_002.0 Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.044783:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269864.045280:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262508800 00000100:00100000:3.0:1788269864.045285:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262508800 00000100:00100000:3.0:1788269864.045305:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269864.045311:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:34569:x1875136262508800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269864.045364:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:34569:x1875136262508800:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.045367:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269864.045477:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262508928 00000100:00100000:3.0:1788269864.045480:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262508928 00000100:00100000:3.0:1788269864.045500:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269864.045510:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:34569:x1875136262508928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269864.045561:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:34569:x1875136262508928:12345-0@lo:1000:mdt00_002.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.045566:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:1.0:1788269864.046251:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269864.046257:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 2/0,0 mode: CW/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046263:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:1.0:1788269864.046266:0:34555:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 3/0,0 mode: CW/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269864.046272:0:34555:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 3/0,0 mode: CW/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046292:0:34555:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 2/0,0 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046298:0:34555:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269864.046321:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 1/0,0 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046328:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0bf800/0xc5f5d7a016e0728a lrc: 0/0,0 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07291 expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046343:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788269864.046345:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262509184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269864.046347:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c275b57e00/0xc5f5d7a016e07298 lrc: 4/0,0 mode: PW/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e0729f expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046356:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b57e00 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:1.0:1788269864.046361:0:34555:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c275b57e00/0xc5f5d7a016e07298 lrc: 5/0,0 mode: PW/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e0729f expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269864.046369:0:34555:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c275b57e00/0xc5f5d7a016e07298 lrc: 5/0,0 mode: PW/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e0729f expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269864.046378:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269864.046393:0:34555:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c275b57e00/0xc5f5d7a016e07298 lrc: 4/0,0 mode: --/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e0729f expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046399:0:34555:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269864.046410:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c275b57e00/0xc5f5d7a016e07298 lrc: 3/0,0 mode: --/PW res: [0x200002340:0x1:0x0].0x8a17a187 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e0729f expref: -99 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269864.046415:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788269864.046417:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269864.046420:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269864.046423:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269864.046424:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262509312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269864.046446:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269864.046741:0:34552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269864.046749:0:34552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3609:x1875136262509184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269864.046759:0:34552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269864.046775:0:34552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c275b57200/0xc5f5d7a016e07291 lrc: 0/0,0 mode: --/CW res: [0x200002340:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0728a expref: 9 pid: 34573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.046805:0:34552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002340:0x1:0x0].0x0 (ffff98c143878700) 00010000:00010000:1.0:1788269864.046817:0:34552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269864.046907:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262509312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269864.047006:0:34552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262509184:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.047022:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262509184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269864.048097:0:34552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269864.050433:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.050483:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253042048 00000100:00100000:1.0:1788269864.050492:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253042048 00000100:00100000:1.0:1788269864.050535:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:1.0:1788269864.050543:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:27034:x1875136253042048:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269864.050558:0:34568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269864.050576:0:34568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e072a6 lrc: 2/0,0 mode: --/PR res: [0x240002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013c7 expref: -99 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.050602:0:34568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e072ad lrc: 3/1,0 mode: --/PR res: [0x240002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34568 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.050612:0:34568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e072ad lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.050623:0:34568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e072ad lrc: 3/1,0 mode: PR/PR res: [0x240002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34568 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.050754:0:34568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e072a6 lrc: 0/0,0 mode: --/PR res: [0x240002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013c7 expref: 22 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.050771:0:34568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e072ad lrc: 3/0,0 mode: PR/PR res: [0x240002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013c7 expref: 21 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.050780:0:34568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x2:0x0].0x0 (ffff98c14387f100) 00010000:00010000:1.0:1788269864.050783:0:34568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269864.050786:0:34568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bec00, rc 0) 00000100:00100000:1.0:1788269864.050845:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+21:27034:x1875136253042048:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 302us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.050853:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:3.0:1788269864.054910:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.054961:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253042432 00000100:00100000:1.0:1788269864.054968:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253042432 00000100:00100000:1.0:1788269864.055010:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:1.0:1788269864.055019:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+23:27034:x1875136253042432:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269864.055035:0:34567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269864.055070:0:34567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e072bb lrc: 2/0,0 mode: --/CR res: [0x240002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561013ce expref: -99 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.055116:0:34567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e072bb lrc: 3/0,0 mode: CR/CR res: [0x240002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ce expref: 24 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.055127:0:34567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e072bb lrc: 3/0,0 mode: CR/CR res: [0x240002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ce expref: 24 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.055143:0:34567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x2:0x0].0x0 (ffff98c14387f100) 00010000:00010000:1.0:1788269864.055145:0:34567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269864.055148:0:34567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf800, rc 0) 00000100:00100000:1.0:1788269864.055192:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+24:27034:x1875136253042432:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 174us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.055198:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:1.0:1788269864.060337:0:36072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253042560 00000100:00100000:1.0:1788269864.060346:0:36072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253042560 00000100:00100000:1.0:1788269864.060406:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788269864.060417:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+5:2401:x1875136253042560:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788269864.060642:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:2401:x1875136253042560:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 227us (731us total) trans 21474836483 rc 0/0 00000100:00100000:1.0:1788269864.060650:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788269864.063293:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.064499:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.070482:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.072673:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.075400:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.078453:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.081638:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.081787:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253044096 00000100:00100000:3.0:1788269864.081794:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253044096 00000100:00100000:3.0:1788269864.081843:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:3.0:1788269864.081851:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+26:27034:x1875136253044096:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788269864.083179:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836497 is committed 00000004:00080000:1.0:1788269864.083190:0:35299:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:1.0:1788269864.083358:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262509696:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1788269864.083399:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269864.083816:0:36072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262509696 00000100:00100000:1.0:1788269864.083821:0:36072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262509696 00000100:00100000:1.0:1788269864.083895:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269864.083901:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262509696:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1788269864.083981:0:36072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x82:0x0] updating lvb size from disk: 0 -> 14 00002000:00010000:1.0:1788269864.083984:0:36072:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x82:0x0] updating lvb mtime from disk: 0 -> 1788269864 00002000:00010000:1.0:1788269864.083986:0:36072:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788269864.083987:0:36072:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x82:0x0] updating lvb ctime from disk: 1788269864 -> 1788269864 00002000:00010000:1.0:1788269864.083989:0:36072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x82:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788269864.084020:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262509696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 119us (619us total) trans 21474836485 rc 0/0 00000100:00100000:1.0:1788269864.084024:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1788269864.084155:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c275906a00/2, rc 0, transno 21474836485 00000100:00100000:3.0:1788269864.084159:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262509696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1788269864.085383:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000001:00080000:1.0:1788269864.086717:0:36885:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836485 is committed 00000001:00080000:1.0:1788269864.086727:0:36885:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836484 is committed 00000100:00100000:3.0:1788269864.088383:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.090097:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.091500:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.093177:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.095217:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.095272:0:36072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253045120 00000100:00100000:1.0:1788269864.095277:0:36072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253045120 00000100:00100000:1.0:1788269864.095317:0:36072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788269864.095326:0:36072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+7:2403:x1875136253045120:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788269864.095362:0:36072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.095380:0:36072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 7 pid: 36073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.095388:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269864.095392:0:36072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269864.095396:0:36072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.095438:0:36072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 7 pid: 36073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.095459:0:36072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 7 pid: 36073 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269864.095473:0:36072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36072:1875136262509952:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269864.095530:0:36072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269864.097661:0:36072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36072:1875136262509952:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269864.097686:0:36072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269864.097965:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.098326:0:34552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253045248 00000100:00100000:1.0:1788269864.098334:0:34552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253045248 00010000:00010000:1.0:1788269864.098364:0:34552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 8 pid: 36073 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269864.098433:0:34552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788269864.098448:0:34552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a672d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+8:2400:x1875136253045248:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269864.098461:0:34552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269864.098496:0:34552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 8 pid: 36073 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.098517:0:34552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 8 pid: 36073 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.098538:0:34552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e58e1f/0xc5f5d7a016e072d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013e3 expref: 8 pid: 36073 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.098565:0:34552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269864.098569:0:34552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269864.098574:0:34552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.098582:0:34552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.098616:0:34552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269864.098734:0:34552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a672d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+7:2400:x1875136253045248:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 292us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.098743:0:34552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00010000:00010000:3.0:1788269864.099365:0:36072:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099397:0:36072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099447:0:36072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099457:0:36072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099467:0:36072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099474:0:36072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269864.099479:0:36072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099488:0:36072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099501:0:36072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.099509:0:36072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af962f8/0xc5f5d7a016e072ec lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269864.099574:0:36072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+6:2403:x1875136253045120:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 4248us (4361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.099582:0:36072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788269864.101400:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.105517:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:1.0:1788269864.105852:0:34569:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c275b57000/0xc5f5d7a016e072f3 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.105862:0:34569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c275b57000/0xc5f5d7a016e072f3 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.106092:0:34569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e072fa lrc: 3/0,1 mode: --/EX res: [0x240002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.106106:0:34569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e072bb lrc: 2/0,0 mode: CR/CR res: [0x240002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ce expref: 10 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.106113:0:34569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e072fa lrc: 4/0,1 mode: --/EX res: [0x240002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34569 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.106139:0:34569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e072bb lrc: 3/0,0 mode: CR/CR res: [0x240002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ce expref: 10 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.106152:0:34569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e072bb lrc: 4/0,0 mode: CR/CR res: [0x240002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013ce expref: 10 pid: 34567 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269864.106165:0:34569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:34569:1875136262510208:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269864.106214:0:34569:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269864.108372:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.109799:0:34572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262510336 00000100:00100000:3.0:1788269864.109804:0:34572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262510336 00000100:00100000:3.0:1788269864.109831:0:34572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788269864.109836:0:34572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:34569:x1875136262510336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269864.109905:0:34572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:34569:x1875136262510336:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269864.109909:0:34572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788269864.112586:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269864.112636:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253045888 00000100:00100000:1.0:1788269864.112645:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253045888 00000100:00100000:1.0:1788269864.112694:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788269864.112713:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:27033:x1875136253045888:12345-192.168.201.42@tcp:49:lfs.0 00000100:00100000:1.0:1788269864.112813:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+14:27033:x1875136253045888:12345-192.168.201.42@tcp:49:lfs.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269864.112819:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000040:00080000:3.0:1788269864.112901:0:35325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269864.112906:0:35325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269864.112916:0:35325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 2 count 2 00000040:00080000:3.0:1788269864.112921:0:35325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269864.114197:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269864.114256:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253046144 00000100:00100000:3.0:1788269864.114260:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253046144 00000100:00100000:3.0:1788269864.114289:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269864.114376:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b59450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+13:27034:x1875136253046144:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788269864.114597:0:34570:0:(mdd_object.c:4014:mdd_close()) Object [0x240002341:0x2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269864.114622:0:34570:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836504 00010000:00010000:3.0:1788269864.114649:0:34570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 3/0,1 mode: --/PW res: [0x240002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.114661:0:34570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.114671:0:34570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 3/0,1 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.114678:0:34570:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 4/0,1 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.114684:0:34570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 4/0,1 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.114690:0:34570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 3/0,0 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269864.114722:0:34570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269864.114779:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b59450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+15:27034:x1875136253046144:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 483us (584us total) trans 21474836505 rc 0/0 00000100:00100000:3.0:1788269864.114785:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000020:00080000:3.0:1788269864.114787:0:34570:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788269864.115154:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269864.115160:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 2/0,0 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.115166:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269864.115169:0:35320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 2/0,0 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.115176:0:35320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 3/0,0 mode: PW/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.115188:0:35320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002341:0x2:0x0].0x0 (ffff98c14387f100) 00010000:00010000:1.0:1788269864.115191:0:35320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788269864.115195:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 1/0,0 mode: --/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.115202:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27b676400/0xc5f5d7a016e07308 lrc: 0/0,0 mode: --/PW res: [0x240002341:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 34570 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269864.115213:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269864.115214:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269864.115216:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269864.196580:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269864.644201:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269864.644224:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262510720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269864.644294:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269864.644575:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262510720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269865.156404:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262510848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269865.156479:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269865.157540:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262510848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269865.159443:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253046784 00000100:00100000:1.0:1788269865.159449:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253046784 00000100:00100000:3.0:1788269865.159512:0:35325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb58380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:35325:1875136262510976:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269865.159541:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788269865.159550:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+16:27266:x1875136253046784:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269865.159601:0:36273:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x240002341:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269865.159730:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+16:27266:x1875136253046784:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 180us (356us total) trans 0 rc -66/-66 00000100:00100000:1.0:1788269865.159738:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:3.0:1788269865.167001:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269865.171856:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000040:00080000:3.0:1788269865.178418:0:35325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269865.178424:0:35325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269865.178952:0:35325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 64768 count 3 00000040:00080000:3.0:1788269865.178962:0:35325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788269865.183144:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:1.0:1788269866.251825:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269866.498334:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253047808 00000100:00100000:1.0:1788269866.498345:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253047808 00000100:00100000:1.0:1788269866.498403:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:1.0:1788269866.498424:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+13:2400:x1875136253047808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269866.498467:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253048064 00000100:00100000:3.0:1788269866.498472:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253048064 00000100:00100000:3.0:1788269866.498509:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253048576 00000100:00100000:3.0:1788269866.498512:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253048576 00000100:00100000:1.0:1788269866.498541:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788269866.498548:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788269866.498557:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2400:x1875136253048576:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269866.498571:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:2400:x1875136253048064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269866.498630:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:2400:x1875136253048064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269866.498636:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2400:x1875136253048576:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269866.498648:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788269866.498656:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788269866.498686:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253047936 00000100:00100000:3.0:1788269866.498690:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253047936 00000100:00100000:3.0:1788269866.498718:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788269866.498730:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:2400:x1875136253047936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269866.498762:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:2400:x1875136253047936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269866.498771:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788269866.498783:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253048448 00000100:00100000:3.0:1788269866.498787:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253048448 00000100:00100000:3.0:1788269866.498808:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788269866.498820:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2400:x1875136253048448:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:1.0:1788269866.498920:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269866.498924:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269866.498926:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269866.498927:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269866.499718:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2400:x1875136253048448:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 898us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269866.499726:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:1.0:1788269866.499828:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+13:2400:x1875136253047808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1413us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269866.499838:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:1.0:1788269866.501505:0:34569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253048960 00000100:00100000:1.0:1788269866.501512:0:34569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253048960 00000100:00100000:1.0:1788269866.501684:0:34569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788269866.501703:0:34569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26917:x1875136253048960:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788269866.501794:0:34569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26917:x1875136253048960:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269866.501802:0:34569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788269866.504196:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253049088 00000100:00100000:1.0:1788269866.504204:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253049088 00000100:00100000:1.0:1788269866.504300:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:1.0:1788269866.504310:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:26917:x1875136253049088:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788269866.504407:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+20:26917:x1875136253049088:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 98us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269866.504415:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:3.0:1788269866.507769:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269866.508017:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253049344 00000100:00100000:1.0:1788269866.508026:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253049344 00000100:00100000:1.0:1788269866.508106:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788269866.508115:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:26917:x1875136253049344:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788269866.508335:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+12:26917:x1875136253049344:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 220us (570us total) trans 21474836487 rc 0/0 00000100:00100000:1.0:1788269866.508343:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788269867.717686:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262511232:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717720:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717743:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262511744:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717767:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717784:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262512256:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717802:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717820:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262512768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269867.717838:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717859:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262511616:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717882:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717898:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262512128:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717917:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717932:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262512640:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717954:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.717966:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788269867.717972:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262511488:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.717989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.718005:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262512000:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.718020:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.718033:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262512512:0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.718082:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269867.718102:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262511232 00000100:00100000:1.0:1788269867.718105:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262511232 00000100:00100000:1.0:1788269867.718132:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788269867.718139:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:3607:x1875136262511232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.718178:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+24:3607:x1875136262511232:12345-0@lo:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269867.718184:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788269867.718209:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262511744 00000100:00100000:1.0:1788269867.718213:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262511744 00000100:00100000:1.0:1788269867.718227:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262512256 00000100:00100000:1.0:1788269867.718229:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262512256 00000100:00100000:1.0:1788269867.718243:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262512384 00000100:00100000:1.0:1788269867.718245:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262512384 00000100:00100000:1.0:1788269867.718254:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262512128 00000100:00100000:1.0:1788269867.718256:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262512128 00000100:00100000:1.0:1788269867.718264:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262512640 00000100:00100000:1.0:1788269867.718266:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262512640 00000100:00100000:1.0:1788269867.718275:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262512512 00000100:00100000:1.0:1788269867.718277:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262512512 00000100:00100000:1.0:1788269867.718289:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269867.718294:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262511744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.718320:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262511744:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269867.718330:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269867.718342:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788269867.718347:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.718371:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262512256:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269867.718377:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788269867.718388:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269867.718393:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262512384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.718416:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262512384:12345-0@lo:400:kworker.0 Request processed in 24us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269867.718422:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269867.718433:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269867.718438:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262512640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269867.719116:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262512640:12345-0@lo:400:kworker.0 Request processed in 678us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269867.719865:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788269868.230070:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269868.230093:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262513024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788269868.230163:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269868.230528:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262513024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788269869.316240:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269869.444991:0:34600:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788269869.672116:0:37890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 09:37:49 (1788269869) 00000100:00100000:1.0:1788269869.764164:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269869.764207:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262513152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269869.764277:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269869.764618:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262513152:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788269870.278724:0:36885:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836487 is committed 00000001:00080000:1.0:1788269870.278736:0:36885:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836486 is committed 00000020:00080000:1.0:1788269870.278853:0:34607:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869276 00000004:00080000:1.0:1788269870.278909:0:34607:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98c251244840 with version 5 00000020:00080000:1.0:1788269870.278924:0:34607:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 17179869275 cancel update log [0x240002340:0x2:0x0].1: rc = 0 00000020:00080000:1.0:1788269870.278986:0:34607:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 17179869275 cancel update log [0x200002340:0x2:0x0].1: rc = 0 00000004:00080000:1.0:1788269870.279004:0:34607:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98c251244000 with version 6 00000020:00080000:1.0:1788269870.279008:0:34607:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 17179869276 cancel update log [0x240002340:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1788269870.279027:0:34607:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 17179869276 cancel update log [0x200002340:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1788269870.279035:0:34607:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869276 00000100:00100000:1.0:1788269870.279874:0:34589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34589:1875136262513536:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1788269870.279884:0:34589:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c27b5fbf00 version 6 rpc_version 6 00000020:00100000:1.0:1788269870.279895:0:34589:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788269870.279900:0:34589:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c24821ad80 x1875136262513792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269870.279913:0:34589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34589:1875136262513792:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788269870.279940:0:34589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269870.279962:0:34589:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269870.280305:0:34589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34589:1875136262513792:0@lo:1000:osp_up1-0.0 00000001:00080000:1.0:1788269870.281465:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836509 is committed 00000020:00080000:1.0:1788269870.281491:0:35299:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c281216000 refcount 2 committed 0 result 0 batchid 17179869188 00000020:00080000:1.0:1788269870.281496:0:35299:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c142b97600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c281216780 00000020:00080000:1.0:1788269870.281499:0:35299:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c142b97300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c26a8c9600 00000020:00080000:3.0:1788269870.281555:0:35322:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17179869188 committed batchid 0 00000020:00080000:3.0:1788269870.281716:0:35322:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788269871.161658:0:34570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253049728 00000100:00100000:1.0:1788269871.161759:0:34570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253049728 00000100:00100000:1.0:1788269871.161842:0:34570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788269871.161854:0:34570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+11:28014:x1875136253049728:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:1.0:1788269871.162152:0:34570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad12a1e2-5e6e-4db2-844b-4676c5d604e3+12:28014:x1875136253049728:12345-192.168.201.42@tcp:35:umount.0 Request processed in 301us (721us total) trans 21474836488 rc 0/0 00000100:00100000:1.0:1788269871.162161:0:34570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788269871.165135:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.165235:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.165270:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.165313:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269871.166319:0:34553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788269871.166329:0:34553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:101677dd-db4e-4988-b466-0ec83e00f72e+15:2400:x1875136253050112:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269871.166340:0:34553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269871.166358:0:34553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c143b9f400/0xc5f5d7a016e06f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610125b expref: 15 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.166371:0:34553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269871.166398:0:34553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:101677dd-db4e-4988-b466-0ec83e00f72e+14:2400:x1875136253050112:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 71us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.166405:0:34553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788269871.166424:0:34553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788269871.166429:0:34553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:101677dd-db4e-4988-b466-0ec83e00f72e+13:2400:x1875136253049984:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269871.166437:0:34553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269871.166445:0:34553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418f600/0xc5f5d7a016e06f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610122a expref: 13 pid: 34561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.166454:0:34553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269871.166470:0:34553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:101677dd-db4e-4988-b466-0ec83e00f72e+12:2400:x1875136253049984:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 40us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.166475:0:34553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788269871.166487:0:34553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788269871.166492:0:34553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:101677dd-db4e-4988-b466-0ec83e00f72e+11:2400:x1875136253050240:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269871.166500:0:34553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269871.166509:0:34553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418ee00/0xc5f5d7a016e0715d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610137a expref: 11 pid: 34562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.166516:0:34553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269871.166532:0:34553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:101677dd-db4e-4988-b466-0ec83e00f72e+10:2400:x1875136253050240:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 39us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.166538:0:34553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269871.170987:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:3.0:1788269871.172717:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269871.177636:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000020:00010000:1.0:1788269871.178862:0:34555:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c1436e6000: total 0 00010000:00010000:1.0:1788269871.178866:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269871.178996:0:34555:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c1436e6000, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1788269871.179030:0:34555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c1429f7f00) 00010000:00010000:1.0:1788269871.179034:0:34555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269871.179178:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676800/0xc5f5d7a016e06fea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610130a expref: 10 pid: 34569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.179206:0:34555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269871.179209:0:34555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269871.179214:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c275b57400/0xc5f5d7a016e07102 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101357 expref: 9 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.179225:0:34555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269871.179227:0:34555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788269871.179230:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e07076 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101326 expref: 8 pid: 36273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.179241:0:34555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c259240c00) 00010000:00010000:1.0:1788269871.179243:0:34555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269871.179247:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c240031e00/0xc5f5d7a016e07006 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101311 expref: 7 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.179262:0:34555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240000) 00010000:00010000:1.0:1788269871.179264:0:34555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269871.179268:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e0705a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610131f expref: 6 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.179278:0:34555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff98c143878a00) 00010000:00010000:1.0:1788269871.179280:0:34555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269871.179284:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c275b56800/0xc5f5d7a016e070ed lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101350 expref: 5 pid: 34568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.179297:0:34555:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c1436e6000, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1788269871.179311:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269871.179313:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269871.179316:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269871.184398:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00080000:1.0:1788269871.185118:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788269871.365730:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269871.609685:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.609731:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.609767:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.609803:0:34554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253051648 00000100:00100000:3.0:1788269871.609815:0:34554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253051648 00000100:00100000:1.0:1788269871.609891:0:34552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788269871.609902:0:34552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:101677dd-db4e-4988-b466-0ec83e00f72e+12:2400:x1875136253051392:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269871.609920:0:34552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269871.609946:0:34552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240031200/0xc5f5d7a016e06f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610129a expref: 12 pid: 34561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.609962:0:34552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269871.610014:0:34552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:101677dd-db4e-4988-b466-0ec83e00f72e+11:2400:x1875136253051392:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.610020:0:34552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788269871.610128:0:34552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788269871.610148:0:34552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:101677dd-db4e-4988-b466-0ec83e00f72e+9:2400:x1875136253051520:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269871.610158:0:34552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269871.610173:0:34552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b677000/0xc5f5d7a016e07156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101373 expref: 9 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.610202:0:34552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269871.610240:0:34552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:101677dd-db4e-4988-b466-0ec83e00f72e+7:2400:x1875136253051520:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 104us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.610246:0:34552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788269871.610764:0:37084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253051776 00000100:00100000:1.0:1788269871.610769:0:37084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253051776 00000100:00100000:1.0:1788269871.610871:0:37084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788269871.610879:0:37084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2399:x1875136253051776:12345-192.168.201.42@tcp:9:umount.0 00000020:00000080:1.0:1788269871.610909:0:37084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06fb9 00000100:00080000:1.0:1788269871.610917:0:37084:0:(import.c:65:import_set_state_nolock()) ffff98c26b843000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788269871.611033:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788269871.611229:0:37084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836487 00000100:00100000:1.0:1788269871.611477:0:37084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+2:2399:x1875136253051776:12345-192.168.201.42@tcp:9:umount.0 Request processed in 599us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.611483:0:37084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00010000:00010000:3.0:1788269871.614179:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269871.614464:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269871.617270:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253052160 00000100:00100000:1.0:1788269871.617278:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253052160 00000100:00100000:1.0:1788269871.617357:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788269871.617364:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2401:x1875136253052160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269871.617425:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2401:x1875136253052160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 63us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.617432:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788269871.617603:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.617686:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253052288 00000100:00100000:3.0:1788269871.617691:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253052288 00000100:00100000:3.0:1788269871.617730:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:3.0:1788269871.617739:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:506e0ad4-cf80-4f01-9357-704d4850a25b+6:2399:x1875136253052288:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:3.0:1788269871.617768:0:34567:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06fa4 00000020:00010000:3.0:1788269871.617776:0:34567:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c26b840800: total 0 00000100:00080000:3.0:1788269871.617781:0:34567:0:(import.c:65:import_set_state_nolock()) ffff98c26b842000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269871.617812:0:34567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836489 00000100:00100000:3.0:1788269871.617931:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2399:x1875136253052288:12345-192.168.201.42@tcp:39:umount.0 Request processed in 193us (328us total) trans 21474836490 rc 0/0 00000100:00100000:3.0:1788269871.617940:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000020:00010000:1.0:1788269871.618214:0:35320:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c26b840800: total 0 00010000:00010000:1.0:1788269871.618262:0:35320:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c26b840800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788269871.618296:0:35320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259240000) 00010000:00010000:1.0:1788269871.618300:0:35320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269871.618309:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c275b56c00/0xc5f5d7a016e07332 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561013f1 expref: 4 pid: 34567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269871.618326:0:35320:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c26b840800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788269871.618338:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269871.618340:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269871.618342:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269871.626133:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269871.626351:0:37764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253052416 00000100:00100000:3.0:1788269871.626360:0:37764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253052416 00000100:00100000:3.0:1788269871.626419:0:37764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:3.0:1788269871.626430:0:37764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:506e0ad4-cf80-4f01-9357-704d4850a25b+5:2399:x1875136253052416:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:3.0:1788269871.626474:0:37764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06fab 00000100:00080000:3.0:1788269871.626485:0:37764:0:(import.c:65:import_set_state_nolock()) ffff98c277e31000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269871.626523:0:37764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474836512 00000100:00100000:3.0:1788269871.626895:0:37764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:506e0ad4-cf80-4f01-9357-704d4850a25b+3:2399:x1875136253052416:12345-192.168.201.42@tcp:39:umount.0 Request processed in 465us (771us total) trans 21474836513 rc 0/0 00000100:00100000:3.0:1788269871.626904:0:37764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:1.0:1788269871.648025:0:34560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253052672 00000100:00100000:1.0:1788269871.648035:0:34560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253052672 00000100:00100000:1.0:1788269871.648148:0:34560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:1.0:1788269871.648169:0:34560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+7:2399:x1875136253052672:12345-192.168.201.42@tcp:251:umount.0 00000020:00000080:1.0:1788269871.648209:0:34560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06f42 00000020:00010000:1.0:1788269871.648217:0:34560:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c1435b7000: total 0 00000100:00080000:1.0:1788269871.648221:0:34560:0:(import.c:65:import_set_state_nolock()) ffff98c1435b5800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788269871.648300:0:34560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:101677dd-db4e-4988-b466-0ec83e00f72e+3:2399:x1875136253052672:12345-192.168.201.42@tcp:251:umount.0 Request processed in 143us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269871.648308:0:34560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 160 00000020:00010000:3.0:1788269871.648377:0:34556:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c1435b7000: total 0 00010000:00010000:3.0:1788269871.648383:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269871.648452:0:34556:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c1435b7000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788269871.648489:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c143b9e600/0xc5f5d7a016e06f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101223 expref: 2 pid: 34560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269871.648506:0:34556:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c1435b7000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788269871.648519:0:34556:0:(genops.c:885:class_export_put()) final put ffff98c1435b7000/101677dd-db4e-4988-b466-0ec83e00f72e 00010000:00010000:3.0:1788269871.648537:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269871.648539:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269871.648540:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788269872.569123:0:38084:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788269872.584178:0:38084:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788269872.584238:0:38084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06ae2 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.584259:0:38084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06ae2 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.584266:0:38084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06ae2 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.584273:0:38084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e06adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06ae2 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.584295:0:38084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788269872.584305:0:38084:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788269872.584337:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269872.584343:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788269872.584351:0:38084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788269872.584378:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788269872.584480:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269872.584493:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25a72341-2152-4ec8-9ca0-7a670d594ca1:3607:1875136262514048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269872.584522:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788269872.584943:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24589f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788269872.584992:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24589d000 for lustre-MDT0000 00000100:00080000:1.0:1788269872.585471:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269872.585474:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269872.585478:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788269872.586350:0:38084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a33 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586358:0:38084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06a33 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586363:0:38084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06a33 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586370:0:38084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e06a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06a33 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586385:0:38084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269872.586390:0:38084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf000/0xc5f5d7a016e06d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06d7b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586396:0:38084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf000/0xc5f5d7a016e06d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06d7b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586402:0:38084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf000/0xc5f5d7a016e06d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06d7b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586407:0:38084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf000/0xc5f5d7a016e06d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06d7b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586416:0:38084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269872.586421:0:38084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b57800/0xc5f5d7a016e0718e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07195 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586428:0:38084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b57800/0xc5f5d7a016e0718e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07195 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586435:0:38084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b57800/0xc5f5d7a016e0718e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07195 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586441:0:38084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c275b57800/0xc5f5d7a016e0718e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07195 expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586462:0:38084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788269872.586467:0:38084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586473:0:38084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586479:0:38084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586485:0:38084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c241543c00/0xc5f5d7a016e06a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e06a25 expref: -99 pid: 34546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269872.586491:0:38084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788269872.586495:0:38084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788269872.586500:0:38084:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788269872.586520:0:38084:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788269872.586523:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788269872.586527:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269872.586531:0:38084:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788269872.586536:0:38084:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c144351000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269872.586542:0:38084:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c142585800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269872.586547:0:38084:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c2752f8800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269872.586562:0:38084:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c27b8e5000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 1) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269872.586569:0:38084:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98c26b840800 506e0ad4-cf80-4f01-9357-704d4850a25b 192.168.201.42@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269872.586574:0:38084:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98c1436e6000 ad12a1e2-5e6e-4db2-844b-4676c5d604e3 192.168.201.42@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 21474836487 stale:0 00000020:00080000:1.0:1788269872.586580:0:38084:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98c143788000) has exports, disconnecting them 00000020:00080000:1.0:1788269872.586584:0:38084:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c144351000), last request at 1788269867 00000020:00000080:1.0:1788269872.586589:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06d43 00000100:00080000:1.0:1788269872.586602:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c144357000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788269872.586635:0:38084:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c144351000): rc 0 00000020:00000080:1.0:1788269872.586637:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c144351000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788269872.586644:0:38084:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c142585800), last request at 1788269867 00000020:00000080:1.0:1788269872.586647:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06cb0 00000100:00080000:1.0:1788269872.586651:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c142586800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788269872.586657:0:38084:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c142585800): rc 0 00000020:00000080:1.0:1788269872.586659:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c142585800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788269872.586662:0:38084:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c2752f8800), last request at 1788269834 00000020:00000080:1.0:1788269872.586664:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06bfa 00000100:00080000:1.0:1788269872.586667:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c2752ff000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788269872.586672:0:38084:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c2752f8800): rc 0 00000020:00000080:1.0:1788269872.586674:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c2752f8800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788269872.586677:0:38084:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c27b8e5000), last request at 1788269834 00000020:00000080:1.0:1788269872.586680:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06b9f 00000020:00010000:1.0:1788269872.586683:0:38084:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c27b8e5000: total 3 00000100:00080000:1.0:1788269872.586686:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c14437f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269872.586691:0:38084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836490 00000020:00080000:1.0:1788269872.586757:0:38084:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c27b8e5000): rc 0 00000004:00000080:1.0:1788269872.586763:0:38084:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad6581603ae0 00000100:00080000:1.0:1788269872.586779:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788269872.586782:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474836484 gen 3 00000100:00100000:1.0:1788269872.586789:0:38084:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98c27fa4bb80 x1875136262513536/t21474836510(21474836510) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788269886 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788269872.586798:0:38084:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836510 committed transno 21474836484 00000100:00100000:1.0:1788269872.586813:0:38084:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98c24821ad80 x1875136262513792/t21474836511(21474836511) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788269886 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788269872.586818:0:38084:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836511 committed transno 21474836484 00000100:00080000:1.0:1788269872.587993:0:38084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788269872.588011:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c24b002000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788269872.588159:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788269872.588162:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836482 gen 3 00000004:00080000:1.0:1788269872.588173:0:38084:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788269872.588272:0:38084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788269872.588282:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c14437a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788269872.588288:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788269872.588290:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836482 gen 3 00000004:00080000:1.0:1788269872.588299:0:38084:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788269872.588353:0:38084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788269872.588362:0:38084:0:(import.c:65:import_set_state_nolock()) ffff98c247f7d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788269872.588402:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98c143788000) has no exports 00010000:00010000:3.0:1788269872.589725:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269872.589758:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262514688:0@lo:39:umount.0 00000100:00100000:3.0:1788269872.589788:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269872.589817:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262514816:0@lo:9:umount.0 00000100:00100000:3.0:1788269872.589837:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269872.589853:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262514944:0@lo:9:umount.0 00000100:00100000:3.0:1788269872.589870:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269872.589916:0:36073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262514816 00000100:00100000:3.0:1788269872.589920:0:36073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262514816 00000100:00100000:3.0:1788269872.589971:0:36073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262514944 00000100:00100000:3.0:1788269872.589974:0:36073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262514944 00000100:00100000:3.0:1788269872.590011:0:36073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269872.590017:0:36073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875136262514816:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269872.590062:0:36073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06d82 00000100:00080000:3.0:1788269872.590071:0:36073:0:(import.c:65:import_set_state_nolock()) ffff98c144350800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269872.590103:0:36073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836482 00000100:00100000:3.0:1788269872.590200:0:36073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3606:x1875136262514816:12345-0@lo:9:umount.0 Request processed in 183us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269872.590207:0:36073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269872.590238:0:36073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788269872.590244:0:36073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875136262514944:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269872.590254:0:36073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06d89 00000100:00080000:3.0:1788269872.590258:0:36073:0:(import.c:65:import_set_state_nolock()) ffff98c144350000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269872.590277:0:36073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836487 00000100:00100000:3.0:1788269872.590333:0:36073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3606:x1875136262514944:12345-0@lo:9:umount.0 Request processed in 89us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269872.590339:0:36073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788269872.590353:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269872.590367:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c14437a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788269872.590375:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788269872.590377:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269872.590380:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262514816:0@lo:9:umount.0 00000100:00080000:3.0:1788269872.590387:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c247f7d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788269872.590390:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788269872.590392:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269872.590394:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262514944:0@lo:9:umount.0 00000100:00100000:3.0:1788269872.590790:0:34573:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788269872.590800:0:34573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:1.0:1788269872.591268:0:38084:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 0, last_idx 2 00000040:00080000:1.0:1788269872.591299:0:38084:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 1, last_idx 2 00000020:00080000:1.0:1788269872.607341:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98c143788000) has no exports 00000020:00000080:1.0:1788269872.641251:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06a79 00000020:00000080:1.0:1788269872.641265:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c27c81f000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788269872.641279:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000100:00100000:3.0:1788269872.836358:0:36074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262515200 00000100:00100000:3.0:1788269872.836367:0:36074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262515200 00000100:00100000:3.0:1788269872.836431:0:36074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269872.836445:0:36074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262515200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788269872.836475:0:36074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788269872.836532:0:36074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262515200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269872.836542:0:36074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269872.836594:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262515456:0@lo:400:kworker.0 00000100:00100000:1.0:1788269872.836637:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262515584:0@lo:400:kworker.0 00000100:00100000:3.0:1788269872.836639:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269872.836670:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262515968:0@lo:400:kworker.0 00000100:00100000:1.0:1788269872.836685:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269872.836705:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262515456 00000100:00100000:3.0:1788269872.836709:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262515456 00000100:00100000:1.0:1788269872.836724:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269872.836733:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262515712:0@lo:400:kworker.0 00000100:00100000:3.0:1788269872.836735:0:34567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262515584 00000100:00100000:3.0:1788269872.836739:0:34567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262515584 00000100:00100000:3.0:1788269872.836762:0:34567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788269872.836773:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269872.836777:0:34567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3608:x1875136262515456:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788269872.836786:0:34567:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788269872.836804:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262515712 00000100:00100000:1.0:1788269872.836810:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262515712 00000100:00100000:3.0:1788269872.836815:0:34567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3608:x1875136262515456:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269872.836821:0:34567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788269872.836857:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788269872.836870:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262515712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269872.836923:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262515712:12345-0@lo:400:kworker.0 Request processed in 57us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269872.836967:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269872.837004:0:3608:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269872.837010:0:3608:0:(import.c:65:import_set_state_nolock()) ffff98c143bc6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788269872.837015:0:3608:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788269872.837318:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788269872.837342:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269872.837348:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269872.837373:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262515712:0@lo:400:kworker.0 00000100:00080000:1.0:1788269872.837395:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788269872.837402:0:3609:0:(import.c:65:import_set_state_nolock()) ffff98c1451ba800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788269872.837408:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788269872.837413:0:3609:0:(import.c:65:import_set_state_nolock()) ffff98c1451ba800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269872.837419:0:3609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1788269872.837423:0:3609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c1451ba800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788269872.837442:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27f293100 x1875136262516224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269872.837469:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262515584:0@lo:400:kworker.0 00000100:00100000:1.0:1788269872.837618:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262516224 00000100:00100000:1.0:1788269872.837625:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262516224 00000100:00100000:1.0:1788269872.837651:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788269872.837657:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262516224:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788269872.837668:0:34568:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788269872.846776:0:3608:0:(import.c:65:import_set_state_nolock()) ffff98c143bc6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269872.846791:0:3608:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 626 00000100:00080000:3.0:1788269872.846801:0:3608:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c143bc6000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269872.846837:0:3608:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef76300 x1875136262516480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269872.846861:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262515456:0@lo:400:kworker.0 00000100:00100000:3.0:1788269872.846919:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262515968:0@lo:400:kworker.0 00000100:00100000:3.0:1788269872.847385:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262516480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788269872.847446:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269872.847868:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143bc6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269872.847872:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269872.847876:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262516480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788269872.848312:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262516224:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 10652us (10779us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788269872.848323:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788269872.848395:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c1451ba800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269872.848400:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269872.848403:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262516224:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788269874.884310:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262516608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269874.884380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269874.884596:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269874.884771:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262516608:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788269875.460351:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269876.420242:0:35325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269876.420251:0:35325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269876.420270:0:35325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 3 count 3 00000040:00080000:3.0:1788269876.420281:0:35325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:1.0:1788269876.425934:0:35299:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788269876.425947:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836514 is committed 00000001:00100000:1.0:1788269876.425952:0:35299:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 506e0ad4-cf80-4f01-9357-704d4850a25b 00000001:00080000:1.0:1788269876.425970:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836513 is committed 00000020:00000080:1.0:1788269876.425972:0:35299:0:(genops.c:885:class_export_put()) final put ffff98c277e31800/506e0ad4-cf80-4f01-9357-704d4850a25b 00000001:00100000:1.0:1788269876.425976:0:35299:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ad12a1e2-5e6e-4db2-844b-4676c5d604e3 00000001:00080000:1.0:1788269876.425980:0:35299:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836512 is committed 00000020:00000080:1.0:1788269876.425982:0:35299:0:(genops.c:885:class_export_put()) final put ffff98c1436e5000/ad12a1e2-5e6e-4db2-844b-4676c5d604e3 00000020:00080000:1.0:1788269876.425988:0:35299:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 17179869188 batchid updated 00000020:00000080:1.0:1788269876.426003:0:35299:0:(genops.c:885:class_export_put()) final put ffff98c245cf8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269876.426115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b8e5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788269876.426163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c277e31800/506e0ad4-cf80-4f01-9357-704d4850a25b for lustre-MDT0001 00000020:00000080:3.0:1788269876.426187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26b840800/506e0ad4-cf80-4f01-9357-704d4850a25b for lustre-MDT0000 00000020:00000080:3.0:1788269876.426208:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1436e5000/ad12a1e2-5e6e-4db2-844b-4676c5d604e3 for lustre-MDT0001 00000020:00000080:3.0:1788269876.426229:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1436e6000/ad12a1e2-5e6e-4db2-844b-4676c5d604e3 for lustre-MDT0000 00000020:00000080:3.0:1788269876.426248:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cf8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788269876.426276:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c14437f000 for lustre-MDT0000 00000020:00000080:3.0:1788269876.426282:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c277e31000 for lustre-MDT0001 00000020:00000080:3.0:1788269876.426286:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c26b842000 for lustre-MDT0000 00000020:00000080:3.0:1788269876.426289:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1436e0000 for lustre-MDT0001 00000020:00000080:3.0:1788269876.426292:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1436e2800 for lustre-MDT0000 00000020:00000080:3.0:1788269876.426295:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c2491ea800 for lustre-MDT0001 00000020:00000080:3.0:1788269877.448702:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c144357800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788269877.448755:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26b847800/506e0ad4-cf80-4f01-9357-704d4850a25b for lustre-OST0000 00000020:00000080:3.0:1788269877.448788:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1436e5800/ad12a1e2-5e6e-4db2-844b-4676c5d604e3 for lustre-OST0000 00000001:00100000:1.0:1788269877.448803:0:36885:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788269877.448809:0:36885:0:(genops.c:885:class_export_put()) final put ffff98c144352000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269877.448811:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c144350800 for lustre-OST0000 00000020:00000080:3.0:1788269877.448820:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c26b844000 for lustre-OST0000 00000001:00100000:1.0:1788269877.448826:0:36885:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 506e0ad4-cf80-4f01-9357-704d4850a25b 00000020:00000080:1.0:1788269877.448829:0:36885:0:(genops.c:885:class_export_put()) final put ffff98c26b843800/506e0ad4-cf80-4f01-9357-704d4850a25b 00000020:00000080:3.0:1788269877.448881:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1436e7800 for lustre-OST0000 00000001:00100000:1.0:1788269877.449836:0:36885:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad12a1e2-5e6e-4db2-844b-4676c5d604e3 00000020:00000080:1.0:1788269877.449842:0:36885:0:(genops.c:885:class_export_put()) final put ffff98c1435b1000/ad12a1e2-5e6e-4db2-844b-4676c5d604e3 00000020:00000080:3.0:1788269877.449910:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c144352000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788269877.449944:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26b843800/506e0ad4-cf80-4f01-9357-704d4850a25b for lustre-OST0001 00000020:00000080:3.0:1788269877.449977:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b1000/ad12a1e2-5e6e-4db2-844b-4676c5d604e3 for lustre-OST0001 00000020:00000080:3.0:1788269877.450005:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c144350000 for lustre-OST0001 00000020:00000080:3.0:1788269877.450017:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c26b843000 for lustre-OST0001 00000020:00000080:3.0:1788269877.450021:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1435b7800 for lustre-OST0001 00000100:00080000:3.0:1788269877.956214:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269877.956221:0:38087:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788269877.956225:0:38087:0:(import.c:65:import_set_state_nolock()) ffff98c245cfd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269877.956233:0:38087:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:3.0:1788269877.956238:0:38087:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788269877.956245:0:38087:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98c245cfd000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269877.956266:0:38087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef76d80 x1875136262516864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269877.956437:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269877.956456:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25a72341-2152-4ec8-9ca0-7a670d594ca1:3609:1875136262516736:0@lo:400:kworker.0 00000100:00100000:1.0:1788269877.956550:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269877.956614:0:34561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262516736 00000100:00100000:1.0:1788269877.956623:0:34561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262516736 00000100:00100000:1.0:1788269877.956669:0:34561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788269877.956680:0:34561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26acb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+19:3609:x1875136262516736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269877.956736:0:34561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26acb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25a72341-2152-4ec8-9ca0-7a670d594ca1+19:3609:x1875136262516736:12345-0@lo:400:kworker.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269877.956744:0:34561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788269877.956791:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25a72341-2152-4ec8-9ca0-7a670d594ca1:3609:1875136262516736:0@lo:400:kworker.0 00000100:00080000:1.0:1788269877.956820:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269877.956847:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262516864:0@lo:38:kworker.0 00000100:00100000:1.0:1788269877.956876:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269877.956911:0:34573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262516864 00000100:00100000:1.0:1788269877.956915:0:34573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262516864 00000100:00080000:3.0:1788269877.956990:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269877.956993:0:38087:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788269877.956996:0:38087:0:(import.c:65:import_set_state_nolock()) ffff98c143bc6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269877.957000:0:38087:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:3.0:1788269877.957003:0:38087:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788269877.957007:0:38087:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c143bc6000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269877.957014:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262517120:0@lo:400:kworker.0 00000100:00100000:3.0:1788269877.957067:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269877.957098:0:37084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517120 00000100:00100000:3.0:1788269877.957102:0:37084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517120 00000100:00100000:3.0:1788269877.957133:0:37084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269877.957140:0:37084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262517120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269877.957174:0:37084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262517120:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269877.957181:0:37084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269877.957209:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262517120:0@lo:400:kworker.0 00000100:00080000:3.0:1788269877.957222:0:34563:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269877.957237:0:38087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c25ef77480 x1875136262517248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269877.957252:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269877.957255:0:38087:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788269877.957257:0:38087:0:(import.c:65:import_set_state_nolock()) ffff98c1451ba800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269877.957261:0:38087:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 664 00000100:00080000:3.0:1788269877.957263:0:38087:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788269877.957267:0:38087:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c1451ba800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269877.957275:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262517248:0@lo:38:kworker.0 00000100:00100000:3.0:1788269877.957306:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269877.957339:0:38087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c24821b800 x1875136262517376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269877.957357:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262517376:0@lo:38:kworker.0 00000100:00100000:3.0:1788269877.957377:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269877.957402:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517248 00000100:00100000:3.0:1788269877.957406:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517248 00000100:00100000:3.0:1788269877.958241:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517376 00000100:00100000:3.0:1788269877.958246:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517376 00000100:00100000:3.0:1788269877.958268:0:36273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517504 00000100:00100000:3.0:1788269877.958272:0:36273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517504 00000100:00100000:3.0:1788269877.958303:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788269877.958312:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262517504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269877.958366:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262517504:12345-0@lo:400:kworker.0 Request processed in 53us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269877.958374:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788269877.958395:0:36273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788269877.958405:0:36273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3606:x1875136262517376:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788269877.958415:0:36273:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788269877.958443:0:36273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3606:x1875136262517376:12345-0@lo:38:kworker.0 Request processed in 39us (1064us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269877.958449:0:36273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788269877.958518:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262516992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269877.958561:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262517760:0@lo:400:kworker.0 00000100:00100000:1.0:1788269877.958591:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269877.958627:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262517504:0@lo:400:kworker.0 00000100:00100000:1.0:1788269877.958651:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517760 00000100:00100000:1.0:1788269877.958656:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517760 00000100:00100000:1.0:1788269877.958684:0:34568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517632 00000100:00100000:1.0:1788269877.958689:0:34568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517632 00000100:00100000:1.0:1788269877.958703:0:34568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788269877.958713:0:34568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262517760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269877.958769:0:34568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262517760:12345-0@lo:400:kworker.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269877.958778:0:34568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788269877.958804:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262517760:0@lo:400:kworker.0 00010000:00010000:1.0:1788269878.532254:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269878.762506:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788269878.762515:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474836484 gen 4 00000100:00100000:3.0:1788269878.762528:0:38084:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98c24821ad80 x1875136262514688/t21474836514(21474836514) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788269882 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269878.762555:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788269878.764389:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788269878.764394:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836482 gen 4 00000004:00080000:3.0:1788269878.764407:0:38084:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269878.764409:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788269878.765329:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788269878.765333:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836482 gen 4 00000004:00080000:3.0:1788269878.765352:0:38084:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269878.765354:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269878.767063:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06a41 00000020:00000080:3.0:1788269878.767072:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c24af8b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788269878.767557:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06a56 00000020:00000080:3.0:1788269878.767562:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c275d99800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269878.767566:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788269878.767570:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269878.767578:0:38084:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788269878.767582:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98c14378b370) has no exports 00000004:01000000:3.0:1788269878.767722:0:38084:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788269878.767728:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06ab8 00000020:00000080:3.0:1788269878.767732:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c2759e0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269878.767735:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788269878.767738:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269878.767742:0:38084:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269878.767744:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98c27b804d28) has no exports 00000020:00000080:3.0:1788269878.767748:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06ab1 00000020:00000080:3.0:1788269878.767751:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c247f78000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788269878.768016:0:38084:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788269878.768020:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788269878.768023:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836482 gen 5 00000004:00080000:3.0:1788269878.768027:0:38084:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269878.768029:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269878.768065:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269878.768070:0:38084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269878.768073:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06aa3 00000020:00000080:3.0:1788269878.768076:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c24af8e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269878.768079:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788269878.768081:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269878.768084:0:38084:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269878.768086:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98c275d80000) has no exports 00000020:00000080:3.0:1788269878.768088:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06a9c 00000020:00000080:3.0:1788269878.768090:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c14437d000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788269878.768352:0:38084:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788269878.768355:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788269878.768357:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836482 gen 5 00000004:00080000:3.0:1788269878.768359:0:38084:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269878.768361:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269878.768379:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269878.768382:0:38084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788269878.768389:0:38084:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788269878.768392:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06a8e 00000020:00000080:3.0:1788269878.768395:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c14408f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269878.768398:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788269878.768401:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269878.768404:0:38084:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269878.768406:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff98c27b8019b8) has no exports 00000020:00000080:3.0:1788269878.768409:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06a87 00000020:00000080:3.0:1788269878.768412:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c27c81f800/lustre-MDT0000-osd_UUID 00000100:00100000:1.0:1788269878.774972:0:34560:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98c27a18f800:34560] 0 exiting: rc = 1 00000100:00100000:1.0:1788269878.775084:0:34562:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98c27f0b9600:34562] 2 exiting: rc = 0 00000100:00100000:1.0:1788269878.775135:0:34561:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98c27f0b8c00:34561] 1 exiting: rc = 0 00000020:00000080:1.0:1788269878.775166:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24b002000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788269878.775171:0:38087:0:(genops.c:885:class_export_put()) final put ffff98c27c81b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788269878.775174:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27c81b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788269878.775178:0:38087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269878.775223:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275d9e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788269878.775227:0:38087:0:(genops.c:885:class_export_put()) final put ffff98c24af8b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788269878.775229:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24af8b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788269878.775232:0:38087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788269878.775253:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275d9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269878.775257:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27a60d800/25a72341-2152-4ec8-9ca0-7a670d594ca1 for MGS 00000020:00000080:1.0:1788269878.775285:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27a609800 for MGS 00000020:00000080:1.0:1788269878.777249:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2758e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269878.777395:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27c81a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788269878.778408:0:38084:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788269878.778412:0:38084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269878.778415:0:38084:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788269878.778420:0:38084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269878.778542:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269878.778548:0:38084:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788269878.778551:0:38084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27a77c800 1 00000020:00000080:1.0:1788269878.778555:0:38084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e069df 00000020:00000080:1.0:1788269878.778558:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c2758e0000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788269878.778562:0:38084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788269878.778565:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269878.778567:0:38084:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269878.778570:0:38084:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98c27b803370) has no exports 00000020:00000080:1.0:1788269878.779990:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b5e3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788269878.779999:0:38087:0:(genops.c:885:class_export_put()) final put ffff98c27b5e0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788269878.780003:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788269878.780009:0:38087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788269878.780102:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2758e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269878.817632:0:38084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269878.817645:0:38084:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788269878.817652:0:38084:0:(genops.c:885:class_export_put()) final put ffff98c27a779800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788269878.817656:0:38084:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27a779800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788269878.817666:0:38084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788269878.817776:0:38084:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c27a77f000 00000020:02000400:1.0:1788269878.817823:0:38084:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788269880.004204:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262517888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269880.004279:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269880.004581:0:36074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262517888 00000100:00100000:3.0:1788269880.004589:0:36074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262517888 00000100:00100000:3.0:1788269880.004648:0:36074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269880.004660:0:36074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262517888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788269880.004689:0:36074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788269880.004750:0:36074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262517888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269880.004918:0:36074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269880.004958:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262517888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269880.468639:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25a72341-2152-4ec8-9ca0-7a670d594ca1:3608:1875136262518016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269880.468700:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269880.468764:0:34553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262518016 00000100:00100000:3.0:1788269880.468771:0:34553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262518016 00000100:00100000:3.0:1788269880.469016:0:34553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269880.469025:0:34553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3608:x1875136262518016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788269880.469032:0:34553:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269880 with bad export cookie 14264544477344459273 00010000:00010000:1.0:1788269880.469433:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269880.469442:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469465:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269880.469472:0:34555:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469484:0:34555:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269880.469499:0:34555:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269880.469518:0:34555:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269880.469525:0:34555:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788269880.469530:0:34555:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788269880.469551:0:34555:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469568:0:34555:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269880.469585:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469603:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e06d66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e06d6d expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469641:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269880.469647:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469663:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269880.469672:0:34555:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469694:0:34555:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269880.469712:0:34555:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269880.469724:0:34555:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269880.469728:0:34555:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788269880.469732:0:34555:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788269880.469749:0:34555:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469759:0:34555:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269880.469772:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469785:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e06b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e06b36 expref: -99 pid: 35298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269880.469801:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269880.469806:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269880.469810:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269880.469824:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25a72341-2152-4ec8-9ca0-7a670d594ca1:3610:1875136262518272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269880.469863:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269880.469968:0:35719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262518272 00000100:00100000:1.0:1788269880.469975:0:35719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262518272 00000100:00100000:1.0:1788269880.470020:0:35719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788269880.470033:0:35719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3610:x1875136262518272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788269880.470339:0:35719:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269880 with bad export cookie 14264544477344459273 00000100:00100000:1.0:1788269880.470410:0:35719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3610:x1875136262518272:12345-0@lo:103:ldlm_bl.0 Request processed in 378us (546us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788269880.470434:0:35719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788269880.470464:0:3610:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788269880.480444:0:3610:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98c27a60e000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788269880.480467:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25a72341-2152-4ec8-9ca0-7a670d594ca1:3610:1875136262518272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269880.480667:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25a72341-2152-4ec8-9ca0-7a670d594ca1:3606:1875136262518656:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788269880.480717:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136262518656 offset 0 length 520: 4 00000100:00100000:1.0:1788269880.480941:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262518784:0@lo:9:umount.0 00000100:00100000:1.0:1788269880.480998:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269880.481062:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262518912:0@lo:9:umount.0 00000100:00100000:1.0:1788269880.481096:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269880.481147:0:37085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788269880.481161:0:37085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875136262518784:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788269880.481188:0:37085:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06ce8 00000100:00080000:1.0:1788269880.481206:0:37085:0:(import.c:65:import_set_state_nolock()) ffff98c144937800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269880.481251:0:37085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836482 00000100:00100000:1.0:1788269880.481561:0:37085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3606:x1875136262518784:12345-0@lo:9:umount.0 Request processed in 404us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269880.481570:0:37085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788269880.481593:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788269880.483181:0:34553:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875136262518016 offset 224 length 224: 4 00000100:00100000:3.0:1788269880.483199:0:34553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3608:x1875136262518016:12345-0@lo:103:ldlm_bl.0 Request processed in 14173us (14498us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269880.483208:0:34553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:00080000:1.0:1788269880.493202:0:38288:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98c2491519b8) has no exports 00000020:01000000:1.0:1788269880.519997:0:38288:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c142ac4cc0 - data ffff98c27209c438/ffff98c1410b6c00 00000004:00080000:3.0:1788269880.563371:0:35307:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788269880.563377:0:35307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 1 count 1 00000040:00080000:3.0:1788269880.563704:0:35307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000004:00080000:3.0:1788269880.564599:0:35309:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788269880.564603:0:35309:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 2 count 1 00000040:00080000:3.0:1788269880.564614:0:35309:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:3.0:1788269880.568087:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491ed800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269880.569390:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491ee800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788269880.569592:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24a203000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788269880.569618:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cf9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269880.570020:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c2491eb800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788269880.570156:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143771000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788269880.570175:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143772000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269880.570512:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143776000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788269880.570600:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143775000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788269880.570619:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cff000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788269880.572093:0:38288:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788269880.572101:0:38288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269880.572105:0:38288:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788269880.572112:0:38288:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269880.572149:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c245cfd000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788269880.572171:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269880.572186:0:38288:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269880.572191:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c245cf9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269880.572195:0:38288:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cf9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788269880.572203:0:38288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269880.572430:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269880.572436:0:38288:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269880.572439:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c281db0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269880.572442:0:38288:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281db0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788269880.572450:0:38288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269880.572641:0:38288:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06b6e 00000020:00000080:3.0:1788269880.572649:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c2491e8800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788269880.572660:0:38288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788269880.572665:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269880.572671:0:38288:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1788269880.572671:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491e8800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00080000:3.0:1788269880.572676:0:38288:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98c249153370) has no exports 00000020:00000080:3.0:1788269880.572711:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269880.572716:0:38288:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788269880.572724:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c2491e8000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788269880.572727:0:38288:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491e8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788269880.572739:0:38288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788269880.572884:0:38288:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06b75 00000020:00000080:3.0:1788269880.572889:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c2491ef800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788269880.572909:0:38288:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c281db5800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788269880.572911:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491ef800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:3.0:1788269880.572913:0:38288:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c281db5800 2 00000020:01000004:3.0:1788269880.572918:0:38288:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c281db5800 from lustre-MDT0001 00000020:00000080:3.0:1788269880.572951:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269880.572956:0:38288:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788269880.572959:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c2491ea000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788269880.572961:0:38288:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491ea000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788269880.572970:0:38288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788269880.573003:0:38288:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788269880.573007:0:38288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788269880.573009:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269880.573012:0:38288:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788269880.573019:0:38288:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98c143774800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788269880.573024:0:38288:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff98c276b6b370) has exports, disconnecting them 00000020:00080000:3.0:1788269880.573029:0:38288:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98c143774800), last request at 1788269834 00000020:00000080:3.0:1788269880.573033:0:38288:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06bf3 00000020:00080000:3.0:1788269880.573069:0:38288:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143774800): rc 0 00000020:00000080:3.0:1788269880.573073:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c143774800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788269880.573097:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143774800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788269880.575165:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143bc6000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788269880.575692:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143798000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269880.593442:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269880.593456:0:38288:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788269880.593463:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c14379c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788269880.593468:0:38288:0:(genops.c:844:class_export_destroy()) destroying export ffff98c14379c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788269880.593481:0:38288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788269880.593602:0:38288:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c14379d800 00000020:01000000:3.0:1788269880.593622:0:38288:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788269880.593625:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269880.593629:0:38288:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788269880.593632:0:38288:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98c275d83370) has no exports 00000100:00100000:1.0:1788269880.593761:0:34569:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98c275ad2c00:34569] 2 exiting: rc = 0 00000100:00100000:3.0:1788269880.593768:0:36273:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98c144a20200:36273] 3 exiting: rc = 0 00000100:00100000:3.0:1788269880.593966:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593971:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593975:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593979:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593983:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593986:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593990:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593993:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.593998:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594004:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594009:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594014:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594019:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594024:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594030:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594036:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594068:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594076:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594086:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594094:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594102:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594106:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594111:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594114:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594117:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594122:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594126:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594129:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594132:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594135:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594139:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594142:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594146:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594149:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594153:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594156:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594160:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594164:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594167:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594170:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594173:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594176:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594180:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594184:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594187:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594190:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594192:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594196:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594201:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594204:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594207:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594212:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594219:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594225:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594231:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594237:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594242:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594248:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594253:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594260:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594264:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594267:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594271:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.594275:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269880.597178:0:34570:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98c275ad2a00:34570] 0 exiting: rc = 1 00000100:00100000:3.0:1788269880.597289:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597297:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597304:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597310:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597316:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597320:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597324:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597328:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597332:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597335:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597338:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597341:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597344:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597347:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597351:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597354:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597357:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597361:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597364:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597366:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597369:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597372:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597375:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597377:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597380:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597383:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597386:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597389:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597392:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597395:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597398:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597401:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597403:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597406:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597409:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597424:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597430:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597435:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597441:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597446:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597451:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597456:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597463:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597468:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597473:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597478:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597483:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597489:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597493:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597497:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597501:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597505:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597508:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597511:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597515:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597518:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597521:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597524:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597527:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597530:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597533:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597536:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597539:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597542:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269880.597921:0:34573:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98c275ad3000:34573] 1 exiting: rc = 0 00000100:00100000:3.0:1788269880.597963:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597976:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597985:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597991:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.597999:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598004:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598007:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598012:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598017:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598023:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598029:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598035:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598274:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598285:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598292:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598301:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598311:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598320:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598326:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598333:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598339:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598345:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598351:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598356:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598377:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598384:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598390:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598396:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598402:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598408:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598425:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598432:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598438:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598444:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598449:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598454:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598473:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598481:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598487:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598494:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598499:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598505:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598510:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598516:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598521:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598527:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598533:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598538:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598557:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598564:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598575:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598581:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598587:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598594:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598599:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598606:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598612:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598622:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598627:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598632:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598653:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598659:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598664:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269880.598670:0:38288:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269880.605376:0:34575:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98c27b53fe00:34575] 1 exiting: rc = 0 00000100:00100000:3.0:1788269880.605936:0:34576:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98c275b22400:34576] 0 exiting: rc = 1 00000100:00100000:3.0:1788269880.606578:0:34578:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98c276263200:34578] 0 exiting: rc = 1 00000100:00100000:1.0:1788269880.607335:0:34582:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98c143ae4800:34582] 2 exiting: rc = 0 00000100:00100000:3.0:1788269880.607385:0:34580:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98c24dc4ba00:34580] 0 exiting: rc = 1 00000020:00000080:3.0:1788269880.611680:0:38288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269880.611694:0:38288:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788269880.611701:0:38288:0:(genops.c:885:class_export_put()) final put ffff98c1435dc000/MDS_uuid 00000020:00000080:3.0:1788269880.611706:0:38288:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435dc000/MDS_uuid for MDS 00000020:01000000:3.0:1788269880.611712:0:38288:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788269880.611883:0:38288:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788269881.604177:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269882.306399:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269882.306406:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269882.306420:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269882.306425:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269882.306435:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269882.306449:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269882.306457:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269882.306460:0:34556:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788269882.306461:0:34556:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788269882.306473:0:34556:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c27a60e000 00010000:00010000:1.0:1788269882.306476:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269882.306480:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144193400/0xc5f5d7a016e06c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06c94 expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269882.306494:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269882.306496:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269882.306497:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269883.076463:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262519296:0@lo:400:kworker.0 00000400:00000100:1.0:1788269883.076495:0:3609:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262519296 offset 0 length 224: 4 00010000:00010000:1.0:1788269883.653563:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269884.677402:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269885.700244:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269886.086530:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262519424:0@lo:400:kworker.0 00000400:00000100:1.0:1788269886.086583:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262519424 offset 0 length 224: 4 00000001:00100000:3.0:1788269886.149633:0:36067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269886.149642:0:36067:0:(genops.c:885:class_export_put()) final put ffff98c144937000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788269886.149877:0:36885:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788269886.149882:0:36885:0:(genops.c:885:class_export_put()) final put ffff98c144354000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1788269886.724416:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269887.749267:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269888.773101:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269889.797635:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269890.244444:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25a72341-2152-4ec8-9ca0-7a670d594ca1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788269890.244451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788269890.244454:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c27a60e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269890.244459:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 672 00000100:00080000:1.0:1788269890.244465:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788269890.244472:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff98c27a60e000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788269890.244504:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27f291c00 x1875136262519680/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269890.244533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788269890.244537:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788269890.244627:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269890.245825:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262519808:0@lo:400:kworker.0 00000400:00000100:3.0:1788269890.245859:0:3607:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262519808 offset 0 length 224: 4 00010000:00010000:1.0:1788269890.822295:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269891.844243:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269892.293423:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269892.293433:0:34555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269892.293443:0:34555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269892.293448:0:34555:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269892.293469:0:34555:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269892.293488:0:34555:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269892.293502:0:34555:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269892.293507:0:34555:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788269892.293512:0:34555:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788269892.293528:0:34555:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c27a60e000 00010000:00010000:1.0:1788269892.293534:0:34555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269892.293543:0:34555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144192000/0xc5f5d7a016e06c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06c6a expref: -99 pid: 36066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269892.293557:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269892.293561:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269892.293563:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269892.311615:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c277ec5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788269892.311788:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1451bd000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788269892.314137:0:38489:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788269892.314150:0:38489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269892.314155:0:38489:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788269892.314162:0:38489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269892.314199:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1451ba800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788269892.314481:0:38489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269892.314489:0:38489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788269892.314495:0:38489:0:(genops.c:885:class_export_put()) final put ffff98c1451bc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788269892.314499:0:38489:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1451bc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788269892.314509:0:38489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788269892.314572:0:38489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788269892.314577:0:38489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269892.314581:0:38489:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788269892.314588:0:38489:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98c277ec0000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269892.314594:0:38489:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff98c1435019b8) has exports, disconnecting them 00000020:00080000:1.0:1788269892.314604:0:38489:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98c277ec0000), last request at 1788269842 00000020:00000080:1.0:1788269892.314609:0:38489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06cb7 00000020:00080000:1.0:1788269892.314621:0:38489:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c277ec0000): rc 0 00000020:00000080:1.0:1788269892.314706:0:38489:0:(genops.c:885:class_export_put()) final put ffff98c277ec0000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788269892.314781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c277ec0000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788269892.317202:0:38489:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788269892.317218:0:38489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788269892.317222:0:38489:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788269892.317227:0:38489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269892.317267:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c277ec5000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788269892.317352:0:38489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269892.317358:0:38489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788269892.317361:0:38489:0:(genops.c:885:class_export_put()) final put ffff98c1451be800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788269892.317363:0:38489:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1451be800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788269892.317367:0:38489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788269892.317406:0:38489:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c250df2800 1 00000020:00000080:1.0:1788269892.317410:0:38489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06c55 00000020:00000080:1.0:1788269892.317414:0:38489:0:(genops.c:885:class_export_put()) final put ffff98c27b5e0000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788269892.317421:0:38489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788269892.317424:0:38489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269892.317426:0:38489:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269892.317429:0:38489:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff98c275d84d28) has no exports 00000020:00000080:3.0:1788269892.317433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788269892.330340:0:38489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269892.330354:0:38489:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788269892.330360:0:38489:0:(genops.c:885:class_export_put()) final put ffff98c250df0800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788269892.330365:0:38489:0:(genops.c:844:class_export_destroy()) destroying export ffff98c250df0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788269892.330370:0:38489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788269892.330483:0:38489:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c250df1000 00000020:02000400:1.0:1788269892.330523:0:38489:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788269892.868213:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269893.892212:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269893.979538:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269893.979548:0:34556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269893.979560:0:34556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9efc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269893.979566:0:34556:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269893.979583:0:34556:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269893.979607:0:34556:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269893.979616:0:34556:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269893.979629:0:34556:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788269893.979632:0:34556:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788269893.979645:0:34556:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c27a60e000 00010000:00010000:1.0:1788269893.979649:0:34556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269893.979656:0:34556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e06d27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06d2e expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269893.979667:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269893.979670:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269893.979673:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269893.980610:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262519424:0@lo:400:kworker.0 00000100:00100000:3.0:1788269893.980651:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262519552:0@lo:400:kworker.0 00000100:00100000:1.0:1788269893.980673:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262519936:0@lo:39:umount.0 00000100:00100000:3.0:1788269893.980691:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262519808:0@lo:400:kworker.0 00000400:00000100:1.0:1788269893.980723:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262519936 offset 0 length 224: 4 00000100:00080000:1.0:1788269895.364153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25a72341-2152-4ec8-9ca0-7a670d594ca1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788269895.364185:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 25a72341-2152-4ec8-9ca0-7a670d594ca1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788269895.940365:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269896.964267:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269899.012209:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269900.036347:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269902.084540:0:34555:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269903.110739:0:34556:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269903.172386:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269893/real 1788269893] req@ffff98c1410e1500 x1875136262519936/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788269903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269903.172423:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c1410e1500 x1875136262519936/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788269903 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788269903.172440:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c1435b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788269903.172459:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262519936:0@lo:39:umount.0 00010000:00010000:1.0:1788269903.176803:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269903.176815:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176826:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269903.176830:0:35320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176840:0:35320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269903.176852:0:35320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269903.176857:0:35320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269903.176859:0:35320:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788269903.176862:0:35320:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788269903.176879:0:35320:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c27a60e000 00010000:00010000:1.0:1788269903.176882:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176889:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e06cfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e06d04 expref: -99 pid: 36884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176904:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269903.176907:0:35320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176913:0:35320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269903.176915:0:35320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176921:0:35320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269903.176927:0:35320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269903.176931:0:35320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788269903.176933:0:35320:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788269903.176936:0:35320:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788269903.176940:0:35320:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c27a60e000 00010000:00010000:1.0:1788269903.176943:0:35320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176948:0:35320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676600/0xc5f5d7a016e07164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e0716b expref: -99 pid: 34564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269903.176960:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269903.176962:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269903.176964:0:35320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788269903.192380:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c277e37800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788269903.193009:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25a72341-2152-4ec8-9ca0-7a670d594ca1:3606:1875136262519680:0@lo:250:kworker.0 10000000:01000000:3.0:1788269903.193655:0:34564:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1788269903.193992:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435db800/25a72341-2152-4ec8-9ca0-7a670d594ca1 for MGC192.168.201.142@tcp 00000020:00000080:1.0:1788269903.194003:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27a60e000 for MGC192.168.201.142@tcp 00000020:00000080:1.0:1788269903.194009:0:38087:0:(genops.c:885:class_export_put()) final put ffff98c27a60b000/25a72341-2152-4ec8-9ca0-7a670d594ca1 00000020:00000080:1.0:1788269903.194011:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27a60b000/25a72341-2152-4ec8-9ca0-7a670d594ca1 for MGC192.168.201.142@tcp 00000020:01000000:1.0:1788269903.194029:0:38087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.142@tcp (25a72341-2152-4ec8-9ca0-7a670d594ca1) 00000020:00000080:1.0:1788269903.194313:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788269903.197236:0:38690:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788269903.197245:0:38690:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269903.197250:0:38690:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788269903.197258:0:38690:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269903.197346:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c144353000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788269903.197457:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269903.197465:0:38690:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788269903.197471:0:38690:0:(genops.c:885:class_export_put()) final put ffff98c250df2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788269903.197474:0:38690:0:(genops.c:844:class_export_destroy()) destroying export ffff98c250df2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788269903.197484:0:38690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788269903.197545:0:38690:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788269903.197549:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269903.197555:0:38690:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788269903.197562:0:38690:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98c1435b4800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788269903.197569:0:38690:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff98c276b699b8) has exports, disconnecting them 00000020:00080000:3.0:1788269903.197574:0:38690:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98c1435b4800), last request at 1788269850 00000020:00000080:3.0:1788269903.197578:0:38690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06d51 00000020:00080000:3.0:1788269903.197592:0:38690:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c1435b4800): rc 0 00000020:00000080:3.0:1788269903.197597:0:38690:0:(genops.c:885:class_export_put()) final put ffff98c1435b4800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788269903.197666:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b4800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788269903.209238:0:38690:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788269903.209246:0:38690:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788269903.209249:0:38690:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788269903.209256:0:38690:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269903.209284:0:38087:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1435b6800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788269903.209332:0:34556:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788269903.209461:0:35320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788269903.209554:0:34555:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788269903.209647:0:34551:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98c142a71a00:34551] 1 exiting: rc = 0 00000100:00100000:1.0:1788269903.209708:0:34550:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98c1429da800:34550] 0 exiting: rc = 1 00000100:00100000:1.0:1788269903.209763:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210125:0:35719:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98c2758ffa00:35719] 3 exiting: rc = 0 00000100:00100000:3.0:1788269903.210139:0:34553:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98c142a71000:34553] 1 exiting: rc = 0 00000100:00100000:1.0:1788269903.210218:0:34554:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98c142a70e00:34554] 2 exiting: rc = 0 00000100:00100000:1.0:1788269903.210289:0:37591:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff98c26b669600:37591] 4 exiting: rc = 0 00000100:00100000:1.0:1788269903.210352:0:34552:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98c142a71800:34552] 0 exiting: rc = 1 00000100:00100000:1.0:1788269903.210393:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210399:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210403:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210408:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210413:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210417:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210421:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210426:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210431:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210436:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210440:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210445:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210450:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210456:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210461:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210466:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210471:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210477:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210482:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210487:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210491:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210497:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210501:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210507:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210513:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210520:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210525:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210530:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210535:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210540:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210545:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210551:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210557:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210563:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210567:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210571:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210574:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210577:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210581:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210584:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210588:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210593:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210598:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210603:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210620:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210627:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210632:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210638:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210642:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210648:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210653:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210658:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210663:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210668:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210674:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210679:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210683:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210688:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210692:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210697:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210702:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210707:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210713:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.210718:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788269903.211360:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269903.211369:0:38690:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788269903.211374:0:38690:0:(genops.c:885:class_export_put()) final put ffff98c1435b6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788269903.211377:0:38690:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788269903.211381:0:38690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788269903.211431:0:38690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c1451b9800 1 00000020:00000080:1.0:1788269903.211437:0:38690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e06cf6 00000020:00000080:1.0:1788269903.211442:0:38690:0:(genops.c:885:class_export_put()) final put ffff98c142580000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788269903.211453:0:38690:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788269903.211462:0:38087:0:(genops.c:844:class_export_destroy()) destroying export ffff98c142580000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788269903.211471:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269903.211475:0:38690:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788269903.211480:0:38690:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff98c2759d0000) has no exports 00000020:00000080:1.0:1788269903.240181:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269903.240194:0:38690:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788269903.240200:0:38690:0:(genops.c:885:class_export_put()) final put ffff98c1451bd800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788269903.240205:0:38690:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1451bd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788269903.240216:0:38690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788269903.240506:0:38690:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c1451b8800 00000020:01000000:1.0:1788269903.240534:0:38690:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788269903.240539:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269903.240544:0:38690:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788269903.240549:0:38690:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff98c143504d28) has no exports 00000020:00000080:1.0:1788269903.240586:0:38690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269903.240591:0:38690:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788269903.240594:0:38690:0:(genops.c:885:class_export_put()) final put ffff98c27b5e7000/OSS_uuid 00000020:00000080:1.0:1788269903.240596:0:38690:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e7000/OSS_uuid for OSS 00000020:01000000:1.0:1788269903.240599:0:38690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788269903.240794:0:37085:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff98c14491ac00:37085] 4 exiting: rc = 0 00000100:00100000:3.0:1788269903.241032:0:36070:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98c24394fe00:36070] 0 exiting: rc = 1 00000100:00100000:3.0:1788269903.241114:0:36072:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98c143a1e600:36072] 1 exiting: rc = 0 00000100:00100000:3.0:1788269903.241183:0:37084:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98c1451ada00:37084] 3 exiting: rc = 0 00000100:00100000:1.0:1788269903.241497:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241506:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241511:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241516:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241521:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241526:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241531:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241536:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241542:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241551:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241557:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241561:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241566:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241571:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241577:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241582:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241589:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241594:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241599:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241604:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241609:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241613:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241618:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241623:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241628:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241633:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241638:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241643:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241648:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241652:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241657:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241662:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241668:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241673:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241679:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241684:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241690:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241695:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241700:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241705:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241710:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241715:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241720:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241725:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241730:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241735:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241741:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241746:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241753:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241758:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241763:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241768:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241773:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241778:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241782:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241787:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241793:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241798:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241803:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241808:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241813:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241818:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241824:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269903.241830:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.243412:0:36075:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98c27a18e000:36075] 1 exiting: rc = 0 00000100:00100000:1.0:1788269903.243526:0:36074:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98c142a3b000:36074] 0 exiting: rc = 1 00000100:00100000:3.0:1788269903.244998:0:36077:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98c27a18fa00:36077] 1 exiting: rc = 0 00000100:00100000:3.0:1788269903.253489:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253496:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253499:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253503:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253506:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253509:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253512:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253516:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253519:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253522:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253525:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253528:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253531:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253535:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253537:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253540:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253543:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253546:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253549:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253552:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253554:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253557:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253560:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253562:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253565:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253568:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253571:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253574:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253578:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253581:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253584:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253586:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253589:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253593:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253595:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253598:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253601:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253604:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253607:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253610:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253613:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253615:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253619:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253621:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253624:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253627:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253630:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253633:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253636:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253639:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253641:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253644:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253647:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253650:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253653:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253655:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253658:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253661:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253664:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253667:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253669:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253672:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253674:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.253677:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254908:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254913:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254917:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254922:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254926:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254930:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254934:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254938:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254941:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254946:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254976:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254983:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254989:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.254994:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255001:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255006:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255009:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255013:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255027:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255034:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255143:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255152:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255178:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255190:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255201:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255213:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255595:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255601:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255607:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255613:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255618:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255625:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255630:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255636:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255655:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255661:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255667:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255674:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255680:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255685:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255690:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255695:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255701:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255706:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255712:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255717:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255736:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255743:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255748:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255754:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255761:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255767:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255772:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255778:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255784:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255790:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255795:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255800:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255817:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255823:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255828:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255833:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255839:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269903.255850:0:38690:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788269920.949304:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269920.953427:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788269920.953436:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000020:00000080:3.0:1788269920.954469:0:40054:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788269920.954485:0:40054:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.142@tcp' 00000020:01000004:3.0:1788269920.954486:0:40054:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788269920.954511:0:40054:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.142@tcp (typ=mgc) 00000020:00000080:3.0:1788269920.954520:0:40054:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.142@tcp (ffff98c276b6cd28) 00000020:00000080:3.0:1788269920.954531:0:40054:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788269920.954603:0:40054:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c248242000@MGC192.168.201.142@tcp: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269920.954738:0:40054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.142@tcp-0 is initialized 00000040:01000000:3.0:1788269920.954744:0:40054:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788269920.956594:0:40072:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00100000:1.0:1788269920.957807:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e129e33-0062-408b-ba53-2e2ae2985734:3606:1875136262520064:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788269920.957879:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269920.957972:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262520064 00000100:00100000:1.0:1788269920.957980:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262520064 00000100:00100000:1.0:1788269920.958012:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269920.958020:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27ec8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3606:x1875136262520064:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788269920.958080:0:40068:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8e129e33-0062-408b-ba53-2e2ae2985734@0@lo t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:1.0:1788269920.958104:0:40068:0:(genops.c:1385:class_connect()) connect: client 8e129e33-0062-408b-ba53-2e2ae2985734, cookie 0xc5f5d7a016e0736a 00000100:00080000:1.0:1788269920.958249:0:40068:0:(import.c:65:import_set_state_nolock()) ffff98c24589a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269920.958325:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27ec8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+5:3606:x1875136262520064:12345-0@lo:250:mount.lustre.0 Request processed in 303us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269920.958333:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269920.962722:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788269920.962730:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788269920.964514:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788269920.964521:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788269921.001390:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788269921.001395:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788269921.016181:0:40054:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269921.016367:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788269921.016373:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788269921.017602:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788269921.017610:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788269921.018321:0:40054:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788269921.018327:0:40054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788269921.018907:0:40054:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788269921.018934:0:40054:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788269921.018939:0:40054:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788269921.019128:0:40054:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788269921.019158:0:40054:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788269921.019162:0:40054:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788269921.019163:0:40054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269921.019165:0:40054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269921.019166:0:40054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269921.019167:0:40054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269921.019169:0:40054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269921.019170:0:40054:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269921.019171:0:40054:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269921.019173:0:40054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269921.019174:0:40054:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269921.019176:0:40054:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788269921.019178:0:40054:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269921.019179:0:40054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269921.019180:0:40054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269921.019182:0:40054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269921.019183:0:40054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269921.019184:0:40054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269921.019186:0:40054:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269921.019187:0:40054:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269921.019188:0:40054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269921.019189:0:40054:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269921.019212:0:40054:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788269921.019229:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788269921.019293:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.019359:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 20000000:01000000:3.0:1788269921.020212:0:40070:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 22 20000000:01000000:3.0:1788269921.025453:0:40091:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788269921.025463:0:40091:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788269921.025466:0:40091:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788269921.025469:0:40091:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788269921.025690:0:40091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788269921.025812:0:40070:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788269921.025821:0:40070:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788269921.027221:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27ec8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+5:40054:x1875136262520192:12345-0@lo:253:mount.lustre.0 Request processed in 7737us (7921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.027238:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269921.027349:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788269921.027365:0:40054:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788269921.027368:0:40054:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788269921.027370:0:40054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269921.027371:0:40054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269921.027373:0:40054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269921.027374:0:40054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269921.027375:0:40054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269921.027376:0:40054:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269921.027378:0:40054:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269921.027379:0:40054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269921.027381:0:40054:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788269921.027401:0:40054:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c145155800 from lustre-MDT0000 10000000:01000000:1.0:1788269921.027430:0:40054:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788269921.027432:0:40054:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788269921.027436:0:40054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c276b6cd28 10000000:01000000:1.0:1788269921.027441:0:40054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269921.027449:0:40054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c276b6cd28 from 1 10000000:01000000:1.0:1788269921.027452:0:40054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788269921.027485:0:40054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.027496:0:40054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.027511:0:40054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.027530:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269921.027563:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.027603:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.027659:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262520320 00000100:00100000:3.0:1788269921.027665:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262520320 00000100:00100000:3.0:1788269921.027715:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269921.027724:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27ec8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+5:40054:x1875136262520320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269921.027735:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269921.027747:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b676000/0xc5f5d7a016e07378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07371 expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.027766:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b676000/0xc5f5d7a016e07378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07371 expref: 6 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.027775:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b676000/0xc5f5d7a016e07378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07371 expref: 6 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.027783:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676000, rc 0) 00000100:00100000:3.0:1788269921.027807:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27ec8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+6:40054:x1875136262520320:12345-0@lo:101:mount.lustre.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.027812:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269921.027881:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269921.027892:0:40054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.027901:0:40054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.027945:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269921.027968:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.027988:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.028031:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262520448 00000100:00100000:3.0:1788269921.028035:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262520448 00000100:00100000:3.0:1788269921.028089:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269921.028095:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+6:40054:x1875136262520448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269921.028150:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+6:40054:x1875136262520448:12345-0@lo:501:mount.lustre.0 Request processed in 55us (181us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269921.028157:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269921.028257:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520448:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788269921.028278:0:40054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788269921.028295:0:40054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028303:0:40054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269921.028310:0:40054:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c145155800 10000000:01000000:1.0:1788269921.028313:0:40054:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788269921.028317:0:40054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98c145155800 10000000:01000000:1.0:1788269921.028319:0:40054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788269921.028322:0:40054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98c145155800 from 1 10000000:01000000:1.0:1788269921.028324:0:40054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788269921.028336:0:40054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028343:0:40054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028350:0:40054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.028361:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269921.028383:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.028411:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269921.028630:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269921.028639:0:40054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028646:0:40054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269921.028655:0:40054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788269921.028658:0:40054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028664:0:40054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269921.028674:0:40054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788269921.028677:0:40054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269921.028680:0:40054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98c145155800 10000000:01000000:1.0:1788269921.028682:0:40054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788269921.028684:0:40054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788269921.028686:0:40054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788269921.028696:0:40054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028703:0:40054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.028721:0:40054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.028733:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269921.028756:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.028776:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269921.028999:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269921.029008:0:40054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.029015:0:40054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.029105:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269921.029130:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.029145:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269921.029520:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269921.029546:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269921.029586:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.029612:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.029687:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262520960 00000100:00100000:3.0:1788269921.029691:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262520960 00000100:00100000:3.0:1788269921.029724:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269921.029732:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+9:40054:x1875136262520960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269921.030389:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+9:40054:x1875136262520960:12345-0@lo:503:mount.lustre.0 Request processed in 657us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.030399:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269921.030475:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262520960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269921.030981:0:40092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e129e33-0062-408b-ba53-2e2ae2985734:40092:1875136262521088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269921.031019:0:40092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.031184:0:40092:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275b5e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.031946:0:40092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e129e33-0062-408b-ba53-2e2ae2985734:40092:1875136262521088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269921.031972:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269921.031983:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269921.031986:0:40092:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788269921.031991:0:40092:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788269921.031994:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269921.032010:0:40092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98c276b699b8) 00000020:00000080:3.0:1788269921.032025:0:40092:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788269921.032030:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788269921.032197:0:40092:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788269921.032204:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e073a2 00000020:00000080:3.0:1788269921.032393:0:40092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788269921.032397:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269921.032401:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269921.032403:0:40092:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788269921.032406:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269921.032410:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269921.032411:0:40092:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788269921.032415:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269921.032423:0:40092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98c276b6b370) 00000020:00000080:3.0:1788269921.032432:0:40092:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788269921.032436:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788269921.032438:0:40092:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788269921.032440:0:40092:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788269921.032446:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788269921.032486:0:40092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c145155800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788269921.032498:0:40092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98c276b68000) 00000020:00000080:3.0:1788269921.032509:0:40092:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788269921.032557:0:40092:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788269921.032563:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e073b7 00000020:00000080:3.0:1788269921.032647:0:40092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788269921.032654:0:40092:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788269921.032658:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc5f5d7a016e073be 00080000:01000000:3.0:1788269921.032663:0:40092:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788269921.032667:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e073c5 00000020:00000080:1.0:1788269921.087340:0:40092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788269921.087353:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269921.087360:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.087362:0:40092:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788269921.087366:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788269921.087368:0:40092:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788269921.087370:0:40092:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269921.087371:0:40092:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269921.087372:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788269921.087374:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.087375:0:40092:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788269921.087378:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269921.087382:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.087384:0:40092:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788269921.087389:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788269921.087440:0:40092:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788269921.087457:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269921.087460:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.087462:0:40092:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788269921.087464:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269921.087467:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.087468:0:40092:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788269921.087471:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788269921.087476:0:40092:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:1.0:1788269921.087502:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788269921.087516:0:40092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98c1438a99b8) 00000020:00000080:1.0:1788269921.087528:0:40092:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788269921.087534:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788269921.087590:0:40092:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788269921.087595:0:40092:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788269921.087601:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e073e8 00010000:00080000:1.0:1788269921.087632:0:40092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c143a5f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788269921.090602:0:40092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000100:00100000:1.0:1788269921.093966:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262521216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788269921.094068:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269921.094629:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269921.094635:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269921.094639:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262521216:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1788269921.094971:0:40092:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788269921.096287:0:40092:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788269921.098765:0:40092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269921.098972:0:40092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:1.0:1788269921.104362:0:40092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].1, 64 off8256 00000040:00080000:1.0:1788269921.104673:0:40098:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788269921.104677:0:40098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788269921.105291:0:40092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269921.105302:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788269921.105337:0:40092:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788269921.105355:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e07404 00000100:00080000:1.0:1788269921.105365:0:40092:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788269921.105371:0:40092:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c275d9d000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788269921.105405:0:40092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27f293800 x1875136262521344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269921.105458:0:40092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788269921.105465:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262521344:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788269921.105522:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262521344 offset 0 length 520: 4 00000020:01000000:1.0:1788269921.105588:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269921.105592:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.105594:0:40092:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788269921.105597:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788269921.105599:0:40092:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788269921.105601:0:40092:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269921.105602:0:40092:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269921.105604:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788269921.105606:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.105607:0:40092:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788269921.105609:0:40092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788269921.105613:0:40092:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788269921.105616:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269921.105617:0:40092:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788269921.105620:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788269921.105624:0:40092:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:1.0:1788269921.105645:0:40092:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788269921.105647:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788269921.105658:0:40092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98c1438ab370) 00000020:00000080:1.0:1788269921.105669:0:40092:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788269921.105673:0:40092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788269921.105740:0:40092:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788269921.105746:0:40092:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788269921.105752:0:40092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e07412 00010000:00080000:1.0:1788269921.105778:0:40092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c247f7c000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788269921.105974:0:40092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788269921.106075:0:40092:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788269921.106091:0:40092:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788269921.107125:0:40092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269921.108879:0:40092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:1.0:1788269921.109034:0:40092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].1, 64 off8256 00000040:00080000:1.0:1788269921.109579:0:40100:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788269921.109584:0:40100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788269921.110419:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262521472:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788269921.110455:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262521472 offset 0 length 520: 4 00000100:00100000:3.0:1788269921.113450:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262521856 00000100:00100000:3.0:1788269921.113458:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262521856 00000100:00100000:3.0:1788269921.113501:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269921.113510:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+10:40054:x1875136262521856:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788269921.113529:0:40070:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788269921.113536:0:40070:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788269921.113620:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+10:40054:x1875136262521856:12345-0@lo:256:mount.lustre.0 Request processed in 112us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.113628:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269921.117101:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262521984 00000100:00100000:1.0:1788269921.117112:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262521984 00000100:00100000:1.0:1788269921.117164:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269921.118520:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+10:40054:x1875136262521984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269921.118538:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269921.118560:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0742e expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.118585:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 11 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.118595:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 11 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.118605:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf200, rc 0) 00000100:00100000:1.0:1788269921.118735:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+11:40054:x1875136262521984:12345-0@lo:101:mount.lustre.0 Request processed in 1564us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269921.118742:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269921.119078:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262522112 00000100:00100000:3.0:1788269921.119085:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262522112 00000100:00100000:3.0:1788269921.119126:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269921.119134:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+11:40054:x1875136262522112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269921.119266:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+11:40054:x1875136262522112:12345-0@lo:501:mount.lustre.0 Request processed in 133us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.119274:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788269921.120194:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262522240 00000100:00100000:1.0:1788269921.120198:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262522240 00000100:00100000:1.0:1788269921.120224:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788269921.120228:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+11:40054:x1875136262522240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269921.120307:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+11:40054:x1875136262522240:12345-0@lo:503:mount.lustre.0 Request processed in 78us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269921.120313:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269921.121303:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262522368 00000100:00100000:3.0:1788269921.121309:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262522368 00000100:00100000:3.0:1788269921.121403:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788269921.121411:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+11:40102:x1875136262522368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269921.122866:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262522496 00000100:00100000:1.0:1788269921.122873:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262522496 00000100:00100000:1.0:1788269921.122906:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269921.122913:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+11:40102:x1875136262522496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269921.123004:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+11:40102:x1875136262522496:12345-0@lo:502:llog_process_th.0 Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269921.123011:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:1.0:1788269921.123329:0:40054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788269921.123348:0:40054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269921.123364:0:40054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.123372:0:40054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269921.123426:0:40054:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788269921.123429:0:40054:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c145155800 10000000:01000000:1.0:1788269921.123431:0:40054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c145155800 10000000:01000000:1.0:1788269921.123435:0:40054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269921.123439:0:40054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c145155800 from 1 10000000:01000000:1.0:1788269921.123441:0:40054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788269921.123464:0:40054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.123473:0:40054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.123482:0:40054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.123495:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262522624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269921.123518:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.123531:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275c2e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269921.123900:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262522624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269921.123909:0:40054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.123916:0:40054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.123950:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262522752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269921.123997:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.124008:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275c2e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269921.124459:0:40054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262522752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269921.124481:0:40054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40054:1875136262522880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269921.124531:0:40054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.124553:0:40054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275c2e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.130210:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262523136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269921.130291:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269921.130557:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269921.130565:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269921.130569:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788269921.130573:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262523136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269921.132361:0:40103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e129e33-0062-408b-ba53-2e2ae2985734:40103:1875136262523264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269921.132427:0:40103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269921.132464:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262523264 00000100:00100000:3.0:1788269921.132470:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262523264 00000100:00100000:3.0:1788269921.132510:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269921.132520:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+12:40103:x1875136262523264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269921.132629:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+12:40103:x1875136262523264:12345-0@lo:502:llog_process_th.0 Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.132637:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269921.132908:0:40103:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.132927:0:40103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e129e33-0062-408b-ba53-2e2ae2985734:40103:1875136262523264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269921.132972:0:40103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e129e33-0062-408b-ba53-2e2ae2985734:40103:1875136262523392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269921.133011:0:40103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269921.133034:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262523392 00000100:00100000:3.0:1788269921.133058:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262523392 00000100:00100000:3.0:1788269921.133085:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269921.133092:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+12:40103:x1875136262523392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269921.133158:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+12:40103:x1875136262523392:12345-0@lo:502:llog_process_th.0 Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.133165:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269921.133198:0:40103:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269921.133209:0:40103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e129e33-0062-408b-ba53-2e2ae2985734:40103:1875136262523392:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788269921.133228:0:40103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:3.0:1788269921.135177:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262523520 00000100:00100000:3.0:1788269921.135183:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262523520 00000100:00100000:3.0:1788269921.135222:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269921.135229:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40054:x1875136262523520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788269921.135250:0:40068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788269921.135263:0:40068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788269921.137022:0:40068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788269921.137061:0:40068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788269921.138741:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40054:x1875136262523520:12345-0@lo:253:mount.lustre.0 Request processed in 3505us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269921.138755:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269921.139074:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262523648 00000100:00100000:3.0:1788269921.139083:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262523648 00000100:00100000:3.0:1788269921.139131:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269921.139144:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262523648:12345-0@lo:104: 00010000:00010000:3.0:1788269921.139162:0:40058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.139226:0:40058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269921.139233:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262523648:12345-0@lo:104: Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269921.139240:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788269921.139257:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269921.139262:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.139268:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269921.139271:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.139277:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269921.139283:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269921.139288:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269921.139320:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.139327:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269921.139357:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.139365:0:40090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262523648:0@lo:104: 00010000:00010000:3.0:1788269921.139368:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418e000/0xc5f5d7a016e07420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07427 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139384:0:40090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269921.139390:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269921.139394:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269921.139397:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269921.139429:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262523776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269921.139467:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269921.139519:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262523776 00000100:00100000:1.0:1788269921.139523:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262523776 00010000:00010000:1.0:1788269921.139544:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c275b56000/0xc5f5d7a016e07427 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07420 expref: 12 pid: 40069 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269921.139567:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269921.139576:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e129e33-0062-408b-ba53-2e2ae2985734+12:3609:x1875136262523776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269921.139588:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269921.139593:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c275b56000/0xc5f5d7a016e07427 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07420 expref: 12 pid: 40069 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139604:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c275b56000/0xc5f5d7a016e07427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e07420 expref: 12 pid: 40069 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139620:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b56000/0xc5f5d7a016e07427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07420 expref: 12 pid: 40069 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139634:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139643:0:40060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788269921.139657:0:40060:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000809139s 00010000:00010000:1.0:1788269921.139661:0:40060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139668:0:40060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139676:0:40060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139683:0:40060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139702:0:40060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269921.139717:0:40060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139728:0:40060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139743:0:40060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139753:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269921.139814:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e129e33-0062-408b-ba53-2e2ae2985734+11:3609:x1875136262523776:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269921.139820:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788269921.139838:0:40090:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139843:0:40090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269921.139848:0:40090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b56c00/0xc5f5d7a016e07458 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788269921.146572:0:40054:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 17179869276 00000020:00080000:3.0:1788269921.146728:0:40113:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 17179869276 00000020:00080000:3.0:1788269921.146732:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869276 00000040:01000000:1.0:1788269921.147222:0:40054:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788269921.147532:0:40115:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98c248218a80 x1875136262523904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269921.147542:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 00000040:00080000:1.0:1788269921.156456:0:40114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788269921.156526:0:40114:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788269921.160374:0:40054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788269921.160431:0:40054:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788269921.161553:0:40054:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/32) registered 00000001:00000004:1.0:1788269921.163574:0:40054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00080000:1.0:1788269921.167178:0:40054:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788269921.167220:0:40054:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad658177f988 00100000:10000000:1.0:1788269921.167228:0:40054:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788269921.168832:0:40054:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788269921.168849:0:40054:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788269921.168870:0:40054:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788269921.168889:0:40054:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788269921.171882:0:40054:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788269921.172157:0:40054:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788269921.988369:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269922.180799:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 10000000:01000000:3.0:1788269922.308128:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269922.308137:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c145155800 from 23 10000000:01000000:3.0:1788269922.308142:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269922.308191:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269922.308203:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269922.308214:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269922.308240:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262524032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269922.308341:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269922.308425:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269922.309995:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262524160 00000100:00100000:3.0:1788269922.310010:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262524160 00000100:00100000:3.0:1788269922.310068:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269922.310077:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40072:x1875136262524160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788269922.310090:0:40068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788269922.310107:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788269922.310110:0:40068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:3.0:1788269922.310573:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40072:x1875136262524160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 495us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269922.310581:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269923.204315:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 00000040:00080000:3.0:1788269923.208826:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788269923.572907:0:40359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788269924.107386:0:40411:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269924.107556:0:40411:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788269924.229441:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 00000020:00000004:3.0:1788269924.611153:0:40462:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269924.611308:0:40462:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788269925.259329:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 00000100:00080000:3.0:1788269926.596159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788269926.596166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788269926.596170:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269926.596180:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 712 00000100:00080000:3.0:1788269926.596185:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788269926.596208:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c143a5f000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269926.596234:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c24821bb80 x1875136262524416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269926.596247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269926.596251:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269926.596254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269926.596258:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269926.596261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788269926.596264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788269926.596266:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269926.596273:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98c2491eb000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269926.596292:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c248218700 x1875136262524544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269926.596327:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262524288 00000100:00100000:3.0:1788269926.596335:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262524288 00000100:00100000:3.0:1788269926.596394:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269926.596405:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+12:3610:x1875136262524288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269926.596467:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+12:3610:x1875136262524288:12345-0@lo:400:kworker.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269926.596476:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269926.597339:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262524544 00000100:00100000:3.0:1788269926.597346:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262524544 00000100:00100000:3.0:1788269926.597371:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269926.597377:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1875136262524544:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788269926.597396:0:40076:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1788269926.597486:0:40076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc5f5d7a016e0746d 00000004:00100000:3.0:1788269926.597503:0:40076:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788269926.597678:0:40076:0:(import.c:65:import_set_state_nolock()) ffff98c27b77a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269926.597748:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875136262524544:12345-0@lo:38:kworker.0 Request processed in 369us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269926.597755:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788269927.108443:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788269928.026884:0:40806:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788269928.026887:0:40806:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788269928.026888:0:40806:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788269928.027102:0:40806:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c27b77a000 00000020:01000004:3.0:1788269928.027114:0:40806:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788269928.027123:0:40806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788269928.027135:0:40806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98c248a2cd28) 00000020:00000080:3.0:1788269928.027147:0:40806:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1788269928.085876:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262524672 00000100:00100000:3.0:1788269928.085884:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262524672 00000100:00100000:3.0:1788269928.085978:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269928.085988:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40806:x1875136262524672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788269928.086017:0:40068:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788269928.086021:0:40068:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788269928.086061:0:40068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788269928.086464:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40806:x1875136262524672:12345-0@lo:253:mount.lustre.0 Request processed in 471us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.086473:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:01000004:3.0:1788269928.086600:0:40806:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c27b77a000 from lustre-MDT0001 10000000:01000000:3.0:1788269928.086623:0:40806:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788269928.086626:0:40806:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788269928.086632:0:40806:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c276b6cd28 local copy 00010000:00010000:3.0:1788269928.086641:0:40806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.086731:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262524800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269928.086761:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.086788:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.086968:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262524800:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788269928.086988:0:40806:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788269928.087008:0:40806:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788269928.087015:0:40806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087024:0:40806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.087076:0:40806:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c27b77a000 10000000:01000000:3.0:1788269928.087082:0:40806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788269928.087086:0:40806:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98c276b6cd28 10000000:01000000:3.0:1788269928.087089:0:40806:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788269928.087092:0:40806:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98c276b6cd28 from 1 10000000:01000000:3.0:1788269928.087095:0:40806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788269928.087118:0:40806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087127:0:40806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087137:0:40806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.087150:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262524928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269928.087174:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.087197:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.087224:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262524928 00000100:00100000:1.0:1788269928.087229:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262524928 00000100:00100000:1.0:1788269928.087260:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788269928.087267:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+12:40806:x1875136262524928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269928.087276:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269928.087288:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0be600/0xc5f5d7a016e07489 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07482 expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.087307:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0be600/0xc5f5d7a016e07489 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07482 expref: 13 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.087317:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0be600/0xc5f5d7a016e07489 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07482 expref: 13 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.087325:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be600, rc 0) 00000100:00100000:1.0:1788269928.087362:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+13:40806:x1875136262524928:12345-0@lo:101:mount.lustre.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.087370:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788269928.087394:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262524928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269928.087408:0:40806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087417:0:40806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.087430:0:40806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788269928.087442:0:40806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087452:0:40806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.087459:0:40806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98c27b77a000 10000000:01000000:3.0:1788269928.087463:0:40806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788269928.087466:0:40806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98c27b77a000 from 1 10000000:01000000:3.0:1788269928.087468:0:40806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788269928.087480:0:40806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087486:0:40806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087493:0:40806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.087502:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269928.087525:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.087540:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.087734:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269928.087745:0:40806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087753:0:40806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.087762:0:40806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788269928.087772:0:40806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087780:0:40806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.087786:0:40806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788269928.087790:0:40806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269928.087793:0:40806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98c27b77a000 10000000:01000000:3.0:1788269928.087795:0:40806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788269928.087798:0:40806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788269928.087800:0:40806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788269928.087810:0:40806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087816:0:40806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.087822:0:40806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.087833:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269928.087856:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.087872:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.087895:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262525184 00000100:00100000:1.0:1788269928.087899:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262525184 00000100:00100000:1.0:1788269928.087921:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788269928.087927:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+14:40806:x1875136262525184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269928.087934:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269928.087942:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0be400/0xc5f5d7a016e074a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0749e expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.087956:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0be400/0xc5f5d7a016e074a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0749e expref: 15 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.087965:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0be400/0xc5f5d7a016e074a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0749e expref: 15 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.087971:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be400, rc 0) 00000100:00100000:1.0:1788269928.088018:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525184:12345-0@lo:101:mount.lustre.0 Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.088032:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269928.096543:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262525312 00000100:00100000:3.0:1788269928.096549:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262525312 00000100:00100000:3.0:1788269928.096599:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269928.096611:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269928.096744:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525312:12345-0@lo:501:mount.lustre.0 Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.096755:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269928.096788:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269928.096825:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269928.096842:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.096872:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262525440 00000100:00100000:1.0:1788269928.096877:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262525440 00000100:00100000:1.0:1788269928.096911:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788269928.096919:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269928.097371:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525440:12345-0@lo:503:mount.lustre.0 Request processed in 453us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.097376:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269928.097430:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788269928.097733:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269928.097785:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269928.097818:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269928.097886:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.097918:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262525568 00000100:00100000:3.0:1788269928.097923:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262525568 00000100:00100000:3.0:1788269928.097984:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788269928.097992:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269928.099202:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525568:12345-0@lo:502:mount.lustre.0 Request processed in 1208us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.099210:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269928.099282:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269928.099446:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:0.0:1788269928.099475:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 136 off8552 00000040:00080000:0.0:1788269928.099490:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 176 off8728 00000040:00080000:0.0:1788269928.099504:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8952 00000040:00080000:0.0:1788269928.099517:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9176 00000040:00080000:0.0:1788269928.099528:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9296 00000040:00080000:0.0:1788269928.099540:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 112 off9408 00000040:00080000:0.0:1788269928.099555:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 160 off9568 00000040:00080000:0.0:1788269928.099566:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9792 00000040:00080000:0.0:1788269928.099577:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 224 off10016 00000040:00080000:0.0:1788269928.099614:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 88 off10104 00000040:00080000:0.0:1788269928.099631:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 144 off10248 00000040:00080000:0.0:1788269928.099643:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 152 off10400 00000040:00080000:0.0:1788269928.099656:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 168 off10568 00000040:00080000:0.0:1788269928.099670:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 224 off10792 00000040:00080000:0.0:1788269928.099683:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 224 off11016 00000040:00080000:0.0:1788269928.099695:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 80 off11096 00000040:00080000:0.0:1788269928.099706:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11320 00000040:00080000:0.0:1788269928.099720:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 224 off11544 00000040:00080000:0.0:1788269928.099736:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 160 off11704 00000040:00080000:0.0:1788269928.099750:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11928 00000040:00080000:0.0:1788269928.099765:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 224 off12152 00000040:00080000:0.0:1788269928.099776:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 80 off12232 00000040:00080000:0.0:1788269928.099789:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 224 off12456 00000040:00080000:0.0:1788269928.099804:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 224 off12680 00000040:00080000:0.0:1788269928.099817:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 88 off12768 00000040:00080000:0.0:1788269928.099831:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 144 off12912 00000040:00080000:0.0:1788269928.099843:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 152 off13064 00000040:00080000:0.0:1788269928.099857:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 136 off13200 00000040:00080000:0.0:1788269928.099873:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13424 00000040:00080000:0.0:1788269928.099887:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 224 off13648 00000040:00080000:0.0:1788269928.099900:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 80 off13728 00000040:00080000:0.0:1788269928.099912:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 224 off13952 00000040:00080000:0.0:1788269928.099927:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 224 off14176 00000040:00080000:0.0:1788269928.099943:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 88 off14264 00000040:00080000:0.0:1788269928.099956:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 144 off14408 00000040:00080000:0.0:1788269928.099968:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 152 off14560 00000040:00080000:0.0:1788269928.099980:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 136 off14696 00000040:00080000:0.0:1788269928.099994:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14920 00000040:00080000:0.0:1788269928.100007:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 224 off15144 00000040:00080000:0.0:1788269928.100021:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 80 off15224 00000040:00080000:0.0:1788269928.100034:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 224 off15448 00000040:00080000:0.0:1788269928.100279:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 224 off15672 00000040:00080000:0.0:1788269928.100296:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 120 off15792 00000100:00100000:0.0:1788269928.100328:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269928.100377:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269928.100454:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.100492:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262525696 00000100:00100000:1.0:1788269928.100499:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262525696 00000100:00100000:1.0:1788269928.100572:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788269928.100595:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269928.100701:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262525696:12345-0@lo:502:mount.lustre.0 Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.100708:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269928.100787:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262525696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269928.100831:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off16016 00000040:00080000:3.0:1788269928.100840:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788269928.101449:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269928.101459:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.101461:0:40810:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788269928.101466:0:40810:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788269928.101469:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269928.101482:0:40810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98c248a28000) 00000020:00000080:3.0:1788269928.101500:0:40810:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788269928.101506:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788269928.101600:0:40810:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788269928.101608:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e074b3 00000020:00000080:3.0:1788269928.101804:0:40810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788269928.101810:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.101813:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.101814:0:40810:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788269928.101817:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269928.101821:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.101822:0:40810:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788269928.101825:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269928.101833:0:40810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98c248a2b370) 00000020:00000080:3.0:1788269928.101844:0:40810:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788269928.101849:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788269928.101850:0:40810:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788269928.101853:0:40810:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788269928.101858:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788269928.101917:0:40810:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c27b77a000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788269928.101929:0:40810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98c248a299b8) 00000020:00000080:3.0:1788269928.101939:0:40810:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788269928.101994:0:40810:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788269928.102000:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e074c8 00000020:00000080:3.0:1788269928.102129:0:40810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788269928.102137:0:40810:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788269928.102142:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc5f5d7a016e074cf 00080000:01000000:3.0:1788269928.102147:0:40810:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788269928.102151:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e074d6 00010000:00010000:0.0:1788269928.132245:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269928.140720:0:40810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788269928.141125:0:40810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 21474836514 00000001:00080000:3.0:1788269928.141411:0:40810:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788269928.142269:0:40810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788269928.142279:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.142284:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.142286:0:40810:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788269928.142289:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269928.142293:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.142295:0:40810:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788269928.142297:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269928.142302:0:40810:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:3.0:1788269928.142325:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269928.142340:0:40810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98c1437899b8) 00000020:00000080:3.0:1788269928.142358:0:40810:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788269928.142363:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269928.142431:0:40810:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788269928.142438:0:40810:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788269928.142444:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e074e4 00010000:00080000:3.0:1788269928.142473:0:40810:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c2458b7000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269928.143942:0:40810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788269928.144788:0:40810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269928.144799:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788269928.144840:0:40810:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788269928.144857:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e074eb 00000100:00080000:3.0:1788269928.144874:0:40810:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269928.144878:0:40810:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98c2458b7000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269928.144906:0:40810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c24821aa00 x1875136262525824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269928.144927:0:40810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788269928.144965:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262525824:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788269928.145000:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.145004:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.145006:0:40810:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788269928.145009:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788269928.145011:0:40810:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788269928.145013:0:40810:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269928.145014:0:40810:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269928.145016:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788269928.145018:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.145020:0:40810:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788269928.145022:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269928.145027:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.145028:0:40810:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788269928.145032:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788269928.145036:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269928.145157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788269928.145162:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788269928.145165:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269928.145170:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:1.0:1788269928.145174:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788269928.145178:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c143a5f000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788269928.145196:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27f291f80 x1875136262525952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269928.145213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269928.145217:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788269928.145219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269928.145222:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:01000000:3.0:1788269928.145260:0:40810:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788269928.145273:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262526080:0@lo:400:kworker.0 00000020:01000000:3.0:1788269928.145279:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.145282:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.145284:0:40810:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788269928.145287:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788269928.145288:0:40810:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788269928.145290:0:40810:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269928.145292:0:40810:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269928.145294:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788269928.145297:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.145298:0:40810:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788269928.145300:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269928.145304:0:40810:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788269928.145307:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.145309:0:40810:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788269928.145312:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269928.145315:0:40810:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000100:00100000:1.0:1788269928.145316:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788269928.145459:0:40810:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788269928.145465:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269928.145478:0:40810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98c14378cd28) 00000020:00000080:3.0:1788269928.145492:0:40810:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788269928.145497:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269928.145598:0:40810:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788269928.145604:0:40810:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788269928.145611:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e07500 00010000:00080000:3.0:1788269928.145638:0:40810:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27c81c800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269928.145845:0:40810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788269928.147220:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262526080 00000100:00100000:1.0:1788269928.147229:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262526080 00000100:00100000:1.0:1788269928.147275:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269928.147286:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269928.147357:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262526080:12345-0@lo:400:kworker.0 Request processed in 74us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.147366:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788269928.147411:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27f293480 x1875136262526080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269928.147425:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262526080:0@lo:400:kworker.0 00000100:00100000:1.0:1788269928.147456:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262525952:0@lo:38:kworker.0 00000100:00100000:1.0:1788269928.147487:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.147535:0:40080:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788269928.147542:0:40080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788269928.147794:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262525952 00000100:00100000:1.0:1788269928.147799:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262525952 00000040:01000000:3.0:1788269928.147967:0:40810:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788269928.148123:0:40810:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788269928.149656:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269928.149735:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788269928.149741:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788269928.149746:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262525952:0@lo:38:kworker.0 00000100:00100000:1.0:1788269928.149764:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269928.149770:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 6 00000100:00080000:1.0:1788269928.149776:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788269928.149781:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788269928.149783:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788269928.149799:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262525824:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788269928.150850:0:40810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269928.151258:0:40810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:3.0:1788269928.151394:0:40810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 64 off8256 00000100:00100000:1.0:1788269928.151609:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262526208:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788269928.151712:0:40816:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788269928.151718:0:40816:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788269928.151739:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269928.151770:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262526208 00000100:00100000:0.0:1788269928.151778:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262526208 00000100:00100000:0.0:1788269928.151817:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788269928.151827:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262526208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788269928.151854:0:40080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446248448 avail 1300008960 00000100:00100000:0.0:1788269928.151925:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262526208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.151933:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269928.152092:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262526208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269928.152545:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262526336:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788269928.152568:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262526336 offset 0 length 520: 4 00000100:00080000:0.0:1788269928.152577:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269928.152597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788269928.152603:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269928.152609:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788269928.157407:0:40810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269928.157421:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788269928.157460:0:40810:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788269928.157492:0:40810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e0751c 00000100:00080000:3.0:1788269928.157503:0:40810:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269928.157508:0:40810:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c27b5e2800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269928.157538:0:40810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c248219880 x1875136262526464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269928.157559:0:40810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788269928.157613:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262526464:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788269928.157631:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.157636:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.157638:0:40810:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788269928.157642:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269928.157648:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.157650:0:40810:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788269928.157653:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788269928.157655:0:40810:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788269928.157658:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.157661:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.157662:0:40810:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788269928.157665:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269928.157668:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.157671:0:40810:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788269928.157675:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788269928.157701:0:40810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269928.157704:0:40810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269928.157706:0:40810:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788269928.157709:0:40810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 46 count 46 00000400:00000100:1.0:1788269928.157779:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262526464 offset 0 length 520: 4 00000100:00080000:0.0:1788269928.158021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269928.158026:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788269928.158030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269928.158032:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788269928.158539:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262526592 00000100:00100000:3.0:1788269928.158546:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262526592 00000100:00100000:3.0:1788269928.158603:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788269928.158614:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+15:40806:x1875136262526592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269928.158625:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269928.158637:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07523 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.158659:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 16 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.158670:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 16 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.158678:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676800, rc 0) 00000100:00100000:3.0:1788269928.158724:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+16:40806:x1875136262526592:12345-0@lo:101:mount.lustre.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.158730:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788269928.159248:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262526720:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788269928.159273:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.159291:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.159312:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262526720 00000100:00100000:1.0:1788269928.159318:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262526720 00000100:00100000:1.0:1788269928.159348:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269928.159356:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+16:40806:x1875136262526720:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788269928.159370:0:40068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788269928.159385:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788269928.159389:0:40068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:1.0:1788269928.159475:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+16:40806:x1875136262526720:12345-0@lo:256:mount.lustre.0 Request processed in 119us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.159483:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269928.159495:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262526720:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788269928.160005:0:40806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788269928.160026:0:40806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.160035:0:40806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.160072:0:40806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27b77a000 from 1 10000000:01000000:3.0:1788269928.160075:0:40806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269928.160099:0:40806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.160106:0:40806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.160114:0:40806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.160126:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262526848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269928.160152:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.160179:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.160649:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262526848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269928.160663:0:40806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.160672:0:40806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269928.167146:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 13 count 13 00000040:00080000:3.0:1788269928.167435:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269928.167622:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:3.0:1788269928.167648:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:3.0:1788269928.167664:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:3.0:1788269928.167678:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:3.0:1788269928.167690:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:3.0:1788269928.167702:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:3.0:1788269928.167715:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:3.0:1788269928.167727:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:3.0:1788269928.167740:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:3.0:1788269928.167768:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 224 off10112 00000040:00080000:3.0:1788269928.167783:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 128 off10240 00000040:00080000:3.0:1788269928.167799:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10464 00000040:00080000:3.0:1788269928.167804:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 12 count 13 00000100:00100000:3.0:1788269928.167873:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262526976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269928.167938:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.167992:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.168909:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262526976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269928.168942:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269928.168984:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.169148:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.169620:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269928.169949:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269928.170101:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269928.170138:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.170169:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.170449:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269928.170887:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1788269928.170913:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:3.0:1788269928.170929:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:3.0:1788269928.170943:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:3.0:1788269928.170957:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:3.0:1788269928.170971:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:3.0:1788269928.170996:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:3.0:1788269928.171015:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000040:00080000:3.0:1788269928.171029:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:3.0:1788269928.171079:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 224 off10112 00000040:00080000:3.0:1788269928.171098:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 128 off10240 00000100:00100000:3.0:1788269928.171134:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269928.171174:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.171218:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.171504:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269928.171548:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10464 00000040:00080000:3.0:1788269928.171556:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788269928.172503:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269928.172512:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.172515:0:40820:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788269928.172521:0:40820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27b77a000 00000020:00000080:1.0:1788269928.172524:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269928.172532:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269928.172534:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.172536:0:40820:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788269928.172538:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269928.172540:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.172541:0:40820:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788269928.172545:0:40820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27b77a000 00000020:00000080:1.0:1788269928.172547:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269928.172647:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269928.172651:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.172653:0:40820:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788269928.172655:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269928.172657:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.172659:0:40820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788269928.172663:0:40820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27b77a000 00000020:00000080:1.0:1788269928.172665:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269928.177052:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269928.177084:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.177087:0:40820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788269928.177092:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269928.177096:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.177098:0:40820:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788269928.177104:0:40820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27b77a000 00000020:00000080:1.0:1788269928.177107:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269928.177680:0:40820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269928.177686:0:40820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269928.177688:0:40820:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788269928.177700:0:40820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 13 count 13 00000020:01000000:3.0:1788269928.177789:0:40806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788269928.177826:0:40806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269928.177849:0:40806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.177862:0:40806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269928.177913:0:40806:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269928.177916:0:40806:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c27b77a000 10000000:01000000:3.0:1788269928.177919:0:40806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c27b77a000 10000000:01000000:3.0:1788269928.177923:0:40806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269928.177928:0:40806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c27b77a000 from 1 10000000:01000000:3.0:1788269928.177931:0:40806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269928.177966:0:40806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.177975:0:40806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.177986:0:40806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.178009:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269928.178108:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.178196:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142428e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.178251:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262527488 00000100:00100000:1.0:1788269928.178259:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262527488 00000100:00100000:1.0:1788269928.178344:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788269928.178356:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+17:40806:x1875136262527488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269928.178370:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269928.178383:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e07546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0753f expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.178405:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e07546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0753f expref: 18 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.178416:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e07546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0753f expref: 18 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.178428:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be000, rc 0) 00000100:00100000:1.0:1788269928.178473:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527488:12345-0@lo:101:mount.lustre.0 Request processed in 119us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.178480:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788269928.178544:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269928.178561:0:40806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269928.178571:0:40806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269928.179754:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 52 count 51 00000040:00080000:3.0:1788269928.179975:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269928.180149:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1788269928.180178:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 120 off8536 00000040:00080000:3.0:1788269928.180195:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 168 off8704 00000040:00080000:3.0:1788269928.180211:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8928 00000040:00080000:3.0:1788269928.180227:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9152 00000040:00080000:3.0:1788269928.180241:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 120 off9272 00000040:00080000:3.0:1788269928.180273:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 168 off9440 00000040:00080000:3.0:1788269928.180293:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9664 00000040:00080000:3.0:1788269928.180313:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 224 off9888 00000040:00080000:3.0:1788269928.180334:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 120 off10008 00000040:00080000:3.0:1788269928.180354:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10232 00000040:00080000:3.0:1788269928.180377:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 224 off10456 00000040:00080000:3.0:1788269928.180399:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 88 off10544 00000040:00080000:3.0:1788269928.180420:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].14, 128 off10672 00000040:00080000:3.0:1788269928.180439:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].15, 144 off10816 00000040:00080000:3.0:1788269928.180451:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].16, 160 off10976 00000040:00080000:3.0:1788269928.180462:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].17, 224 off11200 00000040:00080000:3.0:1788269928.180472:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].18, 224 off11424 00000040:00080000:3.0:1788269928.180480:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].19, 80 off11504 00000040:00080000:3.0:1788269928.180487:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].20, 224 off11728 00000040:00080000:3.0:1788269928.180494:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].21, 224 off11952 00000040:00080000:3.0:1788269928.180500:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].22, 88 off12040 00000040:00080000:3.0:1788269928.180527:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].23, 128 off12168 00000040:00080000:3.0:1788269928.180544:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].24, 144 off12312 00000040:00080000:3.0:1788269928.180556:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].25, 160 off12472 00000040:00080000:3.0:1788269928.180569:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].26, 224 off12696 00000040:00080000:3.0:1788269928.180648:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].27, 224 off12920 00000040:00080000:3.0:1788269928.180667:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].28, 80 off13000 00000040:00080000:3.0:1788269928.180750:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].29, 224 off13224 00000040:00080000:3.0:1788269928.180770:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].30, 224 off13448 00000040:00080000:3.0:1788269928.180785:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].31, 88 off13536 00000040:00080000:3.0:1788269928.180800:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].32, 128 off13664 00000040:00080000:3.0:1788269928.180816:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].33, 144 off13808 00000040:00080000:3.0:1788269928.180835:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].34, 128 off13936 00000040:00080000:3.0:1788269928.180853:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].35, 224 off14160 00000040:00080000:3.0:1788269928.180870:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].36, 224 off14384 00000040:00080000:3.0:1788269928.180886:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].37, 80 off14464 00000040:00080000:3.0:1788269928.180906:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].38, 224 off14688 00000040:00080000:3.0:1788269928.180936:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].39, 224 off14912 00000040:00080000:3.0:1788269928.180955:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].40, 88 off15000 00000040:00080000:3.0:1788269928.180972:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].41, 128 off15128 00000040:00080000:3.0:1788269928.180989:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].42, 144 off15272 00000040:00080000:3.0:1788269928.181009:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].43, 128 off15400 00000040:00080000:3.0:1788269928.181031:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].44, 224 off15624 00000040:00080000:3.0:1788269928.181078:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].45, 224 off15848 00000040:00080000:3.0:1788269928.181095:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].46, 80 off15928 00000040:00080000:3.0:1788269928.181108:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].47, 224 off16152 00000040:00080000:3.0:1788269928.181121:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].48, 232 off16384 00000040:00080000:3.0:1788269928.181227:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].49, 224 off16608 00000040:00080000:3.0:1788269928.181246:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].50, 120 off16728 00000040:00080000:3.0:1788269928.181262:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].51, 224 off16952 00000040:00080000:3.0:1788269928.181266:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 51 count 51 00000100:00100000:3.0:1788269928.181338:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269928.181396:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.181484:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1424280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.181535:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262527616 00000100:00100000:1.0:1788269928.181542:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262527616 00000100:00100000:1.0:1788269928.181625:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269928.181635:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269928.181861:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527616:12345-0@lo:501:mount.lustre.0 Request processed in 227us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.181869:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269928.181954:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269928.181996:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269928.182035:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.182168:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788269928.182200:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262527744 00000100:00100000:3.0:1788269928.182204:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262527744 00000100:00100000:3.0:1788269928.182238:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269928.182246:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269928.182859:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527744:12345-0@lo:503:mount.lustre.0 Request processed in 612us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.182867:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788269928.182882:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788269928.183450:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788269928.183518:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269928.183557:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.183598:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262527872 00000100:00100000:1.0:1788269928.183603:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262527872 00000100:00100000:1.0:1788269928.183630:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269928.183637:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269928.183711:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262527872:12345-0@lo:502:mount.lustre.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.183719:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269928.183760:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.183772:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262527872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269928.184369:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:1.0:1788269928.184397:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 120 off8536 00000040:00080000:1.0:1788269928.184415:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 168 off8704 00000040:00080000:1.0:1788269928.184431:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8928 00000040:00080000:1.0:1788269928.184444:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9152 00000040:00080000:1.0:1788269928.184456:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 120 off9272 00000040:00080000:1.0:1788269928.184467:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 168 off9440 00000040:00080000:1.0:1788269928.184479:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9664 00000040:00080000:1.0:1788269928.184491:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 224 off9888 00000040:00080000:1.0:1788269928.184502:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 120 off10008 00000040:00080000:1.0:1788269928.184513:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10232 00000040:00080000:1.0:1788269928.184524:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 224 off10456 00000040:00080000:1.0:1788269928.184537:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 88 off10544 00000040:00080000:1.0:1788269928.184551:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].14, 128 off10672 00000040:00080000:1.0:1788269928.184564:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].15, 144 off10816 00000040:00080000:1.0:1788269928.184576:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].16, 160 off10976 00000040:00080000:1.0:1788269928.184619:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].17, 224 off11200 00000040:00080000:1.0:1788269928.184635:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].18, 224 off11424 00000040:00080000:1.0:1788269928.184647:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].19, 80 off11504 00000040:00080000:1.0:1788269928.184661:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].20, 224 off11728 00000040:00080000:1.0:1788269928.184672:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].21, 224 off11952 00000040:00080000:1.0:1788269928.184685:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].22, 88 off12040 00000040:00080000:1.0:1788269928.184697:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].23, 128 off12168 00000040:00080000:1.0:1788269928.184710:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].24, 144 off12312 00000040:00080000:1.0:1788269928.184722:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].25, 160 off12472 00000040:00080000:1.0:1788269928.184733:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].26, 224 off12696 00000040:00080000:1.0:1788269928.184745:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].27, 224 off12920 00000040:00080000:1.0:1788269928.184760:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].28, 80 off13000 00000040:00080000:1.0:1788269928.184771:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].29, 224 off13224 00000040:00080000:1.0:1788269928.184783:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].30, 224 off13448 00000040:00080000:1.0:1788269928.184796:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].31, 88 off13536 00000040:00080000:1.0:1788269928.184880:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].32, 128 off13664 00000040:00080000:1.0:1788269928.184910:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].33, 144 off13808 00000040:00080000:1.0:1788269928.184925:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].34, 128 off13936 00000040:00080000:1.0:1788269928.184938:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].35, 224 off14160 00000040:00080000:1.0:1788269928.184951:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].36, 224 off14384 00000040:00080000:1.0:1788269928.184964:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].37, 80 off14464 00000040:00080000:1.0:1788269928.184976:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].38, 224 off14688 00000040:00080000:1.0:1788269928.185130:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].39, 224 off14912 00000040:00080000:1.0:1788269928.185150:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].40, 88 off15000 00000040:00080000:1.0:1788269928.185164:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].41, 128 off15128 00000040:00080000:1.0:1788269928.185251:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].42, 144 off15272 00000040:00080000:1.0:1788269928.185268:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].43, 128 off15400 00000040:00080000:1.0:1788269928.185281:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].44, 224 off15624 00000040:00080000:1.0:1788269928.185295:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].45, 224 off15848 00000040:00080000:1.0:1788269928.185309:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].46, 80 off15928 00000040:00080000:1.0:1788269928.185322:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].47, 224 off16152 00000040:00080000:1.0:1788269928.185337:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].48, 232 off16384 00000100:00100000:1.0:1788269928.185388:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262528000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269928.185437:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.185472:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269928.185482:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528000 00000100:00100000:0.0:1788269928.185489:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528000 00000100:00100000:0.0:1788269928.185537:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788269928.185547:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262528000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269928.185682:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262528000:12345-0@lo:502:mount.lustre.0 Request processed in 136us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.185690:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269928.185708:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262528000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269928.186331:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].49, 224 off16608 00000040:00080000:1.0:1788269928.186355:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].50, 120 off16728 00000100:00100000:1.0:1788269928.186380:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262528128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269928.186413:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.186443:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269928.186456:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528128 00000100:00100000:0.0:1788269928.186463:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528128 00000100:00100000:0.0:1788269928.186493:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788269928.186502:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262528128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269928.186650:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262528128:12345-0@lo:502:mount.lustre.0 Request processed in 149us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.186657:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269928.186675:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262528128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269928.186715:0:40806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].51, 224 off16952 00000040:00080000:1.0:1788269928.186722:0:40806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000000:1.0:1788269928.194563:0:40806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:3.0:1788269928.194633:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262528256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269928.194715:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269928.194784:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528256 00000100:00100000:3.0:1788269928.194791:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528256 00000100:00100000:3.0:1788269928.194823:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269928.194831:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1875136262528256:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788269928.194852:0:40076:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:3.0:1788269928.194886:0:40076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc5f5d7a016e0755b 00000004:00100000:3.0:1788269928.194900:0:40076:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788269928.194928:0:40076:0:(import.c:65:import_set_state_nolock()) ffff98c27f702000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269928.194985:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875136262528256:12345-0@lo:38:llog_process_th.0 Request processed in 153us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.194993:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1788269928.195313:0:40806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788269928.195365:0:40806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.195377:0:40806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788269928.195421:0:40806:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788269928.195423:0:40806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788269928.195425:0:40806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269928.195427:0:40806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269928.195428:0:40806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269928.195430:0:40806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269928.195432:0:40806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269928.195434:0:40806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269928.195436:0:40806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788269928.195439:0:40806:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788269928.195441:0:40806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269928.195443:0:40806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788269928.195445:0:40806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269928.195446:0:40806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269928.195448:0:40806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269928.195449:0:40806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269928.195450:0:40806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269928.195451:0:40806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269928.195453:0:40806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788269928.195468:0:40806:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788269928.195479:0:40806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262528384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788269928.195519:0:40806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.195548:0:40806:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269928.195904:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528384 00000100:00100000:0.0:1788269928.195909:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528384 00000100:00100000:0.0:1788269928.195947:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788269928.195967:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40806:x1875136262528384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788269928.195986:0:40069:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788269928.195996:0:40069:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788269928.201248:0:40055:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788269928.201437:0:40069:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788269928.201450:0:40069:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788269928.201524:0:40090:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788269928.201529:0:40090:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788269928.201550:0:40090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.201569:0:40090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 18 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.201578:0:40090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 18 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.201598:0:40090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.201644:0:40090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 18 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.201661:0:40090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 18 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269928.201687:0:40090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262528512:0@lo:104: 00000100:00100000:1.0:1788269928.201745:0:40090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269928.201803:0:40090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 18 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.201812:0:40090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 18 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269928.201822:0:40090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262528640:0@lo:104: 00000100:00100000:1.0:1788269928.201847:0:40090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.201869:0:40090:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269928.201893:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528512 00000100:00100000:1.0:1788269928.201900:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528512 00000100:00100000:1.0:1788269928.201935:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528640 00000100:00100000:1.0:1788269928.201938:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528640 00000100:00100000:1.0:1788269928.201952:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269928.201960:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+4:40090:x1875136262528512:12345-0@lo:104: 00010000:00010000:1.0:1788269928.201972:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202024:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269928.202031:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+4:40090:x1875136262528512:12345-0@lo:104: Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.202056:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269928.202071:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269928.202077:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262528640:12345-0@lo:104: 00010000:00010000:1.0:1788269928.202084:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202114:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788269928.202120:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262528640:12345-0@lo:104: Request processed in 43us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.202126:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788269928.202139:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269928.202144:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202153:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269928.202157:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202166:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269928.202173:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269928.202179:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269928.202202:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202208:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269928.202226:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202234:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418e400/0xc5f5d7a016e07523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0752a expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202246:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269928.202249:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202256:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269928.202259:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202265:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269928.202293:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269928.202300:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269928.202314:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202324:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269928.202332:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202341:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676c00/0xc5f5d7a016e0745f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07466 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202354:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269928.202357:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269928.202360:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269928.202368:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269928.202380:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262528768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269928.202405:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.202424:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269928.202430:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262528896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269928.202447:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269928.202477:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528768 00000100:00100000:1.0:1788269928.202481:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528768 00010000:00010000:1.0:1788269928.202495:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 19 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269928.202512:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262528896 00000100:00100000:1.0:1788269928.202515:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262528896 00010000:00010000:1.0:1788269928.202524:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 20 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269928.202538:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269928.202544:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+20:3609:x1875136262528768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269928.202554:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269928.202560:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 20 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202570:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 20 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202595:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0752a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07523 expref: 20 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202607:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269928.202651:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+19:3609:x1875136262528768:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.202659:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269928.202674:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269928.202681:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+18:3609:x1875136262528896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269928.202688:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269928.202693:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 18 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202702:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 18 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202712:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b56400/0xc5f5d7a016e07466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0745f expref: 18 pid: 40070 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202723:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202731:0:40061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788269928.202747:0:40061:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001218627s 00010000:00010000:1.0:1788269928.202752:0:40061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202761:0:40061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202769:0:40061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202775:0:40061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202782:0:40061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269928.202786:0:40061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202794:0:40061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202814:0:40061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269928.202824:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269928.202856:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+17:3609:x1875136262528896:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269928.202865:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269928.202899:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262528896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269928.203533:0:40090:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269928.203544:0:40090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269928.203551:0:40090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bf000/0xc5f5d7a016e07562 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269928.205537:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+16:40806:x1875136262528384:12345-0@lo:253:mount.lustre.0 Request processed in 9577us (10011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269928.205550:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788269928.205652:0:40806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:40806:1875136262528384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788269928.205668:0:40806:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788269928.205764:0:40806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788269928.205767:0:40806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788269928.205769:0:40806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269928.205771:0:40806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269928.205772:0:40806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269928.205774:0:40806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269928.205776:0:40806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269928.205778:0:40806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269928.205779:0:40806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788269928.205794:0:40806:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1788269928.211686:0:40831:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 17179869188 00000020:00080000:1.0:1788269928.211691:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869188 00000040:01000000:1.0:1788269928.212192:0:40832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788269928.212712:0:40832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788269928.213479:0:40806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788269928.213503:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269928.214156:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529024 00000100:00100000:0.0:1788269928.214164:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529024 00000100:00100000:0.0:1788269928.214209:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269928.214217:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40833:x1875136262529024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788269928.214300:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40833:x1875136262529024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.214308:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269928.214612:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529152 00000100:00100000:0.0:1788269928.214617:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529152 00000100:00100000:0.0:1788269928.214646:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788269928.214654:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:40833:x1875136262529152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788269928.214768:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:40833:x1875136262529152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 114us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.214774:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788269928.215622:0:40085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529280 00000100:00100000:0.0:1788269928.215628:0:40085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529280 00000100:00100000:0.0:1788269928.215661:0:40085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269928.215669:0:40085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:40833:x1875136262529280:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788269928.215707:0:40085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:40833:x1875136262529280:12345-0@lo:900:lod0001_rec0000.0 Request processed in 40us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.215714:0:40085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269928.216610:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529408 00000100:00100000:0.0:1788269928.216616:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529408 00000100:00100000:0.0:1788269928.216648:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269928.216655:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40833:x1875136262529408:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788269928.216708:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40833:x1875136262529408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 53us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269928.216715:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00000080:3.0:1788269928.217218:0:40806:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788269928.217230:0:40806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788269928.217312:0:40806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269928.220865:0:40832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788269928.220924:0:40832:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788269928.221411:0:40806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788269928.222158:0:40806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788269928.222192:0:40806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788269928.222736:0:40806:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788269928.223194:0:40806:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x33:0x0] (8/32) registered 00000001:00000004:3.0:1788269928.224223:0:40806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803776 00000001:00080000:3.0:1788269928.232441:0:40806:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788269928.232486:0:40806:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffad658177f988 00100000:10000000:3.0:1788269928.232494:0:40806:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788269928.233147:0:40806:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788269928.233176:0:40806:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788269928.233205:0:40806:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788269928.233221:0:40806:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788269928.234209:0:40806:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788269928.234427:0:40806:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788269928.326030:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 00010000:00010000:1.0:1788269929.157080:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269929.228809:0:40828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269929.228817:0:40828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269929.230238:0:40828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 3 count 3 00000040:00080000:0.0:1788269929.230248:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788269929.349156:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 10000000:01000000:3.0:1788269929.604140:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269929.604147:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27b77a000 from 24 10000000:01000000:3.0:1788269929.604153:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269929.604204:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.604217:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.604227:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269929.604253:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269929.604327:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269929.604368:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269929.604992:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529536 00000100:00100000:1.0:1788269929.605001:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529536 00000100:00100000:1.0:1788269929.605071:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788269929.605082:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+16:40072:x1875136262529536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269929.605096:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269929.605111:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07569 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269929.605138:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 17 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269929.605149:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 17 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269929.605158:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bec00, rc 0) 00000100:00100000:1.0:1788269929.605214:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262529536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269929.605221:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788269929.605654:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269929.605672:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.605680:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269929.605732:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269929.605765:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269929.605787:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269929.606306:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529664 00000100:00100000:1.0:1788269929.606312:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529664 00000100:00100000:1.0:1788269929.606347:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788269929.606354:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262529664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788269929.606369:0:40069:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788269929.606385:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788269929.606388:0:40069:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 24 00000100:00100000:1.0:1788269929.606469:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262529664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269929.606476:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788269929.606617:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788269929.606659:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788269929.606667:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.606675:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269929.606685:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269929.606687:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c145155800 from 24 10000000:01000000:3.0:1788269929.606690:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269929.606710:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.606717:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.606727:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269929.606741:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269929.606766:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269929.606796:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269929.607072:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529792 00000100:00100000:1.0:1788269929.607076:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529792 00000100:00100000:1.0:1788269929.607115:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788269929.607121:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262529792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269929.607129:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269929.607141:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07577 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269929.607163:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 18 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269929.607172:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 18 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269929.607179:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfe00, rc 0) 00000100:00100000:1.0:1788269929.607223:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+18:40072:x1875136262529792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269929.607229:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788269929.607613:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269929.607626:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269929.607635:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269929.607674:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262529920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269929.607702:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269929.607730:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269929.608073:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262529920 00000100:00100000:1.0:1788269929.608078:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262529920 00000100:00100000:1.0:1788269929.608124:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269929.608131:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40072:x1875136262529920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788269929.608144:0:40069:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788269929.608156:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788269929.608160:0:40069:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 24 00000100:00100000:1.0:1788269929.609170:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+18:40072:x1875136262529920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1036us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269929.609179:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:1.0:1788269930.183206:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269930.244202:0:40828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269930.244210:0:40828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269930.244395:0:40828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 2 count 1 00000040:00080000:0.0:1788269930.244436:0:40828:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x18:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269930.244591:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1788269930.372114:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 0 seconds 00000001:02000400:0.0:1788269930.647160:0:41075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788269931.205996:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788269931.217823:0:41127:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788269931.218141:0:41127:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788269931.268211:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269921/real 1788269921] req@ffff98c1410e0000 x1875136262521472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269931.268243:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c1410e0000 x1875136262521472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269931.268253:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269921/real 1788269921] req@ffff98c27f293800 x1875136262521344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269931.268263:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27f293800 x1875136262521344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269931.268281:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c247f7c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269931.268308:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788269931.268312:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262521472:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788269931.268318:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269931.268323:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788269931.268325:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262521344:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788269931.268823:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262530176:0@lo:38:kworker.0 00000100:00100000:3.0:1788269931.268863:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269931.269643:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262530304:0@lo:8:kworker.0 00000400:00000100:3.0:1788269931.269669:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262530304 offset 0 length 520: 4 00000100:00100000:3.0:1788269931.269687:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262530432:0@lo:8:kworker.0 00000400:00000100:3.0:1788269931.269705:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262530432 offset 0 length 520: 4 00000100:00100000:0.0:1788269931.269832:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262530176 00000100:00100000:0.0:1788269931.269836:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262530176 00000100:00100000:0.0:1788269931.269867:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269931.269872:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1875136262530176:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788269931.269895:0:40080:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:0.0:1788269931.269933:0:40080:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e07585 00000004:00100000:0.0:1788269931.269947:0:40080:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788269931.269952:0:40080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803776 00000100:00100000:1.0:1788269931.271631:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269931.271693:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262530688 00000100:00100000:1.0:1788269931.271699:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262530688 00000100:00100000:1.0:1788269931.271739:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269931.271748:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262530688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269931.271829:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262530688:12345-0@lo:400:kworker.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269931.271836:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269931.272063:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262530688:0@lo:400:kworker.0 00000100:00080000:0.0:1788269931.277327:0:40080:0:(import.c:65:import_set_state_nolock()) ffff98c27b7a8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269931.277576:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1875136262530176:12345-0@lo:38:kworker.0 Request processed in 7700us (8712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.277587:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788269931.277944:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1788269931.277954:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788269931.277960:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788269931.277964:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788269931.277988:0:3606:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b4f16423): req@ffff98c248218a80 x1875136262523904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269931.278009:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262530176:0@lo:38:kworker.0 00000100:00100000:0.0:1788269931.278104:0:40115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269931.278127:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269931.278157:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262523904 00000100:00100000:0.0:1788269931.278163:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262523904 00000100:00100000:0.0:1788269931.278193:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262530944 00000100:00100000:0.0:1788269931.278197:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262530944 00000100:00100000:0.0:1788269931.278215:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269931.278226:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:40115:x1875136262523904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.278299:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:40115:x1875136262523904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.278307:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269931.278323:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269931.278330:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262530944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788269931.278349:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446367232 avail 1300127744 00000100:00100000:0.0:1788269931.278383:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262530944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.278391:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269931.278426:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262530944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269931.278727:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262531072 00000100:00100000:0.0:1788269931.278731:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262531072 00000100:00100000:0.0:1788269931.278763:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269931.278771:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.278873:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.278893:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269931.278916:0:40115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:40115:1875136262531072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.278987:0:40115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:40115:1875136262531200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.279011:0:40115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269931.279023:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269931.279033:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262531200 00000100:00100000:0.0:1788269931.279057:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262531200 00000100:00100000:0.0:1788269931.279075:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269931.279080:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531200:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.279826:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 743us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.279835:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269931.280920:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262531328 00000100:00100000:0.0:1788269931.280926:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262531328 00000100:00100000:0.0:1788269931.280966:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269931.280974:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.288090:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 7110us (7266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.288101:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269931.288565:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262531456 00000100:00100000:0.0:1788269931.288571:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262531456 00000100:00100000:0.0:1788269931.288609:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269931.288618:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.289074:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 456us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.289082:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269931.289790:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262531584 00000100:00100000:1.0:1788269931.289797:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262531584 00000100:00100000:1.0:1788269931.289834:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269931.289843:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531584:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788269931.289923:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269931.289930:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269931.289959:0:40115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:40115:1875136262531584:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788269931.290023:0:40115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:40115:1875136262531712:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788269931.290113:0:40115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269931.290129:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251351240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269931.297300:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531712:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 6287us (7177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269931.297318:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788269931.297719:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262531840 00000100:00100000:0.0:1788269931.297726:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262531840 00000100:00100000:0.0:1788269931.297775:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269931.297786:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.297858:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262531840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.297866:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1788269931.298092:0:40096:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c275b5e3c0 version 1 rpc_version 1 00000020:00100000:3.0:1788269931.298109:0:40096:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788269931.298122:0:40096:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c248218700 x1875136262532096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269931.298136:0:40096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:40096:1875136262532096:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1788269931.298161:0:40096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269931.298225:0:40096:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788269931.298301:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262532096 00000100:00100000:0.0:1788269931.298306:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262532096 00000100:00100000:0.0:1788269931.298365:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788269931.298372:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:40096:x1875136262532096:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:0.0:1788269931.302300:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803777 is committed 00000001:00100000:0.0:1788269931.302313:0:40807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788269931.302493:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:40096:x1875136262532096:12345-0@lo:1000:osp_up1-0.0 Request processed in 4117us (4326us total) trans 25769803777 rc 0/0 00000100:00100000:1.0:1788269931.302509:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:0.0:1788269931.302595:0:40096:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803777 committed transno 25769803777 00000100:00100000:0.0:1788269931.302601:0:40096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:0.0:1788269931.302618:0:40096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:40096:1875136262532096:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1788269931.302644:0:40096:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c275b5e3c0 version 2 rpc_version 2 00000020:00100000:0.0:1788269931.302667:0:40096:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788269931.302674:0:40096:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c1410e1f80 x1875136262532352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269931.302696:0:40096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:40096:1875136262532352:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788269931.302736:0:40096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269931.302967:0:40096:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269931.303234:0:40096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:40096:1875136262532352:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788269931.303297:0:40115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:40115:1875136262532480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788269931.303355:0:40115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269931.303410:0:40115:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251351780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269931.303477:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262532480 00000100:00100000:0.0:1788269931.303482:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262532480 00000100:00100000:0.0:1788269931.303557:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788269931.303565:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262532480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.303687:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262532480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.303694:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788269931.303888:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262532608 00000100:00100000:0.0:1788269931.303892:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262532608 00000100:00100000:0.0:1788269931.303945:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269931.303952:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262532608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788269931.304005:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40115:x1875136262532608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269931.304012:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1788269931.304296:0:40096:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c275b5e3c0 version 3 rpc_version 3 00000020:00100000:0.0:1788269931.304310:0:40096:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788269931.304316:0:40096:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c1410e2a00 x1875136262532864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269931.304329:0:40096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:40096:1875136262532864:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1788269931.304351:0:40096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269931.304402:0:40096:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269931.304432:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262532864 00000100:00100000:1.0:1788269931.304436:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262532864 00000100:00100000:1.0:1788269931.304493:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269931.304500:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40096:x1875136262532864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1788269931.304678:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:40096:x1875136262532864:12345-0@lo:1000:osp_up1-0.0 Request processed in 178us (325us total) trans 25769803779 rc 0/0 00000100:00100000:1.0:1788269931.304685:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000004:1.0:1788269931.740438:0:41178:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788269931.740648:0:41178:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788269932.235625:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788269932.314725:0:41226:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1c230210 20000000:00000080:0.0:1788269932.314743:0:41226:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c275e2a000 uarg=0000000000000000 20000000:01000000:0.0:1788269932.314780:0:41226:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788269932.314787:0:41226:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788269932.314791:0:41226:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 20000000:00000400:0.0:1788269932.315604:0:41226:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788269932.323831:0:41226:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788269932.323871:0:41226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.323890:0:41226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 17 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.323898:0:41226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 17 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.323906:0:41226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.323947:0:41226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 17 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.323964:0:41226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 17 pid: 40070 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269932.323979:0:41226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41226:1875136262533248:0@lo:104: 00000100:00100000:0.0:1788269932.324569:0:41226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269932.324622:0:41226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 17 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.324632:0:41226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 17 pid: 40069 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269932.324640:0:41226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41226:1875136262533376:0@lo:104: 00000100:00100000:0.0:1788269932.324664:0:41226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269932.324725:0:41226:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269932.324815:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262533248 00000100:00100000:3.0:1788269932.324822:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262533248 00000100:00100000:3.0:1788269932.324868:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262533376 00000100:00100000:3.0:1788269932.324871:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262533376 00000100:00100000:3.0:1788269932.324886:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269932.324894:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+4:41226:x1875136262533248:12345-0@lo:104: 00010000:00010000:3.0:1788269932.324906:0:40058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325005:0:40058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269932.325012:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+4:41226:x1875136262533248:12345-0@lo:104: Request processed in 119us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269932.325020:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269932.325060:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269932.325068:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+3:41226:x1875136262533376:12345-0@lo:104: 00010000:00010000:3.0:1788269932.325075:0:40058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325106:0:40058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788269932.325111:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+3:41226:x1875136262533376:12345-0@lo:104: Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269932.325116:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788269932.325132:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269932.325137:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325144:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269932.325148:0:40063:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325156:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269932.325168:0:40063:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269932.325173:0:40063:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269932.325199:0:40063:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325205:0:40063:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269932.325223:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325229:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e07531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07538 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325243:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269932.325246:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325251:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269932.325254:0:40063:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325260:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269932.325266:0:40063:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269932.325271:0:40063:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269932.325282:0:40063:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325288:0:40063:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269932.325303:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325309:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418f800/0xc5f5d7a016e0742e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07435 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325321:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269932.325323:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269932.325324:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269932.325342:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262533504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269932.325368:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269932.325401:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262533632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269932.325421:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269932.325453:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262533504 00000100:00100000:3.0:1788269932.325457:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262533504 00010000:00010000:3.0:1788269932.325472:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 18 pid: 40070 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269932.325491:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262533632 00000100:00100000:3.0:1788269932.325494:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262533632 00010000:00010000:3.0:1788269932.325504:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 19 pid: 40069 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269932.325526:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269932.325532:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+19:3608:x1875136262533504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269932.325541:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269932.325546:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 19 pid: 40070 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325556:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 19 pid: 40070 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325568:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269932.325592:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+19:3608:x1875136262533504:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269932.325598:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269932.325608:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269932.325614:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+18:3609:x1875136262533632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269932.325621:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269932.325625:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 18 pid: 40069 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325633:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 18 pid: 40069 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325643:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325650:0:40061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325660:0:40061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325666:0:40061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325677:0:40061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325683:0:40061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325688:0:40061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b57e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269932.325692:0:40061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325698:0:40061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325705:0:40061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269932.325712:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269932.325737:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+18:3609:x1875136262533632:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269932.325742:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269932.325774:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262533632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269932.325793:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262533504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269932.326078:0:41226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418e200/0xc5f5d7a016e07538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07531 expref: 17 pid: 40070 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269932.326089:0:41226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41226:1875136262533248:0@lo:104: 00010000:00010000:0.0:1788269932.326098:0:41226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e07435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0742e expref: 16 pid: 40069 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269932.326105:0:41226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41226:1875136262533376:0@lo:104: 00010000:00010000:0.0:1788269932.326117:0:41226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.326125:0:41226:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.326131:0:41226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269932.326141:0:41226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e0758c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.252273:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269933.252371:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262533760 00000100:00100000:1.0:1788269933.252380:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262533760 00000100:00100000:1.0:1788269933.252478:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269933.252488:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262533760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788269933.252549:0:40080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446248448 avail 1300008960 00000100:00100000:1.0:1788269933.252608:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262533760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269933.252614:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000040:00080000:3.0:1788269933.444708:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788269933.829891:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262533888 00000100:00100000:3.0:1788269933.829900:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262533888 00000100:00100000:3.0:1788269933.830004:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269933.830014:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+16:40072:x1875136262533888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269933.830028:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269933.830066:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07593 expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269933.830088:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 17 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269933.830098:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 17 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269933.830107:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676e00, rc 0) 00000100:00100000:3.0:1788269933.830155:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262533888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269933.830161:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788269933.830616:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262533888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269933.830628:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.830634:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269933.830682:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.830702:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269933.830724:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269933.830886:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.830912:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.830957:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269933.830977:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269933.830991:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262534144 00000100:00100000:3.0:1788269933.830995:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262534144 00000100:00100000:3.0:1788269933.831023:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269933.831030:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262534144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269933.831125:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+17:40072:x1875136262534144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269933.831133:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788269933.831133:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788269933.831710:0:41346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788269933.831766:0:40072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788269933.831784:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269933.831791:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.831800:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269933.831810:0:40072:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788269933.831812:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c145155800 from 13 10000000:01000000:0.0:1788269933.831815:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269933.831835:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.831842:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.831851:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269933.831865:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.831893:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269933.831964:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269933.832333:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269933.832341:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.832347:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269933.832374:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.832391:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269933.832412:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269933.832667:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.832690:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269933.832729:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269933.833298:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269933.833628:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262534528:0@lo:503:ll_cfg_requeue.0 00000020:01000000:0.0:1788269933.834294:0:40072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788269933.834311:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269933.834319:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269933.834329:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269935.300159:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269936.325227:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262534656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788269936.325290:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269936.325325:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262534656 00000100:00100000:0.0:1788269936.325332:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262534656 00000100:00100000:0.0:1788269936.325480:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269936.325490:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3607:x1875136262534656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788269936.325523:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446404096 avail 1300164608 00000100:00100000:0.0:1788269936.325569:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3607:x1875136262534656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.325576:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788269936.327347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.327352:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.327356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.327359:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.327389:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.327392:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.327395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.327397:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269936.328228:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262535040 00000100:00100000:1.0:1788269936.328232:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262535040 00000100:00100000:1.0:1788269936.328260:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269936.328267:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262535040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269936.328304:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262535040:12345-0@lo:400:kworker.0 Request processed in 38us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269936.328311:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788269936.328333:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c248219f80 x1875136262534912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269936.328343:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262534912:0@lo:400:kworker.0 00000100:00100000:1.0:1788269936.328351:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262535040:0@lo:400:kworker.0 00100000:10000000:0.0:1788269936.394778:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788269936.395979:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788269936.396365:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788269936.396541:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788269936.396684:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788269936.396860:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788269936.397013:0:41573:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1788269936.398747:0:41573:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788269936.398970:0:41573:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788269936.398981:0:41573:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788269936.398989:0:41573:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f5d7a016e075b6 00000020:01000004:0.0:1788269936.398995:0:41573:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788269936.399011:0:41573:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788269936.399014:0:41573:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788269936.399018:0:41573:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788269936.399021:0:41573:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788269936.399029:0:41573:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98c2759d0000) 00000020:00000080:0.0:1788269936.399090:0:41573:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788269936.400549:0:41573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269936.400712:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788269936.400719:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788269936.401894:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788269936.401902:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788269936.406343:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788269936.406351:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788269936.419098:0:41573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269936.419318:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788269936.419324:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788269936.422201:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788269936.422210:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788269936.428332:0:41573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269936.428548:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788269936.428555:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788269936.432892:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788269936.432908:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788269936.467513:0:41573:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788269936.467523:0:41573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788269936.467832:0:41573:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788269936.467856:0:41573:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788269936.467862:0:41573:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788269936.475858:0:41573:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788269936.475909:0:41573:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788269936.475913:0:41573:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788269936.475915:0:41573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269936.475916:0:41573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269936.475917:0:41573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269936.475919:0:41573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269936.475920:0:41573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269936.475922:0:41573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269936.475923:0:41573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269936.475924:0:41573:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269936.475928:0:41573:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788269936.475930:0:41573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269936.475931:0:41573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269936.475932:0:41573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269936.475934:0:41573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269936.475935:0:41573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269936.475936:0:41573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269936.475937:0:41573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269936.475938:0:41573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269936.475939:0:41573:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269936.475965:0:41573:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788269936.475986:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788269936.476177:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.476225:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269936.476877:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788269936.476886:0:41573:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788269936.476888:0:41573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788269936.476889:0:41573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269936.476891:0:41573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269936.476891:0:41573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269936.476892:0:41573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269936.476894:0:41573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269936.476895:0:41573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269936.476896:0:41573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269936.476897:0:41573:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788269936.476915:0:41573:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c143776800 from lustre-OST0000 10000000:01000000:1.0:1788269936.476937:0:41573:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788269936.476940:0:41573:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788269936.476947:0:41573:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c276b6cd28 local copy 00010000:00010000:1.0:1788269936.476956:0:41573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269936.477026:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269936.477084:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.477111:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269936.477597:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535424:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788269936.477611:0:41573:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788269936.477628:0:41573:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788269936.477634:0:41573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269936.477646:0:41573:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269936.477667:0:41573:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c143776800 10000000:01000000:1.0:1788269936.477671:0:41573:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788269936.477676:0:41573:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788269936.477679:0:41573:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269936.477683:0:41573:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788269936.477686:0:41573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788269936.477706:0:41573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269936.477713:0:41573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269936.477722:0:41573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269936.477734:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269936.477758:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.477779:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269936.478167:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269936.478179:0:41573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269936.478188:0:41573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269936.479126:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:1.0:1788269936.479563:0:41573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269936.482789:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1788269936.482830:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:1.0:1788269936.482838:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:1.0:1788269936.482845:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:1.0:1788269936.482851:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:1.0:1788269936.482858:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:1.0:1788269936.482865:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:1.0:1788269936.482871:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:1.0:1788269936.482878:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:1.0:1788269936.482885:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:1.0:1788269936.482891:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:1.0:1788269936.482910:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:1.0:1788269936.482925:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:1.0:1788269936.482928:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:1.0:1788269936.483006:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269936.483089:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.483128:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269936.483426:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269936.483466:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269936.483501:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.483519:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269936.484550:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788269936.484931:0:41573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788269936.484997:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269936.485035:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.485081:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269936.485088:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262535936 00000100:00100000:0.0:1788269936.485094:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262535936 00000100:00100000:0.0:1788269936.485167:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269936.485176:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+19:41573:x1875136262535936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269936.485566:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+19:41573:x1875136262535936:12345-0@lo:502:mount.lustre.0 Request processed in 390us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.485573:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269936.485643:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262535936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269936.485925:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1788269936.485944:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:1.0:1788269936.485951:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:1.0:1788269936.485959:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:1.0:1788269936.485966:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:1.0:1788269936.485972:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:1.0:1788269936.485979:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:1.0:1788269936.485986:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:1.0:1788269936.485993:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:1.0:1788269936.485999:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:1.0:1788269936.486006:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:1.0:1788269936.486013:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:1.0:1788269936.486065:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269936.486101:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269936.486127:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ce2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269936.486787:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269936.486824:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:1.0:1788269936.486831:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788269936.487315:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788269936.487321:0:41590:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788269936.487326:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.487327:0:41590:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788269936.487331:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788269936.487343:0:41590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98c1438a8000) 00000020:00000080:1.0:1788269936.487361:0:41590:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788269936.487365:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788269936.487410:0:41590:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c143776800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788269936.487415:0:41590:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788269936.487419:0:41590:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f5d7a016e075d9 00010000:00010000:1.0:1788269936.491912:0:41590:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788269936.494477:0:41590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836482 00080000:10000000:1.0:1788269936.500640:0:41590:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/32) registered 00000020:00000080:1.0:1788269936.506927:0:41590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788269936.506939:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269936.506946:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.506948:0:41590:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788269936.506952:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788269936.506955:0:41590:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788269936.506957:0:41590:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269936.506958:0:41590:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269936.506960:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788269936.506962:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.506964:0:41590:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788269936.506966:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269936.506969:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.506970:0:41590:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788269936.506973:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788269936.506975:0:41590:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788269936.506978:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269936.506980:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.506981:0:41590:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788269936.506983:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269936.506985:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.506987:0:41590:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788269936.506990:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788269936.507019:0:41590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269936.507022:0:41590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269936.507024:0:41590:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788269936.507027:0:41590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000100:00100000:0.0:1788269936.508314:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262536192 00000100:00100000:0.0:1788269936.508321:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262536192 00000100:00100000:0.0:1788269936.508365:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269936.508375:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+19:41573:x1875136262536192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269936.508388:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269936.508400:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e075e0 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.508421:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.508431:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.508457:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c275b57e00, rc 0) 00000100:00100000:0.0:1788269936.508494:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536192:12345-0@lo:101:mount.lustre.0 Request processed in 121us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.508501:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269936.516147:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262536320 00000100:00100000:0.0:1788269936.516156:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262536320 00000100:00100000:0.0:1788269936.516208:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788269936.516218:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269936.516334:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536320:12345-0@lo:501:mount.lustre.0 Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.516342:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788269936.516358:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269936.516392:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269936.516447:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.516479:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269936.516527:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262536448 00000100:00100000:0.0:1788269936.516531:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262536448 00000100:00100000:0.0:1788269936.516552:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788269936.516560:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269936.516639:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536448:12345-0@lo:503:mount.lustre.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.516648:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269936.516721:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269936.517105:0:41573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269936.517182:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269936.517217:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.517245:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269936.517749:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269936.517933:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1788269936.517958:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:3.0:1788269936.517972:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:3.0:1788269936.517984:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:3.0:1788269936.517997:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:3.0:1788269936.518009:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:3.0:1788269936.518024:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:3.0:1788269936.518090:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000040:00080000:3.0:1788269936.518112:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:3.0:1788269936.518125:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 224 off10112 00000040:00080000:3.0:1788269936.518139:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 128 off10240 00000100:00100000:3.0:1788269936.518163:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269936.518203:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.518229:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269936.518350:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262536704 00000100:00100000:0.0:1788269936.518356:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262536704 00000100:00100000:0.0:1788269936.518397:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269936.518406:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269936.518499:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+20:41573:x1875136262536704:12345-0@lo:502:mount.lustre.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.518506:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788269936.518577:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269936.518614:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10464 00000040:00080000:3.0:1788269936.518622:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788269936.519365:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269936.519373:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.519375:0:41594:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788269936.519384:0:41594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c143776800 00000020:00000080:0.0:1788269936.519386:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269936.519394:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269936.519396:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.519397:0:41594:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788269936.519400:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269936.519402:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.519403:0:41594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788269936.519406:0:41594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c143776800 00000020:00000080:0.0:1788269936.519408:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269936.519505:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269936.519509:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.519510:0:41594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788269936.519513:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269936.519515:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.519517:0:41594:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788269936.519520:0:41594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c143776800 00000020:00000080:0.0:1788269936.519522:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269936.521338:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269936.521347:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.521349:0:41594:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788269936.521355:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269936.521359:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.521360:0:41594:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788269936.521365:0:41594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c143776800 00000020:00000080:0.0:1788269936.521368:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269936.521411:0:41594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269936.521414:0:41594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269936.521416:0:41594:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788269936.521419:0:41594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 13 count 13 00000020:01000000:3.0:1788269936.521519:0:41573:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788269936.521550:0:41573:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269936.521574:0:41573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.521586:0:41573:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269936.521636:0:41573:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269936.521639:0:41573:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c143776800 10000000:01000000:3.0:1788269936.521642:0:41573:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c143776800 10000000:01000000:3.0:1788269936.521645:0:41573:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269936.521651:0:41573:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c143776800 from 1 10000000:01000000:3.0:1788269936.521654:0:41573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269936.521685:0:41573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.521694:0:41573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.521703:0:41573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269936.521725:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269936.521781:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.521821:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269936.522074:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269936.522089:0:41573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.522098:0:41573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269936.524506:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00000040:00080000:3.0:1788269936.524757:0:41573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269936.524914:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:3.0:1788269936.524934:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:3.0:1788269936.524943:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:3.0:1788269936.524954:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:3.0:1788269936.524962:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:3.0:1788269936.524982:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:3.0:1788269936.524991:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:3.0:1788269936.524999:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:3.0:1788269936.525009:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:3.0:1788269936.525029:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:3.0:1788269936.525066:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:3.0:1788269936.525083:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:3.0:1788269936.525097:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:3.0:1788269936.525106:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:3.0:1788269936.525118:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:3.0:1788269936.525129:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:3.0:1788269936.525140:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:3.0:1788269936.525152:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:3.0:1788269936.525162:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:3.0:1788269936.525174:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:3.0:1788269936.525182:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:3.0:1788269936.525203:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:3.0:1788269936.525213:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:3.0:1788269936.525219:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:3.0:1788269936.525230:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 160 off12472 00000040:00080000:3.0:1788269936.525243:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12696 00000040:00080000:3.0:1788269936.525263:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12920 00000040:00080000:3.0:1788269936.525277:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off13000 00000040:00080000:3.0:1788269936.525294:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13224 00000040:00080000:3.0:1788269936.525311:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13448 00000040:00080000:3.0:1788269936.525325:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13536 00000040:00080000:3.0:1788269936.525336:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13664 00000040:00080000:3.0:1788269936.525350:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13808 00000040:00080000:3.0:1788269936.525366:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13936 00000040:00080000:3.0:1788269936.525385:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14160 00000040:00080000:3.0:1788269936.525405:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14384 00000040:00080000:3.0:1788269936.525419:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14464 00000040:00080000:3.0:1788269936.525462:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14688 00000040:00080000:3.0:1788269936.525485:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14912 00000040:00080000:3.0:1788269936.525514:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 88 off15000 00000040:00080000:3.0:1788269936.525540:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 128 off15128 00000040:00080000:3.0:1788269936.525560:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].42, 144 off15272 00000040:00080000:3.0:1788269936.525581:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].43, 128 off15400 00000040:00080000:3.0:1788269936.525596:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].44, 224 off15624 00000040:00080000:3.0:1788269936.525610:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].45, 224 off15848 00000040:00080000:3.0:1788269936.525622:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].46, 80 off15928 00000040:00080000:3.0:1788269936.525635:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].47, 224 off16152 00000040:00080000:3.0:1788269936.525650:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].48, 232 off16384 00000040:00080000:3.0:1788269936.525776:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].49, 224 off16608 00000040:00080000:3.0:1788269936.525791:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].50, 120 off16728 00000040:00080000:3.0:1788269936.525801:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].51, 224 off16952 00000040:00080000:3.0:1788269936.525805:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 51 count 51 00000100:00100000:3.0:1788269936.525887:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269936.525939:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.525983:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788269936.526197:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262536960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269936.526226:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269936.526258:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.526277:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788269936.528716:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262537088 00000100:00100000:0.0:1788269936.528729:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262537088 00000100:00100000:0.0:1788269936.528804:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269936.528815:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:41573:x1875136262537088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269936.528950:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:41573:x1875136262537088:12345-0@lo:503:mount.lustre.0 Request processed in 137us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.528957:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788269936.531320:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269936.531790:0:41573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269936.531882:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269936.531946:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.531997:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269936.532965:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269936.533201:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1788269936.533231:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:3.0:1788269936.533248:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:3.0:1788269936.533266:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:3.0:1788269936.533280:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:3.0:1788269936.533294:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:3.0:1788269936.533307:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:3.0:1788269936.533322:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:3.0:1788269936.533334:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:3.0:1788269936.533354:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:3.0:1788269936.533375:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:3.0:1788269936.533390:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:3.0:1788269936.533407:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:3.0:1788269936.533422:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:3.0:1788269936.533546:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:3.0:1788269936.533575:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:3.0:1788269936.533594:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:3.0:1788269936.533610:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:3.0:1788269936.533623:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:3.0:1788269936.533636:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:3.0:1788269936.533650:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:3.0:1788269936.533667:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:3.0:1788269936.533682:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:3.0:1788269936.533698:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:3.0:1788269936.533713:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 160 off12472 00000040:00080000:3.0:1788269936.533731:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12696 00000040:00080000:3.0:1788269936.533746:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12920 00000040:00080000:3.0:1788269936.533763:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off13000 00000040:00080000:3.0:1788269936.533778:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13224 00000040:00080000:3.0:1788269936.533796:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13448 00000040:00080000:3.0:1788269936.533814:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13536 00000040:00080000:3.0:1788269936.533845:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13664 00000040:00080000:3.0:1788269936.533862:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13808 00000040:00080000:3.0:1788269936.533877:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13936 00000040:00080000:3.0:1788269936.533890:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14160 00000040:00080000:3.0:1788269936.533905:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14384 00000040:00080000:3.0:1788269936.533919:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14464 00000040:00080000:3.0:1788269936.533934:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14688 00000040:00080000:3.0:1788269936.533949:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14912 00000040:00080000:3.0:1788269936.533963:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 88 off15000 00000040:00080000:3.0:1788269936.533978:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 128 off15128 00000040:00080000:3.0:1788269936.533992:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].42, 144 off15272 00000040:00080000:3.0:1788269936.534008:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].43, 128 off15400 00000040:00080000:3.0:1788269936.534023:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].44, 224 off15624 00000040:00080000:3.0:1788269936.534125:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].45, 224 off15848 00000040:00080000:3.0:1788269936.534147:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].46, 80 off15928 00000040:00080000:3.0:1788269936.534166:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].47, 224 off16152 00000040:00080000:3.0:1788269936.534198:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].48, 232 off16384 00000100:00100000:3.0:1788269936.534243:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269936.534297:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269936.534324:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262537344 00000100:00100000:3.0:1788269936.534331:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269936.534333:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262537344 00000100:00100000:0.0:1788269936.534382:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269936.534395:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:41573:x1875136262537344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269936.534518:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:41573:x1875136262537344:12345-0@lo:502:mount.lustre.0 Request processed in 127us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269936.534526:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788269936.535085:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269936.535233:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].49, 224 off16608 00000040:00080000:3.0:1788269936.535255:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].50, 120 off16728 00000100:00100000:3.0:1788269936.535280:0:41573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269936.535319:0:41573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.535339:0:41573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269936.536414:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269936.536664:0:41573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].51, 224 off16952 00000040:00080000:3.0:1788269936.536675:0:41573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:3.0:1788269936.543258:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262537600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269936.543326:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269936.543391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.543395:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.543398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.543401:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.543404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.543407:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.543409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.543412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1788269936.543509:0:41599:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788269936.543522:0:41599:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98c143788000) 00000020:00000080:3.0:1788269936.543537:0:41599:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788269936.543610:0:41599:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c143776800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788269936.543615:0:41599:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c143776800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788269936.543617:0:41599:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c143776800 3 00010000:00080000:3.0:1788269936.543644:0:41599:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c143795000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00080000:1.0:1788269936.545222:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c25ef74e00 x1875136262537600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269936.545238:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269936.545246:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00080000:1.0:1788269936.545254:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788269936.545259:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788269936.545261:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788269936.545268:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262537600:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1788269936.547465:0:41599:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788269936.547802:0:41599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788269936.547846:0:41599:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788269936.547857:0:41599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc5f5d7a016e07618 00000100:00080000:3.0:1788269936.547867:0:41599:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269936.547873:0:41599:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98c143795000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269936.547905:0:41599:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c248218e00 x1875136262537728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269936.547943:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1875136262537728:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269936.548018:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.548101:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262537728 00000100:00100000:3.0:1788269936.548108:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262537728 00000100:00100000:3.0:1788269936.548134:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269936.548140:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262537728:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788269936.548162:0:40075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:3.0:1788269936.548194:0:40075:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc5f5d7a016e0761f 00000004:00100000:3.0:1788269936.548208:0:40075:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788269936.548231:0:40075:0:(import.c:65:import_set_state_nolock()) ffff98c143790000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269936.548274:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875136262537728:12345-0@lo:38:llog_process_th.0 Request processed in 132us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269936.548281:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788269936.548311:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c248218e00 x1875136262537728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269936.548320:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269936.548327:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 6 00000100:00080000:3.0:1788269936.548333:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788269936.548337:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788269936.548339:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143795000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788269936.548345:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1875136262537728:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788269936.548364:0:41599:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788269936.548383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.548387:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.548390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.548392:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.548396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.548398:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269936.548402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269936.548404:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788269936.548686:0:41599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 20000000:01000000:3.0:1788269936.562219:0:40070:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788269936.562235:0:40070:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788269936.562712:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:41573:x1875136262537856:12345-0@lo:253:mount.lustre.0 Request processed in 12292us (12380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269936.562724:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788269936.562874:0:41573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:41573:1875136262537856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788269936.562888:0:41573:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788269936.562891:0:41573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788269936.562893:0:41573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269936.562895:0:41573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269936.562896:0:41573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269936.562897:0:41573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269936.562898:0:41573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269936.562900:0:41573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269936.562902:0:41573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269936.562903:0:41573:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788269936.562916:0:41573:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788269936.563324:0:40090:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788269936.563330:0:40090:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788269936.563351:0:40090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.563374:0:40090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.563383:0:40090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.563391:0:40090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.563426:0:40090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.563470:0:40090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 20 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269936.563484:0:40090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262537984:0@lo:104: 00000100:00100000:0.0:1788269936.563527:0:40090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269936.563585:0:40090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.563594:0:40090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 20 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269936.563604:0:40090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262538112:0@lo:104: 00000100:00100000:3.0:1788269936.563619:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262537984 00000100:00100000:3.0:1788269936.563627:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262537984 00000100:00100000:0.0:1788269936.563632:0:40090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269936.563652:0:40090:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269936.563667:0:40058:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788269936.563691:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538112 00000100:00100000:3.0:1788269936.563694:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538112 00000100:00100000:3.0:1788269936.563712:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269936.563719:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+4:40090:x1875136262537984:12345-0@lo:104: 00010000:00010000:3.0:1788269936.563731:0:40058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.563788:0:40058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269936.563794:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+4:40090:x1875136262537984:12345-0@lo:104: Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269936.563800:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269936.563812:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269936.563817:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262538112:12345-0@lo:104: 00010000:00010000:3.0:1788269936.563825:0:40058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.563858:0:40058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788269936.563864:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262538112:12345-0@lo:104: Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269936.563869:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788269936.563970:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269936.563976:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.563984:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269936.563987:0:40063:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.563995:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269936.564002:0:40063:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269936.564007:0:40063:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269936.564033:0:40063:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564061:0:40063:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269936.564080:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564087:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e07577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0757e expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564100:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269936.564103:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564114:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269936.564116:0:40063:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564123:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269936.564129:0:40063:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269936.564134:0:40063:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269936.564147:0:40063:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564153:0:40063:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269936.564161:0:40090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262537984:0@lo:104: 00010000:00010000:3.0:1788269936.564171:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269936.564175:0:40090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262538112:0@lo:104: 00010000:00010000:3.0:1788269936.564186:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e07569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07570 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269936.564196:0:40090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564201:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269936.564203:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269936.564212:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269936.564220:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269936.564237:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262538240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269936.564269:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.564309:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262538368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269936.564338:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269936.564377:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538240 00000100:00100000:3.0:1788269936.564382:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538240 00010000:00010000:3.0:1788269936.564398:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 21 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269936.564416:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538368 00000100:00100000:3.0:1788269936.564419:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538368 00010000:00010000:3.0:1788269936.564429:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 22 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269936.564838:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269936.564846:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+22:3608:x1875136262538240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269936.564857:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269936.564862:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 22 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564872:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 22 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564884:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e0757e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07577 expref: 22 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564895:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269936.564929:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+21:3608:x1875136262538240:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269936.564936:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269936.564949:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269936.564955:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+20:3609:x1875136262538368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269936.564964:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269936.564967:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 20 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564975:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 20 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564985:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07569 expref: 20 pid: 40070 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.564994:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565000:0:40061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269936.565014:0:40061:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001684324s 00010000:00010000:3.0:1788269936.565018:0:40061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565024:0:40061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565030:0:40061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565035:0:40061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565061:0:40061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b57600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269936.565066:0:40061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565075:0:40061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565091:0:40061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565102:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269936.565135:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262538240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269936.565136:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+19:3609:x1875136262538368:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269936.565148:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788269936.565197:0:40090:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565205:0:40090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269936.565211:0:40090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57600/0xc5f5d7a016e07626 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269936.565245:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262538368:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788269936.565512:0:41573:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:1.0:1788269936.572116:0:41573:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788269936.572126:0:41573:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788269936.572164:0:41573:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788269936.572202:0:41573:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788269936.572220:0:41573:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788269936.572244:0:41573:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788269936.573063:0:41573:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788269936.573251:0:41573:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788269937.348516:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788269937.354155:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803780 is committed 10000000:01000000:3.0:1788269937.732337:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269937.732344:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27b77a000 from 25 10000000:01000000:3.0:1788269937.732350:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269937.732392:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.732402:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.732427:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269937.732452:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269937.732580:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269937.732623:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269937.732746:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538496 00000100:00100000:0.0:1788269937.732754:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538496 00000100:00100000:0.0:1788269937.732809:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788269937.732819:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+19:40072:x1875136262538496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269937.732832:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269937.732846:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0762d expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269937.732868:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 20 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269937.732883:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 20 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269937.732892:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c275b56200, rc 0) 00000100:00100000:0.0:1788269937.732937:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+20:40072:x1875136262538496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269937.732951:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788269937.733035:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269937.733077:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.733085:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269937.733150:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269937.733181:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269937.733199:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269937.733400:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538624 00000100:00100000:0.0:1788269937.733405:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538624 00000100:00100000:0.0:1788269937.733452:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788269937.733459:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+20:40072:x1875136262538624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788269937.733473:0:40070:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788269937.733492:0:40070:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788269937.733495:0:40070:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 25 00000100:00100000:0.0:1788269937.733745:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+20:40072:x1875136262538624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 285us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269937.733752:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788269937.734448:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788269937.734527:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788269937.734536:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.734547:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269937.734557:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269937.734560:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c145155800 from 25 10000000:01000000:3.0:1788269937.734563:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269937.734587:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.734594:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.734602:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269937.734618:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269937.734655:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269937.734691:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269937.734857:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538752 00000100:00100000:0.0:1788269937.734864:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538752 00000100:00100000:0.0:1788269937.734903:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788269937.734911:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+20:40072:x1875136262538752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269937.734919:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269937.734930:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0763b expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269937.734958:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 21 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269937.734969:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 21 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269937.734977:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c275b57400, rc 0) 00000100:00100000:0.0:1788269937.735015:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262538752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269937.735022:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788269937.735216:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269937.735227:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.735237:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269937.735283:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269937.735309:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269937.735336:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269937.735389:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262538880 00000100:00100000:1.0:1788269937.735394:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262538880 00000100:00100000:1.0:1788269937.735432:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788269937.735440:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262538880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788269937.735451:0:40069:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788269937.735464:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788269937.735467:0:40069:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 25 00000100:00100000:1.0:1788269937.735554:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262538880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269937.735561:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788269937.735819:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262538880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788269937.735860:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788269937.735867:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269937.735879:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269938.372155:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262539008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269938.372223:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269938.372343:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269938.372868:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262539008 00000100:00100000:0.0:1788269938.372875:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262539008 00000100:00100000:0.0:1788269938.372961:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269938.372972:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262539008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788269938.373008:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446248448 avail 1300008960 00000100:00100000:0.0:1788269938.373239:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262539008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 270us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269938.373245:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788269938.373299:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262539008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269938.629217:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269928/real 1788269928] req@ffff98c248219880 x1875136262526464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269938 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269938.629247:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c248219880 x1875136262526464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269938 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269938.629255:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269928/real 1788269928] req@ffff98c27fa4b100 x1875136262526336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269938 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269938.629262:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27fa4b100 x1875136262526336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269938 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788269938.629276:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788269938.629292:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788269938.629295:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262526464:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788269938.629298:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27c81c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788269938.629302:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788269938.629303:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262526336:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788269938.629472:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262539136:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.629526:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269938.629561:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269938.629569:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262539264:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.629595:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269938.629625:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262539904:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.629659:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269938.629688:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269938.629698:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262540032:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.629730:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269938.629774:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262539136 00000100:00100000:1.0:1788269938.629781:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262539136 00000100:00100000:1.0:1788269938.629845:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788269938.629861:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:3607:x1875136262539136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.629914:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:3607:x1875136262539136:12345-0@lo:400:kworker.0 Request processed in 55us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.629922:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788269938.629960:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262539520:0@lo:8:kworker.0 00000100:00100000:1.0:1788269938.629994:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269938.630019:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262539648:0@lo:8:kworker.0 00000100:00100000:1.0:1788269938.630181:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269938.630218:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262539264 00000100:00100000:1.0:1788269938.630222:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262539264 00000100:00100000:1.0:1788269938.630246:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788269938.630254:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262539264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.630288:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262539264:12345-0@lo:400:kworker.0 Request processed in 36us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.630294:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788269938.630395:0:40075:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788269938.630413:0:40075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:1.0:1788269938.630442:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef75c00 x1875136262539904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269938.630454:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262539904:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.630462:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:1.0:1788269938.630467:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803778 committed transno 25769803780 00000004:00080000:1.0:1788269938.630481:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803779 committed transno 25769803780 00000004:00080000:1.0:1788269938.630490:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803780 committed transno 25769803780 00000100:00100000:1.0:1788269938.630499:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262539264:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.630508:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262539136:0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.630535:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262539520 00000100:00100000:1.0:1788269938.630539:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262539520 00000100:00100000:1.0:1788269938.630556:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262539648 00000100:00100000:1.0:1788269938.630559:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262539648 00000100:00100000:1.0:1788269938.630570:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269938.630574:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262539520:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788269938.630597:0:41578:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:1.0:1788269938.630624:0:41578:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e07649 00002000:00100000:1.0:1788269938.630637:0:41578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98c27b8e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788269938.630641:0:41578:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788269938.630644:0:41578:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788269938.630804:0:41578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788269938.630833:0:41578:0:(import.c:65:import_set_state_nolock()) ffff98c27b8e2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269938.630872:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1875136262539520:12345-0@lo:8:kworker.0 Request processed in 296us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.630878:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269938.630891:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269938.630894:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262539648:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788269938.630904:0:41578:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788269938.630928:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262539648:12345-0@lo:8:kworker.0 Request processed in 32us (747us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788269938.630934:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788269938.631025:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef76a00 x1875136262539520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269938.631033:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269938.631057:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 6 00000100:00080000:1.0:1788269938.631065:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788269938.631069:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788269938.631071:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27c81c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788269938.631090:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788269938.631095:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262539520:0@lo:8:kworker.0 00000100:00080000:1.0:1788269938.631106:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788269938.631110:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788269938.631112:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262539648:0@lo:8:kworker.0 00000100:00100000:1.0:1788269938.631148:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269938.631156:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262540032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269938.631191:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262540032:12345-0@lo:400:kworker.0 Request processed in 37us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.631198:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788269938.631224:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef76300 x1875136262540032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269938.631238:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262540032:0@lo:400:kworker.0 00000004:00080000:0.0:1788269938.631456:0:40816:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788269938.631519:0:40816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 730338479634ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788269938.631525:0:40816:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788269938.632020:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262540288 00000100:00100000:1.0:1788269938.632027:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262540288 00000100:00100000:1.0:1788269938.632410:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269938.632419:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:40817:x1875136262540288:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788269938.637786:0:40807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788269938.643694:0:41578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788269938.643704:0:41578:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0xa1:0x0] 00000100:00100000:1.0:1788269938.643808:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:40817:x1875136262540288:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11386us (11826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.643819:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788269938.643922:0:40817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef75500 x1875136262540288/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788269954 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269938.643939:0:40817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:40817:1875136262540288:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788269938.643955:0:40817:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0xa1:0x0] 00000100:00100000:0.0:1788269938.643995:0:40817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:40817:1875136262540416:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788269938.644031:0:40817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269938.644182:0:40817:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269938.645524:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262540416 00000100:00100000:1.0:1788269938.645537:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262540416 00000100:00100000:1.0:1788269938.646502:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269938.646516:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:40817:x1875136262540416:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788269938.646547:0:41580:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = 0 00000100:00100000:1.0:1788269938.646618:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:40817:x1875136262540416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 106us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.646626:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788269938.648550:0:40817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c1410e1500 x1875136262540416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269954 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269938.648570:0:40817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:40817:1875136262540416:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788269938.648587:0:40817:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0xa1:0x0] from OST, last_created [0x280000400:0xa1:0x0]last_used is [0x280000400:0xa1:0x0] 00000100:00100000:0.0:1788269938.648633:0:40817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:40817:1875136262540544:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788269938.648685:0:40817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269938.648713:0:40817:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788269938.648739:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262540544 00000100:00100000:0.0:1788269938.648745:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262540544 00000100:00100000:0.0:1788269938.648784:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788269938.648794:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:40817:x1875136262540544:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788269938.648829:0:41578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 162 00000001:00080000:3.0:1788269938.671602:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803777 is committed 00000001:00100000:3.0:1788269938.671620:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788269938.671886:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:40817:x1875136262540544:12345-0@lo:5:osp-pre-0-1.0 Request processed in 23089us (23197us total) trans 25769803777 rc 0/0 00000100:00100000:1.0:1788269938.671898:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788269938.672117:0:40817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c1410e1500 x1875136262540544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269954 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269938.672130:0:40817:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 25769803777 gen 2 00000100:00100000:3.0:1788269938.672136:0:40817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:40817:1875136262540544:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788269938.672152:0:40817:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0xa1:0x0]-[0x280000400:0xc1:0x0] 00000100:00100000:3.0:1788269938.672204:0:40817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:40817:1875136262540672:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788269938.672241:0:40817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269938.672264:0:40817:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2751de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269938.672459:0:40086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262540672 00000100:00100000:1.0:1788269938.672467:0:40086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262540672 00000100:00100000:1.0:1788269938.672508:0:40086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269938.672517:0:40086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:40817:x1875136262540672:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788269938.672562:0:40086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:40817:x1875136262540672:12345-0@lo:900:osp-pre-0-1.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269938.672569:0:40086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269938.673113:0:40817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c248219180 x1875136262540672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788269954 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269938.673125:0:40817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:40817:1875136262540672:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788269940.422090:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788269940.649854:0:42046:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788269940.650114:0:42046:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788269941.444730:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262540800 00000100:00100000:1.0:1788269941.444738:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262540800 00000100:00100000:1.0:1788269941.444791:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788269941.444801:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262540800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788269941.444832:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446404096 avail 1300164608 00000100:00100000:1.0:1788269941.444892:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262540800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269941.444899:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788269941.447435:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269942.469201:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269943.492206:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262540928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269943.492276:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269943.492455:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262540928 00000100:00100000:3.0:1788269943.492462:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262540928 00000100:00100000:3.0:1788269943.492507:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269943.492516:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262540928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788269943.492549:0:40080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446248448 avail 1300008960 00000100:00100000:3.0:1788269943.492598:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262540928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269943.492605:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269943.492646:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262540928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788269943.493294:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269943.684657:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788269944.004329:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262541056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269944.004397:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.004446:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262541184:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.004476:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.004511:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269944.004521:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262541568:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.004551:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.004596:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541056 00000100:00100000:1.0:1788269944.004603:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541056 00000100:00100000:1.0:1788269944.004670:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269944.004679:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262541056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269944.004705:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788269944.004743:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262541056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.004750:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269944.004775:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541184 00000100:00100000:1.0:1788269944.004779:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541184 00000100:00100000:1.0:1788269944.004810:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788269944.004818:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:3608:x1875136262541184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.004849:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:3608:x1875136262541184:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.004856:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788269944.004890:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541568 00000100:00100000:1.0:1788269944.004893:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541568 00000100:00100000:0.0:1788269944.004904:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541952 00000100:00100000:0.0:1788269944.004912:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541952 00000100:00100000:1.0:1788269944.004922:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269944.004931:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262541568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.004962:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262541568:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.004968:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788269944.004984:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269944.005003:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262541696:0@lo:8:kworker.0 00000100:00100000:1.0:1788269944.005028:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.005036:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541440 00000100:00100000:0.0:1788269944.005077:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541440 00000100:00100000:0.0:1788269944.005100:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788269944.005112:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262541952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.007214:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262541952:12345-0@lo:400:kworker.0 Request processed in 2100us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.007227:0:40075:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788269944.007230:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269944.007238:0:40075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788269944.007254:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269944.007263:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262542080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.007298:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262542080:12345-0@lo:400:kworker.0 Request processed in 37us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.007324:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788269944.007416:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788269944.007421:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269944.008447:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541696 00000100:00100000:1.0:1788269944.008454:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541696 00000100:00100000:1.0:1788269944.008486:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269944.008492:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262541696:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788269944.008513:0:41580:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788269944.008567:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262541696:12345-0@lo:8:kworker.0 Request processed in 73us (3537us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788269944.008574:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269944.008668:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269944.008683:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.008721:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269944.008767:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788269944.008772:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788269944.008777:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262541696:0@lo:8:kworker.0 00010000:00080000:1.0:1788269944.008811:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef75c00 x1875136262541568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269944.008823:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262541568:0@lo:400:kworker.0 00010000:00080000:1.0:1788269944.008838:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f290380 x1875136262541056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269944.008854:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262541056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269944.008869:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262541184:0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.009072:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262541824 00000100:00100000:0.0:1788269944.009076:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262541824 00000100:00100000:0.0:1788269944.009108:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269944.009116:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262541824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.009159:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262541824:12345-0@lo:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.009165:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788269944.009194:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c25ef74e00 x1875136262541824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269944.009202:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262541824:0@lo:400:kworker.0 00000020:01000004:1.0:1788269944.388786:0:42391:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788269944.388790:0:42391:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788269944.388792:0:42391:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788269944.388911:0:42391:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c24b03b000 00000020:01000004:1.0:1788269944.388928:0:42391:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788269944.388943:0:42391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788269944.388957:0:42391:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98c1438acd28) 00000020:00000080:1.0:1788269944.388972:0:42391:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788269944.431411:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788269944.438460:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788269944.438899:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788269944.439063:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788269944.439267:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788269944.439768:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788269944.440024:0:42391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788269944.441156:0:42391:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788269944.441373:0:42391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788269944.441389:0:42391:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788269944.441401:0:42391:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f5d7a016e07657 00000020:01000004:0.0:1788269944.441408:0:42391:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788269944.441429:0:42391:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788269944.441432:0:42391:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788269944.441439:0:42391:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788269944.441469:0:42391:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788269944.441473:0:42391:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788269944.448829:0:42391:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788269944.448865:0:42391:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788269944.448870:0:42391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788269944.448872:0:42391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788269944.448873:0:42391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269944.448874:0:42391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269944.448876:0:42391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269944.448877:0:42391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269944.448878:0:42391:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269944.448880:0:42391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269944.448881:0:42391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269944.448884:0:42391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788269944.448886:0:42391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269944.448887:0:42391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788269944.448888:0:42391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269944.448889:0:42391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269944.448890:0:42391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269944.448891:0:42391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269944.448892:0:42391:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269944.448893:0:42391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269944.448894:0:42391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269944.448918:0:42391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788269944.448935:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788269944.449003:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.449124:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b74cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.449772:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269944.449783:0:42391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788269944.449785:0:42391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269944.449787:0:42391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269944.449788:0:42391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269944.449789:0:42391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269944.449791:0:42391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269944.449792:0:42391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269944.449793:0:42391:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269944.449795:0:42391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269944.449796:0:42391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788269944.449812:0:42391:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c24b03b000 from lustre-OST0001 10000000:01000000:0.0:1788269944.449839:0:42391:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788269944.449842:0:42391:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788269944.449850:0:42391:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c276b6cd28 local copy 00010000:00010000:0.0:1788269944.449859:0:42391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269944.449937:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269944.449966:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.450215:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269944.450314:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262542336 00000100:00100000:1.0:1788269944.450320:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262542336 00000100:00100000:1.0:1788269944.450344:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788269944.450351:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:42391:x1875136262542336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269944.450433:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:42391:x1875136262542336:12345-0@lo:501:mount.lustre.0 Request processed in 82us (466us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269944.450441:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788269944.450505:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542336:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788269944.450518:0:42391:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788269944.450533:0:42391:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788269944.450539:0:42391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.450549:0:42391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269944.450576:0:42391:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c24b03b000 10000000:01000000:0.0:1788269944.450580:0:42391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788269944.450585:0:42391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788269944.450588:0:42391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788269944.450592:0:42391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788269944.450595:0:42391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788269944.450616:0:42391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.450628:0:42391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.450638:0:42391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269944.450650:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269944.450674:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.450695:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269944.450737:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262542464 00000100:00100000:1.0:1788269944.450741:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262542464 00000100:00100000:1.0:1788269944.450757:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788269944.450763:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:42391:x1875136262542464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269944.450772:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269944.450783:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e07665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0765e expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.450802:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e07665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0765e expref: 22 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.450813:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e07665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0765e expref: 22 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.450820:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfe00, rc 0) 00000100:00100000:1.0:1788269944.450854:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542464:12345-0@lo:101:mount.lustre.0 Request processed in 91us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.450859:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788269944.450921:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269944.450931:0:42391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.450940:0:42391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269944.451965:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000040:00080000:0.0:1788269944.452782:0:42391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269944.458543:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262542592 00000100:00100000:0.0:1788269944.458551:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262542592 00000100:00100000:0.0:1788269944.458598:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788269944.458607:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269944.458747:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542592:12345-0@lo:501:mount.lustre.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.458755:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788269944.458835:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269944.458868:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269944.458908:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269944.458934:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.458976:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262542720 00000100:00100000:0.0:1788269944.458980:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262542720 00000100:00100000:0.0:1788269944.459010:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788269944.459017:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269944.459787:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542720:12345-0@lo:503:mount.lustre.0 Request processed in 768us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.459796:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788269944.459915:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269944.460703:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262542848 00000100:00100000:3.0:1788269944.460708:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262542848 00000100:00100000:3.0:1788269944.460773:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788269944.460782:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269944.461124:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542848:12345-0@lo:502:mount.lustre.0 Request processed in 342us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269944.461132:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000040:00080000:2.0:1788269944.461505:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:2.0:1788269944.461517:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 120 off9752 00000100:00100000:2.0:1788269944.461539:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269944.461573:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.461835:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.461897:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262542976 00000100:00100000:0.0:1788269944.461903:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262542976 00000100:00100000:0.0:1788269944.461931:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788269944.461939:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.462021:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262542976:12345-0@lo:502:mount.lustre.0 Request processed in 82us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.462029:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788269944.462143:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262542976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269944.462180:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9976 00000040:00080000:2.0:1788269944.462187:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788269944.462710:0:42395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788269944.462718:0:42395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788269944.462724:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.462726:0:42395:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788269944.462731:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788269944.462745:0:42395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98c249154d28) 00000020:00000080:2.0:1788269944.462766:0:42395:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788269944.462773:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788269944.462846:0:42395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c24b03b000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788269944.462854:0:42395:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788269944.462862:0:42395:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f5d7a016e07673 00010000:00010000:2.0:1788269944.468827:0:42395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788269944.469599:0:42395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 21474836487 00080000:10000000:2.0:1788269944.471687:0:42395:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xe:0x0] (8/32) registered 00000020:00000080:0.0:1788269944.473351:0:42395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788269944.473362:0:42395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269944.473367:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269944.473368:0:42395:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788269944.473371:0:42395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269944.473374:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269944.473374:0:42395:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269944.473376:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269944.473377:0:42395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788269944.473379:0:42395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269944.473380:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269944.473381:0:42395:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788269944.473382:0:42395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269944.473384:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269944.473385:0:42395:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788269944.473387:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788269944.473407:0:42395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269944.473409:0:42395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269944.473410:0:42395:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788269944.473412:0:42395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000020:01000000:2.0:1788269944.474109:0:42391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788269944.474136:0:42391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788269944.474155:0:42391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269944.474163:0:42391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269944.474169:0:42391:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c24b03b000 from 1 10000000:01000000:2.0:1788269944.474171:0:42391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269944.474198:0:42391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269944.474204:0:42391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269944.474212:0:42391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269944.474229:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269944.474289:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.474340:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269944.474806:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543104 00000100:00100000:1.0:1788269944.474814:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543104 00000100:00100000:1.0:1788269944.474914:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788269944.474926:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:42391:x1875136262543104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269944.474941:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269944.474955:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0767a expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.474980:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.474991:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.475001:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bec00, rc 0) 00000100:00100000:1.0:1788269944.475075:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543104:12345-0@lo:101:mount.lustre.0 Request processed in 151us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.475082:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788269944.475249:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269944.475264:0:42391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.475273:0:42391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269944.479425:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:2.0:1788269944.479730:0:42391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269944.479909:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:2.0:1788269944.479934:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:2.0:1788269944.479950:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:2.0:1788269944.479959:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:2.0:1788269944.479966:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:2.0:1788269944.479973:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:2.0:1788269944.479980:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:2.0:1788269944.479987:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:2.0:1788269944.479994:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:2.0:1788269944.480001:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 224 off10112 00000040:00080000:2.0:1788269944.480008:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 128 off10240 00000040:00080000:2.0:1788269944.480017:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10464 00000040:00080000:2.0:1788269944.480020:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:2.0:1788269944.480118:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269944.480173:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.480204:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269944.480210:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543232 00000100:00100000:1.0:1788269944.480219:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543232 00000100:00100000:1.0:1788269944.480271:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788269944.480282:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269944.480676:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543232:12345-0@lo:501:mount.lustre.0 Request processed in 395us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.480685:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788269944.482389:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269944.482430:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269944.482475:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.482508:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269944.482533:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543360 00000100:00100000:1.0:1788269944.482540:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543360 00000100:00100000:1.0:1788269944.482591:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788269944.482601:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269944.482720:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543360:12345-0@lo:503:mount.lustre.0 Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.482728:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788269944.482898:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788269944.483267:0:42391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788269944.483338:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269944.483366:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.483391:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.483916:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543488 00000100:00100000:0.0:1788269944.483923:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543488 00000100:00100000:0.0:1788269944.483959:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788269944.483968:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.484150:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543488:12345-0@lo:502:mount.lustre.0 Request processed in 183us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.484158:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788269944.484336:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269944.484480:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:2.0:1788269944.484497:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:2.0:1788269944.484505:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:2.0:1788269944.484514:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:2.0:1788269944.484521:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:2.0:1788269944.484527:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:2.0:1788269944.484534:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:2.0:1788269944.484540:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000040:00080000:2.0:1788269944.484547:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:2.0:1788269944.484553:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 224 off10112 00000040:00080000:2.0:1788269944.484560:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 128 off10240 00000100:00100000:2.0:1788269944.484575:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269944.484601:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.484621:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.484640:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543616 00000100:00100000:0.0:1788269944.484646:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543616 00000100:00100000:0.0:1788269944.484679:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788269944.484686:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.484762:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543616:12345-0@lo:502:mount.lustre.0 Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.484770:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788269944.484851:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269944.484880:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10464 00000040:00080000:2.0:1788269944.484886:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788269944.485877:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269944.485884:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485886:0:42399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788269944.485890:0:42399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c24b03b000 00000020:00000080:2.0:1788269944.485893:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788269944.485900:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269944.485903:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485904:0:42399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788269944.485906:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269944.485908:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485909:0:42399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788269944.485912:0:42399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c24b03b000 00000020:00000080:2.0:1788269944.485913:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788269944.485961:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269944.485963:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485964:0:42399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788269944.485966:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269944.485967:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485968:0:42399:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788269944.485971:0:42399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c24b03b000 00000020:00000080:2.0:1788269944.485972:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788269944.485984:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269944.485985:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485986:0:42399:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788269944.485988:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269944.485989:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.485990:0:42399:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788269944.485991:0:42399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c24b03b000 00000020:00000080:2.0:1788269944.485992:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788269944.486004:0:42399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269944.486006:0:42399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269944.486007:0:42399:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788269944.486008:0:42399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 13 count 13 00000020:01000000:3.0:1788269944.486376:0:42391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788269944.486400:0:42391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269944.486418:0:42391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269944.486426:0:42391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269944.486465:0:42391:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269944.486467:0:42391:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c24b03b000 10000000:01000000:3.0:1788269944.486469:0:42391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c24b03b000 10000000:01000000:3.0:1788269944.486472:0:42391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269944.486475:0:42391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c24b03b000 from 1 10000000:01000000:3.0:1788269944.486477:0:42391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269944.486501:0:42391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269944.486508:0:42391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269944.486515:0:42391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269944.486529:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269944.486569:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269944.486600:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.487090:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543744 00000100:00100000:0.0:1788269944.487098:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543744 00000100:00100000:0.0:1788269944.487145:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788269944.487154:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+23:42391:x1875136262543744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269944.487167:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269944.487180:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c275b57000/0xc5f5d7a016e0768f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07688 expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.487204:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c275b57000/0xc5f5d7a016e0768f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07688 expref: 24 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.487214:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c275b57000/0xc5f5d7a016e0768f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07688 expref: 24 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.487224:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c275b57000, rc 0) 00000100:00100000:0.0:1788269944.487279:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262543744:12345-0@lo:101:mount.lustre.0 Request processed in 126us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.487286:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788269944.487341:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269944.487354:0:42391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269944.487361:0:42391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269944.503180:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00000040:00080000:2.0:1788269944.503475:0:42391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269944.503663:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:2.0:1788269944.503692:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:2.0:1788269944.503709:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:2.0:1788269944.503723:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:2.0:1788269944.503739:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:2.0:1788269944.503755:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:2.0:1788269944.503768:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:2.0:1788269944.503782:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:2.0:1788269944.503797:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:2.0:1788269944.503814:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:2.0:1788269944.503832:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:2.0:1788269944.503849:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:2.0:1788269944.503867:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:2.0:1788269944.503896:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:2.0:1788269944.503913:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:2.0:1788269944.503929:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:2.0:1788269944.503944:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:2.0:1788269944.503959:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:2.0:1788269944.503975:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:2.0:1788269944.503992:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:2.0:1788269944.504009:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:2.0:1788269944.504022:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:2.0:1788269944.504058:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:2.0:1788269944.504076:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:2.0:1788269944.504092:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 160 off12472 00000040:00080000:2.0:1788269944.504106:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12696 00000040:00080000:2.0:1788269944.504122:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12920 00000040:00080000:2.0:1788269944.504138:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off13000 00000040:00080000:2.0:1788269944.504154:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13224 00000040:00080000:2.0:1788269944.504181:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13448 00000040:00080000:2.0:1788269944.504198:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13536 00000040:00080000:2.0:1788269944.504211:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13664 00000040:00080000:2.0:1788269944.504223:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13808 00000040:00080000:2.0:1788269944.504236:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13936 00000040:00080000:2.0:1788269944.504249:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14160 00000040:00080000:2.0:1788269944.504263:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14384 00000040:00080000:2.0:1788269944.504276:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14464 00000040:00080000:2.0:1788269944.504290:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14688 00000040:00080000:2.0:1788269944.504321:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14912 00000040:00080000:2.0:1788269944.504335:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 88 off15000 00000040:00080000:2.0:1788269944.504347:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 128 off15128 00000040:00080000:2.0:1788269944.504359:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].42, 144 off15272 00000040:00080000:2.0:1788269944.504372:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].43, 128 off15400 00000040:00080000:2.0:1788269944.504384:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].44, 224 off15624 00000040:00080000:2.0:1788269944.504399:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].45, 224 off15848 00000040:00080000:2.0:1788269944.504424:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].46, 80 off15928 00000040:00080000:2.0:1788269944.504439:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].47, 224 off16152 00000040:00080000:2.0:1788269944.504452:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].48, 232 off16384 00000040:00080000:2.0:1788269944.504544:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].49, 224 off16608 00000040:00080000:2.0:1788269944.504562:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].50, 120 off16728 00000040:00080000:2.0:1788269944.504580:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].51, 224 off16952 00000040:00080000:2.0:1788269944.504585:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 51 count 51 00000100:00100000:2.0:1788269944.504659:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269944.504721:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.504771:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c245de43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.504893:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262543872 00000100:00100000:0.0:1788269944.504901:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262543872 00000100:00100000:0.0:1788269944.504945:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788269944.504956:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262543872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269944.505092:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262543872:12345-0@lo:501:mount.lustre.0 Request processed in 137us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.505101:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788269944.505157:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262543872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269944.505197:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269944.505237:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.505269:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269944.505331:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544000 00000100:00100000:3.0:1788269944.505336:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544000 00000100:00100000:3.0:1788269944.505371:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788269944.505378:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269944.505453:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544000:12345-0@lo:503:mount.lustre.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269944.505459:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788269944.506505:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788269944.506937:0:42391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269944.507008:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.507090:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.507124:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269944.507356:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544128 00000100:00100000:2.0:1788269944.507363:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544128 00000100:00100000:2.0:1788269944.507405:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788269944.507413:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269944.507515:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544128:12345-0@lo:502:mount.lustre.0 Request processed in 102us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.507522:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788269944.508646:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269944.508837:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:0.0:1788269944.508866:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:0.0:1788269944.508882:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:0.0:1788269944.508896:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:0.0:1788269944.508911:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:0.0:1788269944.508924:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:0.0:1788269944.508939:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:0.0:1788269944.508954:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:0.0:1788269944.508967:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:0.0:1788269944.508994:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:0.0:1788269944.509010:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:0.0:1788269944.509023:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:0.0:1788269944.509056:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:0.0:1788269944.509074:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:0.0:1788269944.509089:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:0.0:1788269944.509103:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:0.0:1788269944.509117:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:0.0:1788269944.509129:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:0.0:1788269944.509141:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:0.0:1788269944.509153:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:0.0:1788269944.509166:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:0.0:1788269944.509177:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:0.0:1788269944.509190:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:0.0:1788269944.509202:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:0.0:1788269944.509215:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 160 off12472 00000040:00080000:0.0:1788269944.509241:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12696 00000040:00080000:0.0:1788269944.509256:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12920 00000040:00080000:0.0:1788269944.509268:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off13000 00000040:00080000:0.0:1788269944.509280:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13224 00000040:00080000:0.0:1788269944.509292:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13448 00000040:00080000:0.0:1788269944.509330:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13536 00000040:00080000:0.0:1788269944.509344:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13664 00000040:00080000:0.0:1788269944.509358:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13808 00000040:00080000:0.0:1788269944.509372:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13936 00000040:00080000:0.0:1788269944.509400:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14160 00000040:00080000:0.0:1788269944.509416:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14384 00000040:00080000:0.0:1788269944.510794:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14464 00000040:00080000:0.0:1788269944.510826:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14688 00000040:00080000:0.0:1788269944.510841:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14912 00000040:00080000:0.0:1788269944.510854:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 88 off15000 00000040:00080000:0.0:1788269944.510867:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 128 off15128 00000040:00080000:0.0:1788269944.510895:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].42, 144 off15272 00000040:00080000:0.0:1788269944.510912:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].43, 128 off15400 00000040:00080000:0.0:1788269944.510926:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].44, 224 off15624 00000040:00080000:0.0:1788269944.510939:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].45, 224 off15848 00000040:00080000:0.0:1788269944.510953:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].46, 80 off15928 00000040:00080000:0.0:1788269944.510967:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].47, 224 off16152 00000040:00080000:0.0:1788269944.510980:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].48, 232 off16384 00000100:00100000:0.0:1788269944.511032:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.511117:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.511155:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544256 00000100:00100000:0.0:1788269944.511161:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544256 00000100:00100000:0.0:1788269944.511593:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788269944.511604:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.511706:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544256:12345-0@lo:502:mount.lustre.0 Request processed in 103us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.511713:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788269944.512004:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269944.512026:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269944.513167:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].49, 224 off16608 00000040:00080000:0.0:1788269944.513194:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].50, 120 off16728 00000100:00100000:0.0:1788269944.513226:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269944.513286:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269944.513562:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544384 00000100:00100000:0.0:1788269944.513566:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269944.513569:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544384 00000100:00100000:3.0:1788269944.513723:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788269944.513734:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269944.513929:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262544384:12345-0@lo:502:mount.lustre.0 Request processed in 196us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269944.513937:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788269944.514086:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262544384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269944.514129:0:42391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].51, 224 off16952 00000040:00080000:0.0:1788269944.514137:0:42391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788269944.514841:0:42404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788269944.514857:0:42404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98c143504d28) 00000020:00000080:0.0:1788269944.514881:0:42404:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788269944.514972:0:42404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c24b03b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788269944.514977:0:42404:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c24b03b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788269944.514979:0:42404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c24b03b000 3 00010000:00080000:0.0:1788269944.515008:0:42404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c143555800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788269944.519013:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269944.522157:0:42404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788269944.526934:0:42404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788269944.526984:0:42404:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788269944.526996:0:42404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5f5d7a016e0769d 00000100:00080000:0.0:1788269944.527006:0:42404:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788269944.527012:0:42404:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c143555800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269944.527059:0:42404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1410e3100 x1875136262544512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269944.527089:0:42404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788269944.527356:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262544512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788269944.527418:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788269944.527501:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269944.527504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788269944.527506:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269944.527508:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788269944.527526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269944.527528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788269944.527530:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269944.527533:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 735 00000100:00080000:2.0:1788269944.527537:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1788269944.527541:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262544640:0@lo:400:kworker.0 00000100:00080000:2.0:1788269944.527542:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c27b5e2800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788269944.527554:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14409bb80 x1875136262545152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269944.527584:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.527599:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262544896:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.527622:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262545280:0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.527623:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.527640:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262545536:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.527660:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.527667:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262545024:0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.527815:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.527852:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262545152:0@lo:8:kworker.0 00000100:00100000:2.0:1788269944.527871:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.527894:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544640 00000100:00100000:2.0:1788269944.527901:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544640 00000100:00100000:2.0:1788269944.527937:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544896 00000100:00100000:2.0:1788269944.527940:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544896 00000100:00100000:2.0:1788269944.527957:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269944.527965:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262544640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.528015:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262544640:12345-0@lo:400:kworker.0 Request processed in 50us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.528022:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269944.528057:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788269944.528063:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262544896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.528086:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262544896:12345-0@lo:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.528090:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269944.528377:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544512 00000100:00100000:0.0:1788269944.528382:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544512 00000100:00100000:0.0:1788269944.528403:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545280 00000100:00100000:0.0:1788269944.528406:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545280 00000100:00100000:0.0:1788269944.528448:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269944.528456:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262545280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.528492:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262545280:12345-0@lo:400:kworker.0 Request processed in 37us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.528502:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269944.528515:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269944.528519:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1875136262544512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788269944.528538:0:40076:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:0.0:1788269944.528578:0:40076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc5f5d7a016e076a4 00000004:00100000:0.0:1788269944.528594:0:40076:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788269944.528625:0:40076:0:(import.c:65:import_set_state_nolock()) ffff98c142bd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269944.528666:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875136262544512:12345-0@lo:38:llog_process_th.0 Request processed in 145us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269944.528673:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788269944.528723:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e3100 x1875136262544512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269944.528733:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788269944.528740:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00080000:0.0:1788269944.528747:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788269944.528751:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788269944.528753:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788269944.528759:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262544512:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788269944.528847:0:42404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788269944.528861:0:42404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98c1435019b8) 00000020:00000080:0.0:1788269944.528878:0:42404:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788269944.528946:0:42404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c24b03b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788269944.528951:0:42404:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c24b03b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788269944.528953:0:42404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c24b03b000 3 00010000:00080000:0.0:1788269944.528981:0:42404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27b7ad800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.142@tcp at head 00000100:00100000:2.0:1788269944.529096:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262544768:0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.529121:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269944.529135:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262545408:0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.529147:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.529166:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262544768 00000100:00100000:0.0:1788269944.529171:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262544768 00000100:00100000:2.0:1788269944.529174:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545408 00000100:00100000:2.0:1788269944.529178:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545408 00000100:00100000:0.0:1788269944.529203:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269944.529485:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262544768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.529528:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262544768:12345-0@lo:400:kworker.0 Request processed in 318us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.532121:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788269944.532138:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262545408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.532201:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262545408:12345-0@lo:400:kworker.0 Request processed in 71us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.532206:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269944.532288:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.532361:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262544896:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.532391:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545024 00000100:00100000:1.0:1788269944.532397:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545024 00000100:00100000:1.0:1788269944.532457:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545152 00000100:00100000:1.0:1788269944.532461:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545152 00000100:00100000:1.0:1788269944.532475:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269944.532482:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262545024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.532527:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262545024:12345-0@lo:400:kworker.0 Request processed in 45us (4711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.532533:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269944.532547:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269944.532551:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262545152:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788269944.532600:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262545152:12345-0@lo:8:kworker.0 Request processed in 47us (4726us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788269944.532606:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788269944.532647:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14409b100 x1875136262545024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269944.532658:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262545024:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.532682:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269944.532689:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788269944.532693:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788269944.532697:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262545152:0@lo:8:kworker.0 00010000:00080000:1.0:1788269944.532721:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144099880 x1875136262545280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269944.532731:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262545280:0@lo:400:kworker.0 00000100:00100000:1.0:1788269944.532743:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262544640:0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.532858:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545536 00000100:00100000:2.0:1788269944.532861:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545536 00000100:00100000:2.0:1788269944.532883:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788269944.532889:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262545536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.532933:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262545536:12345-0@lo:400:kworker.0 Request processed in 44us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.532940:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788269944.533271:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144099f80 x1875136262545536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788269944.533279:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14409b480 x1875136262544768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269944.533285:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262545536:0@lo:400:kworker.0 00000100:00100000:2.0:1788269944.533309:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262544768:0@lo:400:kworker.0 00010000:00080000:2.0:1788269944.533323:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144099500 x1875136262545408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269944.533331:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262545408:0@lo:400:kworker.0 00000100:00100000:0.0:1788269944.534167:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788269944.536593:0:42404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788269944.536796:0:42404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788269944.536842:0:42404:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788269944.536857:0:42404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc5f5d7a016e076b2 00000100:00080000:2.0:1788269944.536866:0:42404:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269944.536872:0:42404:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98c27b7ad800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788269944.536903:0:42404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c144099500 x1875136262545664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269944.536980:0:42404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788269944.537120:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262545664:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788269944.537181:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.537234:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545664 00000100:00100000:1.0:1788269944.537240:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545664 00000100:00100000:1.0:1788269944.537267:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269944.537274:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3606:x1875136262545664:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788269944.537308:0:42351:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:1.0:1788269944.537388:0:42351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc5f5d7a016e076b9 00000004:00100000:1.0:1788269944.537402:0:42351:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788269944.537491:0:42351:0:(import.c:65:import_set_state_nolock()) ffff98c1435b0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269944.537542:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875136262545664:12345-0@lo:38:llog_process_th.0 Request processed in 267us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.537550:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788269944.537585:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144099500 x1875136262545664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269944.537595:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269944.537603:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 6 00000100:00080000:1.0:1788269944.537609:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788269944.537613:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788269944.537616:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b7ad800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788269944.537621:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262545664:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788269944.538966:0:42404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 00000100:00080000:0.0:1788269944.539271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269944.539277:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788269944.539280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269944.539283:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788269944.539370:0:42391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788269944.539400:0:42391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788269944.539423:0:42391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.539442:0:42391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788269944.539491:0:42391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788269944.539493:0:42391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269944.539495:0:42391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269944.539496:0:42391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269944.539497:0:42391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269944.539498:0:42391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269944.539500:0:42391:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269944.539501:0:42391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269944.539503:0:42391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269944.539506:0:42391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788269944.539509:0:42391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269944.539511:0:42391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269944.539512:0:42391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269944.539513:0:42391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269944.539514:0:42391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269944.539515:0:42391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269944.539516:0:42391:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269944.539517:0:42391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269944.539518:0:42391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269944.539538:0:42391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788269944.539552:0:42391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262545792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269944.539597:0:42391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269944.539635:0:42391:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269944.539928:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545792 00000100:00100000:2.0:1788269944.539935:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545792 00000100:00100000:2.0:1788269944.539980:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788269944.539990:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262545792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788269944.540013:0:40068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788269944.540027:0:40068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788269944.545534:0:40068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788269944.545557:0:40068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788269944.545654:0:40090:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788269944.545659:0:40090:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788269944.545679:0:40090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.545697:0:40090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 24 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.545706:0:40090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.545714:0:40090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.545749:0:40090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.545764:0:40090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 24 pid: 40070 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269944.545779:0:40090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262545920:0@lo:104: 00000100:00100000:1.0:1788269944.545841:0:40090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269944.545898:0:40090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 24 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.545907:0:40090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 24 pid: 40069 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269944.545920:0:40090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a652680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262546048:0@lo:104: 00000100:00100000:1.0:1788269944.545942:0:40090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.545967:0:40090:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143a46e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269944.545975:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262545920 00000100:00100000:2.0:1788269944.545983:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262545920 00000100:00100000:0.0:1788269944.546018:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546048 00000100:00100000:2.0:1788269944.546023:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269944.546025:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546048 00000100:00100000:2.0:1788269944.546033:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+4:40090:x1875136262545920:12345-0@lo:104: 00010000:00010000:2.0:1788269944.546131:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269944.546194:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269944.546201:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+4:40090:x1875136262545920:12345-0@lo:104: Request processed in 169us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.546208:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269944.546230:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269944.546231:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:42391:x1875136262545792:12345-0@lo:253:mount.lustre.0 Request processed in 6240us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.546240:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262546048:12345-0@lo:104: 00000100:00100000:1.0:1788269944.546246:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:2.0:1788269944.546251:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269944.546290:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788269944.546307:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+3:40090:x1875136262546048:12345-0@lo:104: Request processed in 58us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269944.546318:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788269944.546323:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269944.546331:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546340:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269944.546344:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546353:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269944.546372:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269944.546378:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269944.546406:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546413:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269944.546441:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546449:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676a00/0xc5f5d7a016e0763b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07642 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546460:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269944.546463:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546468:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269944.546471:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546478:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269944.546484:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269944.546489:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269944.546502:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546507:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269944.546521:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546528:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676200/0xc5f5d7a016e0762d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07634 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546538:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269944.546541:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269944.546542:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269944.546553:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262546176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269944.546591:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.546630:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269944.546739:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262546304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269944.546762:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269944.546793:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546176 00000100:00100000:1.0:1788269944.546796:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546176 00010000:00010000:1.0:1788269944.546813:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 24 pid: 40070 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269944.546830:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546304 00000100:00100000:1.0:1788269944.546832:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546304 00010000:00010000:1.0:1788269944.546841:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 25 pid: 40069 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269944.546851:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269944.546857:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e129e33-0062-408b-ba53-2e2ae2985734+25:3610:x1875136262546176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269944.546866:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269944.546871:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 25 pid: 40070 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546882:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 25 pid: 40070 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546895:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269944.546924:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e129e33-0062-408b-ba53-2e2ae2985734+25:3610:x1875136262546176:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.546931:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269944.546944:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269944.546956:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e129e33-0062-408b-ba53-2e2ae2985734+24:3608:x1875136262546304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269944.546967:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269944.546974:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 24 pid: 40069 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546983:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 24 pid: 40069 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.546999:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547007:0:40060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788269944.547019:0:40060:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001684324s 00010000:00010000:1.0:1788269944.547023:0:40060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547030:0:40060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547062:0:40060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547071:0:40060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547076:0:40060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269944.547080:0:40060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547087:0:40060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547101:0:40060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269944.547111:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269944.547138:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e129e33-0062-408b-ba53-2e2ae2985734+24:3608:x1875136262546304:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269944.547145:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269944.547188:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262546304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269944.547212:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262546176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269944.547286:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269944.547338:0:42391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e129e33-0062-408b-ba53-2e2ae2985734:42391:1875136262545792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269944.547348:0:42391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788269944.547351:0:42391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269944.547353:0:42391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269944.547354:0:42391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269944.547355:0:42391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269944.547356:0:42391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269944.547357:0:42391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269944.547359:0:42391:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269944.547360:0:42391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269944.547362:0:42391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788269944.547373:0:42391:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788269944.548371:0:40090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57400/0xc5f5d7a016e07642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0763b expref: 23 pid: 40070 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269944.548383:0:40090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262545920:0@lo:104: 00010000:00010000:0.0:1788269944.548395:0:40090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b56200/0xc5f5d7a016e07634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0762d expref: 22 pid: 40069 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269944.548403:0:40090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a652680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:40090:1875136262546048:0@lo:104: 00010000:00010000:0.0:1788269944.548419:0:40090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.548491:0:40090:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.548498:0:40090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269944.548504:0:40090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bf200/0xc5f5d7a016e076c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788269944.549524:0:42391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:2.0:1788269944.552062:0:42391:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788269944.552071:0:42391:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788269944.552110:0:42391:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788269944.552147:0:42391:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788269944.552162:0:42391:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788269944.552184:0:42391:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788269944.552791:0:42391:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788269944.553437:0:42391:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788269945.011158:0:42458:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788269945.011387:0:42458:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788269945.540648:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788269945.797097:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788269945.797105:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27b77a000 from 26 10000000:01000000:1.0:1788269945.797110:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788269945.797158:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.797170:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.797182:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269945.797206:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269945.797263:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269945.797318:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269945.797368:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546432 00000100:00100000:3.0:1788269945.797374:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546432 00000100:00100000:3.0:1788269945.797413:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788269945.797419:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262546432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269945.797430:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269945.797441:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b677c00/0xc5f5d7a016e076ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e076c7 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269945.797462:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b677c00/0xc5f5d7a016e076ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e076c7 expref: 23 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269945.797472:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b677c00/0xc5f5d7a016e076ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e076c7 expref: 23 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269945.797480:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677c00, rc 0) 00000100:00100000:3.0:1788269945.798741:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262546432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1317us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269945.798749:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788269945.799245:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269945.799261:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.799269:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269945.799324:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788269945.799356:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269945.799387:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788269945.799440:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546560 00000100:00100000:2.0:1788269945.799446:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546560 00000100:00100000:2.0:1788269945.799481:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788269945.799491:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262546560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788269945.799507:0:40068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788269945.799524:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788269945.799528:0:40068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 26 00000100:00100000:2.0:1788269945.799620:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262546560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269945.799630:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788269945.799644:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788269945.799708:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788269945.799715:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.799724:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269945.799732:0:40072:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788269945.799735:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c145155800 from 26 10000000:01000000:1.0:1788269945.799737:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788269945.799756:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.799764:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.799772:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269945.799786:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269945.799813:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269945.799838:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269945.799860:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546688 00000100:00100000:3.0:1788269945.799865:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546688 00000100:00100000:3.0:1788269945.799889:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788269945.799895:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262546688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269945.799902:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269945.799911:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b677800/0xc5f5d7a016e076dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e076d5 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269945.799924:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b677800/0xc5f5d7a016e076dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e076d5 expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269945.799930:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b677800/0xc5f5d7a016e076dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e076d5 expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269945.799936:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b677800, rc 0) 00000100:00100000:3.0:1788269945.799961:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262546688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269945.799965:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788269945.799987:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269945.799997:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.800002:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269945.800028:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788269945.800072:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269945.800091:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788269945.800260:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546816 00000100:00100000:2.0:1788269945.800266:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546816 00000100:00100000:2.0:1788269945.800309:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788269945.800317:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262546816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788269945.800326:0:40068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788269945.800335:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788269945.800337:0:40068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 26 00000100:00100000:2.0:1788269945.800408:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262546816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269945.800417:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788269945.800432:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262546816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788269945.800473:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788269945.800479:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269945.800487:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269946.564143:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269931/real 1788269931] req@ffff98c27fa4a680 x1875136262530304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269946 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269946.564182:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27fa4a680 x1875136262530304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269946 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269946.564194:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269931/real 1788269931] req@ffff98c27fa4b480 x1875136262530432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269946 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269946.564202:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262546944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788269946.564207:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27fa4b480 x1875136262530432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269946 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788269946.564236:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788269946.564244:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788269946.564249:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262530304:0@lo:8:kworker.0 00000100:00080000:2.0:1788269946.564255:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c247f7c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788269946.564270:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788269946.564273:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262530432:0@lo:8:kworker.0 00000100:00100000:3.0:1788269946.564302:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.564355:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262546944 00000100:00100000:2.0:1788269946.564363:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262546944 00000100:00100000:2.0:1788269946.564405:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269946.564414:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262546944:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788269946.564421:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269946.564425:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788269946.564427:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c275d9d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269946.564442:0:466:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 722 00000004:00000024:2.0:1788269946.564444:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446404096 avail 1300164608 00000100:00080000:0.0:1788269946.564446:0:466:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788269946.564451:0:466:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c275d9d000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269946.564467:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1410e0a80 x1875136262547200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269946.564482:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269946.564485:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788269946.564487:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c247f7c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788269946.564489:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262546944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269946.564491:0:466:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 722 00000100:00080000:0.0:1788269946.564494:0:466:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1788269946.564496:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788269946.564497:0:466:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c247f7c000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269946.564511:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262546944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269946.564515:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1410e1500 x1875136262547328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1788269946.564521:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269946.564535:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262547200:0@lo:8:kworker.0 00000100:00100000:2.0:1788269946.564563:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788269946.564565:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269946.564568:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788269946.564570:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269946.564576:0:466:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c27b5e2800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269946.564585:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262547584:0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.564588:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1410e3800 x1875136262547840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269946.564596:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262547328:0@lo:8:kworker.0 00000100:00100000:3.0:1788269946.564622:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.564629:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269946.564647:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262547072:0@lo:400:kworker.0 00000100:00100000:3.0:1788269946.564653:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262548224:0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.564658:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262547840:0@lo:8:kworker.0 00000100:00100000:0.0:1788269946.564679:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.564691:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269946.564698:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262547968:0@lo:400:kworker.0 00000100:00100000:3.0:1788269946.564713:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.564727:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547200 00000100:00100000:2.0:1788269946.564732:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547200 00000100:00100000:3.0:1788269946.564740:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788269946.564746:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269946.564752:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262547712:0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.564755:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547328 00000100:00100000:2.0:1788269946.564758:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547328 00000100:00100000:2.0:1788269946.564770:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547840 00000100:00100000:2.0:1788269946.564772:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547840 00000100:00100000:0.0:1788269946.564783:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262548480:0@lo:400:kworker.0 00000100:00100000:3.0:1788269946.564784:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.564785:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269946.564793:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262547200:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788269946.564804:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262548352:0@lo:400:kworker.0 00010000:00080000:2.0:1788269946.564816:0:41580:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 738 last 0 00000100:00100000:0.0:1788269946.564817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269946.564838:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269946.564843:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788269946.564850:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262547456:0@lo:400:kworker.0 00000020:00000080:2.0:1788269946.564860:0:41580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e076e3 00002000:00100000:2.0:1788269946.564874:0:41580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98c245cff800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788269946.564875:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547072 00000100:00100000:0.0:1788269946.564875:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788269946.564879:0:41580:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:3.0:1788269946.564881:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547072 00002000:00100000:2.0:1788269946.564883:0:41580:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788269946.564894:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262548096:0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.564917:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269946.564921:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788269946.564932:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3609:x1875136262547072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.564942:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548224 00000100:00100000:0.0:1788269946.564947:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548224 00002000:00080000:2.0:1788269946.564955:0:41580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788269946.564978:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3609:x1875136262547072:12345-0@lo:400:kworker.0 Request processed in 48us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.564978:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547968 00000100:00100000:0.0:1788269946.564983:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547968 00000100:00080000:2.0:1788269946.564984:0:41580:0:(import.c:65:import_set_state_nolock()) ffff98c245cfe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269946.564989:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788269946.564996:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548480 00000100:00100000:0.0:1788269946.565000:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548480 00000100:00100000:0.0:1788269946.565018:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548352 00000100:00100000:0.0:1788269946.565021:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548352 00000100:00100000:2.0:1788269946.565025:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3606:x1875136262547200:12345-0@lo:8:kworker.0 Request processed in 231us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269946.565027:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547456 00000100:00100000:3.0:1788269946.565033:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547456 00000100:00100000:2.0:1788269946.565034:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269946.565035:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548096 00000100:00100000:0.0:1788269946.565061:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548096 00000100:00100000:2.0:1788269946.565069:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547712 00000100:00100000:2.0:1788269946.565071:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547712 00000100:00100000:3.0:1788269946.565090:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788269946.565094:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269946.565097:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269946.565103:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262548224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.565105:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262547712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.565105:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262547968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.565152:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262547968:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.565158:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269946.565165:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262548224:12345-0@lo:400:kworker.0 Request processed in 62us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269946.565165:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262547712:12345-0@lo:400:kworker.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.565174:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788269946.565180:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269946.565184:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788269946.565185:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262548480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.565192:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269946.565195:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262547328:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788269946.565209:0:41580:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 738 last 0 00000100:00100000:3.0:1788269946.565217:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269946.565218:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262548480:12345-0@lo:400:kworker.0 Request processed in 34us (399us total) trans 0 rc 0/0 00000020:00000080:2.0:1788269946.565226:0:41580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e076ea 00000100:00100000:0.0:1788269946.565227:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269946.565232:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262548352:12345-0@lo:400:kworker.0 00002000:00100000:2.0:1788269946.565233:0:41580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98c245cfa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788269946.565241:0:41580:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:0.0:1788269946.565243:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00002000:00100000:2.0:1788269946.565244:0:41580:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788269946.565252:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262547456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269946.565291:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262548352:12345-0@lo:400:kworker.0 Request processed in 64us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269946.565302:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269946.565304:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262547456:12345-0@lo:400:kworker.0 Request processed in 51us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.565312:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269946.565321:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269946.565331:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262548096:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788269946.565336:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269946.565341:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269946.565343:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269946.565375:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262547584 00000100:00100000:0.0:1788269946.565379:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262547584 00002000:00080000:2.0:1788269946.565397:0:41580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1788269946.565398:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269946.565403:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262547584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788269946.565409:0:41580:0:(import.c:65:import_set_state_nolock()) ffff98c245cfd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269946.566018:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262548096:12345-0@lo:400:kworker.0 Request processed in 687us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269946.566024:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3606:x1875136262547328:12345-0@lo:8:kworker.0 Request processed in 824us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.566024:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262547584:12345-0@lo:400:kworker.0 Request processed in 617us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269946.566032:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269946.566054:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269946.566056:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269946.566071:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269946.566075:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262547840:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788269946.566090:0:41580:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 738 last 0 00010000:00080000:0.0:1788269946.566091:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e1500 x1875136262547328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269946.566099:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788269946.566104:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 6 00000020:00000080:2.0:1788269946.566106:0:41580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e076f1 00000100:00080000:0.0:1788269946.566111:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00002000:00100000:2.0:1788269946.566112:0:41580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98c245cfc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788269946.566115:0:41580:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000100:00080000:0.0:1788269946.566115:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00002000:00100000:2.0:1788269946.566117:0:41580:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788269946.566118:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c247f7c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788269946.566138:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00002000:00080000:2.0:1788269946.566141:0:41580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:0.0:1788269946.566142:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262547328:0@lo:8:kworker.0 00000004:00080000:1.0:1788269946.566151:0:40100:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:2.0:1788269946.566154:0:41580:0:(import.c:65:import_set_state_nolock()) ffff98c14379c800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788269946.566158:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e0a80 x1875136262547200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269946.566165:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788269946.566168:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1788269946.566172:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788269946.566174:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788269946.566176:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788269946.566185:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3606:x1875136262547840:12345-0@lo:8:kworker.0 Request processed in 108us (1492us total) trans 0 rc 0/0 00000004:00080000:0.0:1788269946.566188:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788269946.566191:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788269946.566191:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262547200:0@lo:8:kworker.0 00000004:00080000:1.0:1788269946.566216:0:40100:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738273176406ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788269946.566224:0:40100:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788269946.566245:0:40098:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788269946.566294:0:40098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738273254116ns, next at 0ns, rc = 0 00010000:00080000:0.0:1788269946.566297:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e3800 x1875136262547840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00080000:00080000:1.0:1788269946.566302:0:40098:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788269946.566303:0:40099:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x62:0x0] 00000100:00080000:0.0:1788269946.566311:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 6 00000100:00080000:0.0:1788269946.566315:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788269946.566320:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:2.0:1788269946.566322:0:40099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:40099:1875136262548736:0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788269946.566322:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788269946.566336:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00080000:3.0:1788269946.566341:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e2a00 x1875136262547456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269946.566354:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262547456:0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.566392:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262547840:0@lo:8:kworker.0 00000100:00100000:2.0:1788269946.566409:0:40099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788269946.566425:0:40101:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x63:0x0] 00000100:00100000:2.0:1788269946.566427:0:40099:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8840 going to sleep for 11 seconds 00000004:00080000:2.0:1788269946.566437:0:40818:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788269946.566445:0:40101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144838000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:40101:1875136262548992:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788269946.566469:0:40101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788269946.566480:0:40818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 738273440308ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788269946.566483:0:40101:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109300 going to sleep for 11 seconds 00080000:00080000:2.0:1788269946.566484:0:40818:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788269946.566514:0:40819:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x82:0x0] 00000100:00100000:0.0:1788269946.566532:0:40819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:40819:1875136262549248:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788269946.566554:0:40819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269946.566567:0:40819:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269946.566576:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548736 00000100:00100000:0.0:1788269946.566577:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548992 00000100:00100000:2.0:1788269946.566580:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548736 00000100:00100000:0.0:1788269946.566580:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548992 00000100:00100000:0.0:1788269946.566599:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549248 00000100:00100000:0.0:1788269946.566602:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549248 00000100:00100000:2.0:1788269946.566606:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269946.566611:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:40101:x1875136262548992:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788269946.566615:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269946.566617:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269946.566635:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262548608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269946.566656:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269946.566687:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548608 00000100:00100000:0.0:1788269946.566690:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548608 00000100:00100000:0.0:1788269946.566711:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269946.566717:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262548608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269946.566733:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788269946.566765:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262548608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.566774:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788269946.566799:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144099f80 x1875136262548608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269946.566812:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262548608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269946.566842:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262548864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269946.566858:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262549120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788269946.566863:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.566879:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788269946.566885:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e0380 x1875136262547712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269946.566894:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262547712:0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.566904:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262548864 00010000:00080000:0.0:1788269946.566904:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14483bb80 x1875136262548352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269946.566907:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262548864 00000100:00100000:0.0:1788269946.566912:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262548352:0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.566918:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549120 00000100:00100000:2.0:1788269946.566920:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549120 00010000:00080000:0.0:1788269946.566926:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14483b800 x1875136262548224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269946.566929:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269946.566934:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262548224:0@lo:400:kworker.0 00000100:00100000:0.0:1788269946.566943:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262547584:0@lo:400:kworker.0 00000100:00100000:2.0:1788269946.566973:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262548864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269946.566985:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788269946.567014:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262548864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269946.567020:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269946.567032:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269946.567056:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262549120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788269946.567066:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788269946.567092:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262549120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269946.567097:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788269946.567184:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14483ad80 x1875136262548864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269946.567202:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262548864:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788269946.567205:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14483a680 x1875136262549120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269946.567222:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262549120:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788269946.568136:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e2300 x1875136262548096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269946.568150:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262548096:0@lo:400:kworker.0 00000100:00100000:3.0:1788269946.568163:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262547072:0@lo:400:kworker.0 00010000:00080000:3.0:1788269946.568176:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1410e1c00 x1875136262547968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269946.568184:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262547968:0@lo:400:kworker.0 00010000:00080000:3.0:1788269946.568222:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144838380 x1875136262548480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269946.568232:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262548480:0@lo:400:kworker.0 00000004:00080000:1.0:1788269946.569462:0:40055:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788269946.569479:0:40055:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788269946.570203:0:41579:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788269946.570210:0:41579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -62 00002000:02000040:3.0:1788269946.570216:0:41579:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:100 to 0x2c0000401:161) 00000004:00080000:0.0:1788269946.570400:0:40807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1788269946.577807:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.577821:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.577838:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.577844:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.577850:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.577869:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.577885:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.577892:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.577926:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269946.578388:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.578395:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578403:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa0:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.578406:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.578410:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578420:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578428:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578436:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578462:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269946.578588:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269946.578595:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578603:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.578608:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578621:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578643:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578651:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e076f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578678:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.578681:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578688:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.578691:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269946.578696:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.578699:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578703:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578715:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578716:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.578723:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.578730:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578732:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e076ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578745:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578751:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.578753:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578754:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.578757:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.578773:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.578794:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.578809:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.578815:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578822:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.578827:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578835:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578844:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578852:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07706 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.578864:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.578866:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.578868:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.579072:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.579080:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.579091:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.579096:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.579101:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.579111:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.579120:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.579128:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.579145:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.579165:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.579171:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.579180:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.579190:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.579343:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.579390:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.579499:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.579507:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.579518:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.579521:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.579525:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.579537:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.579546:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.579554:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.579570:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.579578:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.579782:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.579789:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.579792:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.579796:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.579806:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.579810:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.579817:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.579828:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.579835:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f2881b7/0xc5f5d7a016e07714 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.579848:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.579849:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.579851:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.580255:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.580271:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.580280:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.580284:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.580289:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.580403:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.580414:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.580422:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.580441:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.580470:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.580477:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.580486:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.580491:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.580500:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.580512:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.580519:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0771b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.580534:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.580536:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.580538:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.580555:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.580565:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978737c6/0xc5f5d7a016e0770d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.580577:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.580579:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.580580:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.583601:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.583615:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.583631:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9b:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.583636:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.583643:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.583656:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.583667:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.583681:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.583703:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.583725:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.583735:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.583746:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.583750:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.583761:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.583779:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.583788:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07722 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.583807:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.583810:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.583812:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.586055:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.586067:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586081:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.586086:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.586091:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586105:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586125:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586133:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586153:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.586231:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.586240:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.586249:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.586254:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.586274:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.586307:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.586314:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003232294f/0xc5f5d7a016e07729 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.586332:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.586334:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.586336:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.586495:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.586508:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586517:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.586520:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.586524:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586533:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586540:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586547:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586564:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.586593:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.586601:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.586611:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.586615:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.586624:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.586636:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.586644:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07730 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.586659:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.586661:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.586663:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.586808:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.586814:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586823:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.586826:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.586830:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586839:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586847:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586863:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.586887:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.587288:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.587295:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.587315:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.587319:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.587329:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.587341:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.587349:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5206753/0xc5f5d7a016e07737 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.587364:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.587366:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.587368:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.587473:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.587479:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.587488:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.587491:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.587495:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.587505:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.587518:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.587526:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.587542:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.587552:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.587559:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.587569:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.587573:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.587583:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.587595:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.587602:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11b5e47/0xc5f5d7a016e0773e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.587617:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.587619:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.587621:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.591416:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.591432:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.591449:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.591454:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.591459:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.591473:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.591482:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.591490:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.591514:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.591540:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.591549:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.591560:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.591566:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.591576:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.591594:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.591603:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07745 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.591626:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.591628:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.591630:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.592109:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.592116:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592125:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.592128:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.592131:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592144:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592152:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592159:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592177:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.592191:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.592199:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592208:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.592213:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592229:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592243:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592249:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0774c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592273:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.592275:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.592278:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.592523:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.592530:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592538:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x94:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.592542:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.592546:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592555:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592563:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592582:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.592600:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.592628:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.592635:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592644:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.592647:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592655:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592666:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592678:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e07753 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.592693:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.592696:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.592698:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.595173:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.595185:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595199:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x93:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.595203:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.595209:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595222:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595232:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595240:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595268:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.595297:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.595305:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595315:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.595320:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595328:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595345:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595352:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0775a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595368:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.595371:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.595372:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.595568:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.595574:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595582:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x92:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.595585:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.595590:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595599:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595607:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595615:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595639:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.595666:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.595686:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595696:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.595701:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595710:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595722:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595730:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e07761 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595743:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.595745:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.595746:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.595868:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.595875:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595885:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x91:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.595888:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.595891:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595897:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595903:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595907:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.595921:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.595948:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.595954:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595962:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.595966:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595981:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.595993:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596016:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e07768 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596032:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.596035:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.596074:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.596150:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.596157:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596163:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x90:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.596166:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.596169:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596175:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596188:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596193:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596209:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.596230:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.596236:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596244:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.596247:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596256:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596283:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596296:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e0776f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596309:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.596311:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.596313:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.596611:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.596615:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596621:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8f:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.596623:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.596626:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596632:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596638:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596646:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596665:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.596690:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.596696:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596714:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.596718:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596727:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596739:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596747:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e07776 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596766:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.596769:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.596771:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.596891:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.596897:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596906:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8e:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.596908:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.596912:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596922:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596930:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596937:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.596957:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.596978:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.596984:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.596992:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.596996:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597005:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597019:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597024:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0777d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597035:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.597037:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.597056:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.597240:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.597248:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597274:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8d:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.597278:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.597283:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597295:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597304:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597311:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597329:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.597348:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.597364:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597372:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.597377:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597401:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597413:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597421:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597438:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.597440:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.597442:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.597595:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.597602:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597612:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.597615:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.597619:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597627:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597635:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597643:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597660:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.597678:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.597682:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597689:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.597692:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597697:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597705:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597714:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e0778b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597725:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.597726:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.597728:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.597881:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.597888:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597897:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.597900:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.597905:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597915:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597929:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597936:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.597954:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.597973:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.597979:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.597987:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.597991:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.598000:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.598013:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.598021:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e07792 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.598035:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.598054:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.598056:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.599532:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.599542:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599555:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8a:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.599560:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.599565:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599577:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599585:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599594:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599623:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.599662:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.599676:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599682:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.599689:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599695:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599706:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599710:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599727:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.599729:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.599731:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.599887:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.599892:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599898:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x89:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.599901:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.599911:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599918:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599924:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599928:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.599939:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.599956:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.599961:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599967:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.599970:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599980:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599988:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.599992:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e077a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600002:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.600003:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.600005:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.600161:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.600167:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600173:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x88:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.600177:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.600180:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600189:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600196:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600202:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600216:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.600235:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.600242:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600251:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.600255:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600274:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600282:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600294:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e077a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600310:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.600313:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.600315:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.600505:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.600510:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600517:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x87:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.600519:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.600522:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600528:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600534:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600539:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.600557:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.600582:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.600588:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600599:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.600603:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600612:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600626:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600634:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e077ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.600651:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.600653:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.600655:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.601935:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.601943:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.601952:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x86:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.601955:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.601958:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.601966:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.601971:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.601976:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.601992:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.602223:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.602229:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602237:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.602241:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602250:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602274:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602282:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e077b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602297:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.602298:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.602300:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.602503:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.602508:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602513:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x85:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.602516:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.602518:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602525:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602536:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602543:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602567:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.602667:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.602673:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602681:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.602684:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602692:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602703:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602710:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e077bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602722:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.602725:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.602726:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.602860:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.602866:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602874:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x84:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.602877:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.602882:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602892:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602899:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602906:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.602944:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.602952:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.602957:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602965:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.602968:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602981:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.602993:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.603000:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e077c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.603012:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.603014:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.603015:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.603430:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.603436:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603444:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x83:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.603447:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.603452:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603460:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603468:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603475:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603492:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.603507:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.603513:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603520:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.603522:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603528:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603539:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603543:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e077ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603554:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.603555:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.603556:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.603699:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.603705:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603713:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x82:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.603716:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.603720:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603729:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603737:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603744:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.603769:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.603789:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.603794:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603802:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.603806:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603820:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603830:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603838:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000616431f9/0xc5f5d7a016e077d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.603856:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.603858:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.603860:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788269946.604011:0:41579:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:99 00000100:00100000:0.0:1788269946.604146:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:40101:x1875136262548992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 37531us (37675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.604157:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269946.604176:0:40101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144838000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:40101:1875136262548992:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788269946.604192:0:40101:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0xa1:0x0] from OST, last_created [0x2c0000401:0xa1:0x0]last_used is [0x2c0000401:0x63:0x0] 00000100:00100000:1.0:1788269946.604233:0:40101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:40101:1875136262549376:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788269946.604254:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269946.604278:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:40099:x1875136262548736:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788269946.604288:0:40101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269946.604318:0:40101:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269946.604334:0:41578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788269946.604342:0:41578:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788269946.604509:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549376 00000100:00100000:0.0:1788269946.604546:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549376 00000100:00100000:1.0:1788269946.604589:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269946.604599:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:40819:x1875136262549248:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788269946.605173:0:41579:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788269946.605179:0:41579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -63 00002000:02000040:2.0:1788269946.605184:0:41579:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:99 to 0x280000401:161) 00002000:00010000:2.0:1788269946.609763:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.609776:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.609794:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.609799:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.609806:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.609824:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.609839:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.609847:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610182:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.610195:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788269946.610200:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610212:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.610216:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610234:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610255:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610279:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2fca655/0xc5f5d7a016e077d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610296:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.610297:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.610299:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.610672:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.610680:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610690:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.610693:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.610699:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610708:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610717:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610724:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.610748:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.610982:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.610989:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.610999:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.611003:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611013:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611027:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611035:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bab72ef/0xc5f5d7a016e077df lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611086:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.611088:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.611091:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.611233:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.611240:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611249:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.611253:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.611273:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611284:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788269946.611289:0:42623:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00010000:00010000:1.0:1788269946.611294:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788269946.611298:0:42623:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -31 00002000:02000040:2.0:1788269946.611306:0:42623:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:131 to 0x2c0000400:161) 00010000:00010000:1.0:1788269946.611307:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.611325:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788269946.612092:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.612099:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.612108:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.612111:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.612115:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.612124:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.612129:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.612134:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.612146:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269946.612564:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269946.612571:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612580:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.612585:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612593:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612607:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612614:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e077e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612631:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.612634:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612644:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.612647:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612655:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612664:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612909:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e077ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.612926:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.612928:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.612930:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.612937:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.613768:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.613777:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613790:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.613794:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.613798:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613806:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613813:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613818:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613830:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.613966:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.613970:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613976:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.613979:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.613987:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.614002:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.614009:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b432da3f/0xc5f5d7a016e077f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.614024:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.614026:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.614029:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.616562:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.616575:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.616592:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.616597:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.616604:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.616617:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.616627:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.616636:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.616662:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.616693:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269946.616702:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.616713:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269946.616717:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.616726:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.616744:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.616765:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e077fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.616784:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.616787:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.616788:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.617000:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.617005:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617011:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.617013:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.617016:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617022:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617027:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617031:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617064:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.617076:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.617082:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.617088:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.617092:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.617107:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.617119:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.617127:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1383ec9/0xc5f5d7a016e07802 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.617144:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.617145:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.617147:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269946.617325:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.617330:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617352:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.617356:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.617360:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617370:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617377:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617385:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.617405:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.617568:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269946.617573:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.617580:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269946.617591:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.617603:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.617613:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.617621:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e07809 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.617635:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.617637:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.617638:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.618063:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.618069:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618078:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.618082:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.618087:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618097:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618105:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618113:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618133:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.618167:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269946.618199:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618208:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269946.618211:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618218:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618227:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618232:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f2881b7/0xc5f5d7a016e07810 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618252:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.618255:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.618269:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.618418:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.618424:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618433:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.618437:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.618441:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618451:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618459:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618466:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618486:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.618507:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.618514:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618524:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b57400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.618529:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618537:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618550:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269946.618557:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.618558:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d11f3482/0xc5f5d7a016e07817 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618566:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618575:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa1:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.618578:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.618581:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.618582:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618585:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.618589:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.618593:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618599:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618613:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618629:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.618638:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.618643:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618651:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.618655:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618663:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618675:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618683:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e0cd87b/0xc5f5d7a016e0781e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618699:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.618702:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.618705:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.618726:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.618733:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618743:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.618746:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.618750:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618758:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618765:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618772:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.618789:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.618831:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269946.618836:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618858:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b57600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269946.618861:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618867:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618877:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618882:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e58e1f/0xc5f5d7a016e07825 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.618892:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.618894:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.618895:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.618902:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.618909:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618922:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa0:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.618925:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.618929:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618939:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618946:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618953:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.618969:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.619000:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.619005:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619013:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.619017:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619026:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619063:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619071:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0782c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619087:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.619089:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.619092:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.619093:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.619103:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.619125:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.619128:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.619132:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.619143:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.619150:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.619158:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.619177:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.619194:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.619199:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619207:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.619210:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619218:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619229:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619237:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07833 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619255:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.619269:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.619271:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.619484:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.619492:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.619500:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9f:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.619504:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.619508:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269946.619515:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.619519:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619523:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619548:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.619549:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619556:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.619565:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619568:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619587:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.619596:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.619597:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619608:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619625:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269946.619735:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269946.619741:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619766:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.619770:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619778:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.619789:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.619791:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.619798:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619802:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e3c590/0xc5f5d7a016e0783a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.619814:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.619820:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619826:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.619830:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619830:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.619833:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.619851:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.619859:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eadbe29/0xc5f5d7a016e07841 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.619876:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.619879:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.619882:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.619900:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.619907:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619916:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x94:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.619919:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x94:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1788269946.619929:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.619933:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.619937:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619952:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.619953:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9e:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.619961:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.619968:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.619977:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619981:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.619992:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.619996:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620004:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.620031:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269946.620068:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788269946.620087:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269946.620093:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620101:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b57200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.620105:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620115:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620127:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620136:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.620139:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620151:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.620155:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620163:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620174:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620197:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0784f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.620212:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.620214:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.620216:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.620460:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.620466:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620475:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9d:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.620478:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.620483:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620492:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620500:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620507:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620527:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788269946.620757:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.620764:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620773:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9c:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.620777:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.620781:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620789:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620796:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620803:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620816:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269946.620823:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269946.620827:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620834:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.620844:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620852:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620862:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620874:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097520ddb/0xc5f5d7a016e07856 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620888:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.620891:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620897:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.620900:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620907:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620915:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620922:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b24b7941/0xc5f5d7a016e0785d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.620931:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.620932:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.620934:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.621123:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.621129:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621139:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9b:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.621142:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.621149:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621151:0:41579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095839375/0xc5f5d7a016e07848 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621172:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621182:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621189:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621214:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.621225:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.621229:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621236:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.621240:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621247:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621271:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.621278:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621286:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e648f120/0xc5f5d7a016e07864 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621300:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.621302:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.621305:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.621325:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.621410:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.621416:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621435:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x93:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.621437:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.621440:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621447:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621452:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621461:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621476:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.621499:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.621505:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269946.621507:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.621518:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621519:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.621527:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621532:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9a:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.621540:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.621548:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621554:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621559:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621571:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621572:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621585:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621589:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027bd8b47/0xc5f5d7a016e0786b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621619:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.621625:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.621627:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.621630:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621639:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.621642:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621650:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621661:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621669:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf2794a/0xc5f5d7a016e07872 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621686:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.621689:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.621690:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.621691:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.621695:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621704:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x92:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.621707:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.621712:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621723:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621732:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621740:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621755:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.621775:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.621780:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621787:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.621790:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621798:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621810:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621818:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000395ce04d/0xc5f5d7a016e07879 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621833:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.621849:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.621856:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.621858:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.621862:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.621867:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x99:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.621870:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.621874:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621882:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621889:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621896:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.621913:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.621921:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.621946:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621955:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.621960:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621968:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621981:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.621988:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e07880 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269946.621991:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.621996:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622005:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622008:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622010:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.622015:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x91:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1788269946.622018:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.622022:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622032:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622060:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622068:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622085:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.622097:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.622102:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622109:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.622113:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622125:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622135:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622141:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df4d5f6/0xc5f5d7a016e07887 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622157:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622160:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622162:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.622217:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.622223:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622231:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x98:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.622234:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.622239:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622249:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622257:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622281:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622295:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.622313:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.622318:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622325:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.622328:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622361:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622379:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622386:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146707bf/0xc5f5d7a016e0788e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622401:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.622404:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.622406:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.622416:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.622423:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.622433:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x90:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.622436:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.622439:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.622446:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.622451:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.622455:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.622467:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.622482:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.622489:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622497:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5da00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.622501:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622509:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269946.622515:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269946.622521:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622521:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622529:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x97:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.622529:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d0470a9/0xc5f5d7a016e07895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622533:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269946.622537:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622543:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.622545:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622546:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622548:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.622554:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622561:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.622582:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.622591:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.622595:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622601:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.622605:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622612:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622622:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622630:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0789c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.622643:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622645:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.622647:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.623117:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.623124:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623133:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8f:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.623137:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.623141:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269946.623144:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.623153:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623158:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623161:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x96:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.623167:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.623175:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623177:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623203:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623204:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623223:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623229:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623237:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269946.623242:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788269946.623244:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269946.623250:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.623251:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623255:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.623273:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269946.623279:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623285:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.623292:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.623293:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623306:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.623334:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623335:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623348:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2fca655/0xc5f5d7a016e078aa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623368:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.623370:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e078a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623372:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.623376:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.623391:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.623393:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.623396:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.623500:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.623506:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623515:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8e:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.623518:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.623522:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623531:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623539:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623546:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623562:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.623568:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.623573:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623580:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.623583:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623590:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623598:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623603:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004316307a/0xc5f5d7a016e078b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623613:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.623614:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.623615:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.623649:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.623653:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623662:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x95:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.623664:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.623667:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623677:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623685:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623693:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.623710:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.623719:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.623725:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623733:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.623737:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623744:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623767:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623775:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e078b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623790:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.623792:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.623794:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.623954:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.623960:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623968:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8d:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.623972:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.623976:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623986:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.623994:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624002:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624020:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.624052:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.624058:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624067:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.624071:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624079:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624097:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624104:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e078bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624119:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.624121:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.624123:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.624317:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.624323:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624331:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x94:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.624334:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.624339:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624354:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624361:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269946.624366:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.624369:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624371:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624379:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.624382:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.624386:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624388:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.624394:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.624395:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624398:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624404:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624405:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.624408:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624412:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624416:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624426:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624429:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.624434:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.624435:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707c14ee/0xc5f5d7a016e078c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624437:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624444:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.624447:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624449:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.624450:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.624452:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.624455:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624465:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624472:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e078cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624484:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.624486:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.624488:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.624755:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.624762:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624770:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x93:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.624774:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.624778:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624787:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624795:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624802:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624818:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.624825:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.624829:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624842:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.624847:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624854:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624865:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269946.624871:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.624877:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624878:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e078d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624886:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.624889:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.624893:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.624894:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624896:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.624899:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.624903:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624910:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624929:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.624946:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.624952:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.624957:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624964:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.624968:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624976:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624987:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.624995:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e078db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625009:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625011:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625013:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.625362:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.625369:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.625377:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8a:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.625380:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.625384:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.625394:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.625402:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.625408:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.625427:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.625450:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.625456:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625464:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.625469:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625476:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625488:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625495:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e078e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625510:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625513:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625514:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.625555:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.625561:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625569:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x92:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.625572:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.625576:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625590:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625598:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625605:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625619:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.625626:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.625630:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625636:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.625640:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269946.625643:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.625651:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.625654:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.625671:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x89:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.625674:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.625675:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.625684:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625689:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb6578ef/0xc5f5d7a016e078e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.625702:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625708:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625712:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.625715:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625715:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.625724:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.625739:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.625743:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.625748:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625757:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.625761:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625769:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625780:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625788:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5206753/0xc5f5d7a016e078f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.625801:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625803:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.625805:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.626087:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.626094:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269946.626102:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.626112:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626114:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x91:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.626123:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.626131:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x88:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.626131:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626138:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.626148:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626150:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626171:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626172:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626192:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626194:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626214:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626221:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.626242:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269946.626332:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269946.626337:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626345:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.626349:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626357:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626374:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626380:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8d68754/0xc5f5d7a016e078f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626392:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.626395:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626401:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.626404:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626411:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626420:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626427:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003232294f/0xc5f5d7a016e078fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626460:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.626463:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.626465:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.626471:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.626495:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.626502:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626510:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x87:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.626514:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.626518:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626527:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626535:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269946.626540:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.626544:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626548:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626564:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x90:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.626568:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.626568:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.626576:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626586:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626595:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626602:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626616:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269946.626706:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269946.626712:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626719:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.626723:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626736:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626750:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626757:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000978737c6/0xc5f5d7a016e07905 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626777:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.626781:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626812:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.626817:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626825:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626837:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626845:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e0790c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269946.626858:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.626866:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626870:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.626874:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.626878:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x86:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.626879:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.626884:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.626887:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.626890:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626902:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626910:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626918:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.626938:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.626977:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.626983:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269946.626988:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.626991:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.626995:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.626995:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627003:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627003:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8f:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.627007:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.627012:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627016:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627021:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627023:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11b5e47/0xc5f5d7a016e07913 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627030:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627055:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627058:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627060:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627062:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.627069:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.627072:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.627076:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627083:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.627086:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627094:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627104:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627111:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000782eb1e2/0xc5f5d7a016e0791a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627132:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627136:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627139:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269946.627181:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788269946.627188:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.627197:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x85:0x0].0x0 since=738s v=(0 0) 00010000:00010000:3.0:1788269946.627200:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269946.627205:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.627214:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.627222:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.627230:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.627249:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.627282:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.627287:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627294:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.627298:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627313:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627325:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627333:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e0cd87b/0xc5f5d7a016e07921 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627347:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627349:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627351:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.627491:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788269946.627491:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.627498:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627498:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627507:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x84:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.627511:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.627511:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8e:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.627515:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.627516:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627519:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627526:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627528:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627534:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627535:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627543:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627544:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627558:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269946.627565:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269946.627649:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.627649:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269946.627656:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627656:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627665:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.627665:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.627670:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627670:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627680:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627680:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627692:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627696:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627699:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d402a291/0xc5f5d7a016e0792f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.627704:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e07928 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627713:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627715:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.627716:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.627717:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.627718:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.627720:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.627801:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.627809:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627817:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x83:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.627821:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.627826:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627835:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627843:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627851:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627864:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.627954:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.627959:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627967:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5cc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.627971:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627980:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.627992:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628000:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea933191/0xc5f5d7a016e07936 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628020:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.628022:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.628024:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.628110:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.628117:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628124:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8d:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.628127:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.628131:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628140:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628148:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628155:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628173:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.628292:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.628298:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628305:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.628309:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628317:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628328:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628336:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e0793d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628351:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.628353:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.628355:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269946.628394:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.628418:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628426:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x82:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.628430:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.628434:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628443:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628451:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628458:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.628476:0:41579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.628493:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.628498:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.628506:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.628509:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.628517:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.628528:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.628536:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e07944 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.628555:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.628557:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.628559:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788269946.628715:0:41579:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:98 00000100:00100000:2.0:1788269946.628794:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:40099:x1875136262548736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24518us (62381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269946.628802:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269946.628830:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788269946.628840:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:40101:x1875136262549376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788269946.628873:0:41579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 162 00000100:00100000:2.0:1788269946.630632:0:40099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:40099:1875136262548736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788269946.630649:0:40099:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0xa1:0x0] from OST, last_created [0x280000401:0xa1:0x0]last_used is [0x280000401:0x62:0x0] 00000100:00100000:2.0:1788269946.630688:0:40099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:40099:1875136262549504:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788269946.630729:0:40099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269946.630758:0:40099:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a13c0 going to sleep for 11 seconds 00002000:00010000:2.0:1788269946.630880:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269946.630888:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.630901:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8c:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1788269946.630906:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269946.630912:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.630925:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.630935:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.630944:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.630967:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.630992:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269946.631001:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.631010:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ca00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269946.631015:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.631023:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.631082:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.631091:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b18d9164/0xc5f5d7a016e0794b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.631108:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.631110:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.631112:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269946.631311:0:41578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788269946.631320:0:41578:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788269946.631779:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549504 00000100:00100000:0.0:1788269946.631786:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549504 00000100:00100000:3.0:1788269946.631864:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269946.631877:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:40099:x1875136262549504:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788269946.631915:0:42634:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 162 00002000:00010000:0.0:1788269946.632034:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.632067:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632075:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8b:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.632077:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.632082:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632091:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632098:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632103:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632134:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.632312:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.632318:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.632327:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.632332:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.632349:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.632363:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.632372:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007451c501/0xc5f5d7a016e07952 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.632385:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.632387:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.632388:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.632486:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.632493:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632502:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8a:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.632505:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.632510:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632520:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632543:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632552:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632583:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.632691:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.632696:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632705:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.632709:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632717:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632732:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632739:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e07959 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.632755:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.632759:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.632761:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788269946.632910:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803777 is committed 00000001:00100000:0.0:1788269946.632979:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788269946.632985:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788269946.633065:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.633071:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633079:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x89:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.633083:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.633087:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633095:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633103:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633110:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633131:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269946.633137:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269946.633145:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269946.633146:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:40101:x1875136262549376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4305us (28855us total) trans 25769803777 rc 0/0 00000100:00100000:2.0:1788269946.633162:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788269946.633163:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269946.633168:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.633178:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.633192:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.633200:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e07960 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269946.633205:0:40101:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:2.0:1788269946.633213:0:40101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:40101:1875136262549376:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788269946.633215:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.633219:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269946.633223:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788269946.633228:0:40101:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa1:0x0]-[0x2c0000401:0xc1:0x0] 00002000:00010000:0.0:1788269946.633449:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.633454:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633461:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x88:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.633463:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.633466:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633473:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633478:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633483:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633496:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269946.633518:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.633523:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.633531:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.633535:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.633549:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.633562:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.633570:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9deb5a9/0xc5f5d7a016e07967 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.633585:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.633588:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.633590:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.633714:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.633720:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633729:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x87:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.633732:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.633736:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633746:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633753:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633762:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633776:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.633866:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.633872:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633879:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.633883:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633891:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633909:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633916:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000544c7fec/0xc5f5d7a016e0796e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.633932:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.633934:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.633936:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.635539:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.635548:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.635557:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x86:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.635560:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.635564:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.635572:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.635578:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.635583:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.635602:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788269946.636204:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.636210:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636220:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x85:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.636223:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.636228:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636239:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636247:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636254:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636289:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269946.636410:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269946.636417:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636426:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.636431:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636440:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636456:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636470:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e07975 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636488:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269946.636492:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269946.636497:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.636500:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269946.636504:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636511:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636522:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636530:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0797c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269946.636548:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.636550:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269946.636553:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.636778:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.636786:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636796:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x84:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.636800:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.636805:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636814:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636822:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636830:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636843:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269946.636925:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269946.636930:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636938:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269946.636941:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636949:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636960:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636973:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e07983 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.636987:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.636990:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269946.636991:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269946.637229:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269946.637235:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.637244:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x83:0x0].0x0 since=738s v=(0 0) 00010000:00010000:0.0:1788269946.637248:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269946.637251:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.637324:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.637333:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.637340:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269946.637360:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269946.637373:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269946.637382:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.637392:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1c00 already unused, calling callback (ffffffffc0e7f230) 00002000:00080000:0.0:1788269946.637392:0:42623:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:130 00010000:00010000:1.0:1788269946.637398:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.637408:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.637423:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.637430:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3be535/0xc5f5d7a016e0798a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269946.637446:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.637449:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269946.637451:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269946.637477:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:40819:x1875136262549248:12345-0@lo:5:osp-pre-1-1.0 Request processed in 32877us (70918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.637487:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269946.637545:0:40819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:40819:1875136262549248:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788269946.637561:0:40819:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0xa1:0x0] from OST, last_created [0x2c0000400:0xa1:0x0]last_used is [0x2c0000400:0x82:0x0] 00000100:00100000:0.0:1788269946.637603:0:40819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:40819:1875136262549632:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788269946.637637:0:40819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269946.637667:0:40819:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269946.637676:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549632 00000100:00100000:1.0:1788269946.637683:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549632 00000100:00100000:1.0:1788269946.637724:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269946.637734:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:40819:x1875136262549632:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788269946.637765:0:41578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 162 00000001:00080000:3.0:1788269946.639275:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803778 is committed 00000001:00100000:3.0:1788269946.639338:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788269946.639474:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:40099:x1875136262549504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7598us (8744us total) trans 25769803778 rc 0/0 00000100:00100000:2.0:1788269946.639489:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269946.639527:0:40099:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803778 gen 2 00000100:00100000:2.0:1788269946.639534:0:40099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:40099:1875136262549504:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788269946.639547:0:40099:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa1:0x0]-[0x280000401:0xc1:0x0] 00000100:00100000:0.0:1788269946.640965:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:40819:x1875136262549632:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3229us (3325us total) trans 25769803778 rc 0/0 00000100:00100000:0.0:1788269946.640975:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269946.641165:0:40819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:40819:1875136262549632:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788269946.641177:0:40819:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0xa1:0x0]-[0x2c0000400:0xc1:0x0] 00000100:00100000:1.0:1788269946.641212:0:40819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a651500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:40819:1875136262549760:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788269946.641248:0:40819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269946.641282:0:40819:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269946.641343:0:40085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549760 00000100:00100000:0.0:1788269946.641350:0:40085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549760 00000100:00100000:0.0:1788269946.641421:0:40085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269946.641430:0:40085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:40819:x1875136262549760:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788269946.641477:0:40085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:40819:x1875136262549760:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269946.641484:0:40085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788269946.641515:0:40819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a651500 x1875136262549760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788269962 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269946.641534:0:40819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:40819:1875136262549760:0@lo:900:osp-pre-1-1.0 00000001:02000400:0.0:1788269947.288298:0:42751:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788269947.588134:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788269947.701739:0:42803:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788269947.701921:0:42803:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788269948.106964:0:42853:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788269948.107243:0:42853:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788269948.202741:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.205087:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253052800 00000100:00100000:2.0:1788269948.205102:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253052800 00000100:00100000:2.0:1788269948.205157:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:2.0:1788269948.205166:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875136253052800:12345-192.168.201.42@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788269948.205195:0:40068:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 460bc5f4-1ddb-4a00-850f-bc38bcba8857@192.168.201.42@tcp t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:2.0:1788269948.205226:0:40068:0:(genops.c:1385:class_connect()) connect: client 460bc5f4-1ddb-4a00-850f-bc38bcba8857, cookie 0xc5f5d7a016e07991 00000100:00080000:2.0:1788269948.205520:0:40068:0:(import.c:65:import_set_state_nolock()) ffff98c142bd6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269948.205658:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+5:2399:x1875136253052800:12345-192.168.201.42@tcp:250:mount.lustre.0 Request processed in 492us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.205665:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:3.0:1788269948.209504:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.209564:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253052928 00000100:00100000:1.0:1788269948.209574:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253052928 00000100:00100000:1.0:1788269948.209631:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:1.0:1788269948.209642:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+5:29726:x1875136253052928:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269948.209657:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269948.209674:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e07998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101406 expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.209702:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e07998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101406 expref: 6 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.209713:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e07998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101406 expref: 6 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.209723:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f000, rc 0) 00000100:00100000:1.0:1788269948.209783:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+6:29726:x1875136253052928:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 142us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.209790:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:1.0:1788269948.211186:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.211256:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053056 00000100:00100000:2.0:1788269948.211263:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053056 00000100:00100000:2.0:1788269948.211308:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:2.0:1788269948.211317:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+6:29726:x1875136253053056:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788269948.211415:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+6:29726:x1875136253053056:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 99us (231us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269948.211427:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:0.0:1788269948.212189:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.212256:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053184 00000100:00100000:3.0:1788269948.212262:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053184 00000100:00100000:3.0:1788269948.212291:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788269948.212299:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+6:29726:x1875136253053184:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788269948.212309:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269948.212324:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0799f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610140d expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.212361:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0799f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610140d expref: 7 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.212373:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0799f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610140d expref: 7 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.212382:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676800, rc 0) 00000100:00100000:3.0:1788269948.212412:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+7:29726:x1875136253053184:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 115us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.212417:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788269948.215962:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.216014:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053312 00000100:00100000:1.0:1788269948.216023:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053312 00000100:00100000:1.0:1788269948.216095:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788269948.216107:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+7:29726:x1875136253053312:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788269948.216264:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29726:x1875136253053312:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 159us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.216272:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788269948.217429:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.217509:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053440 00000100:00100000:3.0:1788269948.217514:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053440 00000100:00100000:3.0:1788269948.217545:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:3.0:1788269948.217554:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29726:x1875136253053440:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788269948.217676:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29726:x1875136253053440:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 122us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.217685:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:0.0:1788269948.219064:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.219099:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053568 00000100:00100000:1.0:1788269948.219106:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053568 00000100:00100000:1.0:1788269948.219150:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:1.0:1788269948.219159:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29745:x1875136253053568:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269948.219292:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29745:x1875136253053568:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 133us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.219300:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788269948.230163:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.230301:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053696 00000100:00100000:3.0:1788269948.230312:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053696 00000100:00100000:3.0:1788269948.230374:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788269948.230384:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29745:x1875136253053696:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269948.230572:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29745:x1875136253053696:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 188us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.230580:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788269948.231457:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.231514:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053824 00000100:00100000:2.0:1788269948.231522:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053824 00000100:00100000:2.0:1788269948.231562:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788269948.231571:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29745:x1875136253053824:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269948.231671:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29745:x1875136253053824:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.231861:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:0.0:1788269948.233112:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.233224:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253053952 00000100:00100000:3.0:1788269948.233249:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253053952 00000100:00100000:3.0:1788269948.233290:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:3.0:1788269948.233300:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:29726:x1875136253053952:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788269948.233312:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269948.233326:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b676c00/0xc5f5d7a016e079a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610143e expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.233354:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b676c00/0xc5f5d7a016e079a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610143e expref: 9 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.233361:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b676c00/0xc5f5d7a016e079a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610143e expref: 9 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.233369:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676c00, rc 0) 00000100:00100000:3.0:1788269948.233408:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+9:29726:x1875136253053952:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.233413:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788269948.235152:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.235208:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054080 00000100:00100000:2.0:1788269948.235213:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054080 00000100:00100000:2.0:1788269948.235274:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:2.0:1788269948.235284:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+9:29726:x1875136253054080:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788269948.235302:0:40068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788269948.235321:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788269948.235324:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788269948.235326:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788269948.235327:0:40068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788269948.235329:0:40068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 26 00000100:00100000:2.0:1788269948.238168:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+9:29726:x1875136253054080:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 2873us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.238182:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788269948.242254:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.242347:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054208 00000100:00100000:3.0:1788269948.242356:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054208 00000100:00100000:3.0:1788269948.242404:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:3.0:1788269948.242413:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+9:29726:x1875136253054208:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788269948.242431:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269948.242448:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101445 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.242478:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 10 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.242486:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 10 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269948.242493:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676200, rc 0) 00000100:00100000:3.0:1788269948.242538:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29726:x1875136253054208:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 128us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.242545:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:0.0:1788269948.245216:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.245383:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054336 00000100:00100000:2.0:1788269948.245392:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054336 00000100:00100000:2.0:1788269948.245439:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:2.0:1788269948.245449:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29726:x1875136253054336:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788269948.245580:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29726:x1875136253054336:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 131us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.245588:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:1.0:1788269948.247268:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.247386:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054464 00000100:00100000:3.0:1788269948.247394:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054464 00000100:00100000:3.0:1788269948.247546:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:3.0:1788269948.247556:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29726:x1875136253054464:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788269948.247706:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29726:x1875136253054464:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 150us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.247714:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:0.0:1788269948.249153:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.249246:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054592 00000100:00100000:1.0:1788269948.249252:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054592 00000100:00100000:1.0:1788269948.249291:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788269948.249300:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29750:x1875136253054592:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269948.249419:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29750:x1875136253054592:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.249428:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:0.0:1788269948.251320:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.251400:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054720 00000100:00100000:3.0:1788269948.251409:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054720 00000100:00100000:3.0:1788269948.251458:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:3.0:1788269948.251466:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29750:x1875136253054720:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269948.251627:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29750:x1875136253054720:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 161us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.251635:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:3.0:1788269948.255633:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.255680:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.255774:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054848 00000100:00100000:1.0:1788269948.255784:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054848 00000100:00100000:2.0:1788269948.255885:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055104 00000100:00100000:2.0:1788269948.255891:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055104 00000100:00100000:1.0:1788269948.255911:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788269948.255921:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875136253054848:12345-192.168.201.42@tcp:38:mount.lustre.0 00000100:00100000:2.0:1788269948.255929:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788269948.255936:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875136253055104:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788269948.255956:0:40075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp t0 exp 0000000000000000 cur 739 last 0 00010000:00080000:2.0:1788269948.255957:0:41798:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:2.0:1788269948.256021:0:41798:0:(genops.c:1385:class_connect()) connect: client 41dd69ed-5790-4cb1-adef-18c6baaffed2, cookie 0xc5f5d7a016e079b4 00000020:00000080:1.0:1788269948.256023:0:40075:0:(genops.c:1385:class_connect()) connect: client 41dd69ed-5790-4cb1-adef-18c6baaffed2, cookie 0xc5f5d7a016e079bb 00000004:00100000:2.0:1788269948.256072:0:41798:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:1.0:1788269948.256079:0:40075:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788269948.256375:0:41798:0:(import.c:65:import_set_state_nolock()) ffff98c143557000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788269948.256376:0:40075:0:(import.c:65:import_set_state_nolock()) ffff98c1435b1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269948.256630:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2399:x1875136253054848:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 609us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.256640:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788269948.259602:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2399:x1875136253055104:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 3654us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.259616:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788269948.273195:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.273255:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269948.273295:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.273356:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055360 00000100:00100000:2.0:1788269948.273367:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055360 00000100:00100000:2.0:1788269948.273444:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055232 00000100:00100000:2.0:1788269948.273447:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055232 00000100:00100000:2.0:1788269948.273468:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253054976 00000100:00100000:2.0:1788269948.273471:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253054976 00000100:00100000:2.0:1788269948.273487:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788269948.273496:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:29726:x1875136253055360:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788269948.273535:0:40074:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446248448 avail 1300008960 00000100:00100000:0.0:1788269948.273614:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788269948.273626:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:0:x1875136253055232:12345-192.168.201.42@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788269948.273640:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788269948.273646:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:29726:x1875136253055360:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 147us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.273653:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:0:x1875136253054976:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788269948.273657:0:40076:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446404096 avail 1300164608 00000100:00100000:2.0:1788269948.273660:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000004:00000024:1.0:1788269948.273667:0:42351:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446248448 avail 1300008960 00000100:00100000:1.0:1788269948.273703:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:0:x1875136253054976:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.273712:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788269948.273717:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:0:x1875136253055232:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 92us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269948.273724:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00080000:3.0:1788269948.274053:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788269948.274056:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269948.276255:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.276352:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055488 00000100:00100000:2.0:1788269948.276359:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055488 00000100:00100000:2.0:1788269948.276413:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788269948.276424:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29726:x1875136253055488:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788269948.276494:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29726:x1875136253055488:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.276501:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788269948.278303:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269948.278336:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269948.278365:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055616 00000100:00100000:2.0:1788269948.278371:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269948.278374:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055616 00000100:00100000:1.0:1788269948.278387:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055744 00000100:00100000:1.0:1788269948.278391:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055744 00000100:00100000:1.0:1788269948.278415:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788269948.278430:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788269948.278431:0:40086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253055872 00000100:00100000:1.0:1788269948.278431:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875136253055616:12345-192.168.201.42@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788269948.278437:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875136253055744:12345-192.168.201.42@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788269948.278438:0:40086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253055872 00010000:00080000:1.0:1788269948.278462:0:42623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp t0 exp 0000000000000000 cur 739 last 0 00010000:00080000:0.0:1788269948.278462:0:41579:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp t0 exp 0000000000000000 cur 739 last 0 00000100:00100000:3.0:1788269948.278472:0:40086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788269948.278481:0:40086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29726:x1875136253055872:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788269948.278483:0:40085:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000020:00000080:1.0:1788269948.278493:0:42623:0:(genops.c:1385:class_connect()) connect: client 41dd69ed-5790-4cb1-adef-18c6baaffed2, cookie 0xc5f5d7a016e079c9 00000100:00100000:2.0:1788269948.278494:0:40085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000020:00000080:0.0:1788269948.278501:0:41579:0:(genops.c:1385:class_connect()) connect: client 41dd69ed-5790-4cb1-adef-18c6baaffed2, cookie 0xc5f5d7a016e079c2 00002000:00100000:0.0:1788269948.278507:0:41579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41dd69ed-5790-4cb1-adef-18c6baaffed2/ffff98c1437df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788269948.278510:0:42623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41dd69ed-5790-4cb1-adef-18c6baaffed2/ffff98c1435b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788269948.278518:0:42623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1788269948.278518:0:41579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788269948.278591:0:40086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29726:x1875136253055872:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269948.278601:0:40086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00002000:00080000:1.0:1788269948.278702:0:42623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1788269948.278702:0:41579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788269948.278731:0:41579:0:(import.c:65:import_set_state_nolock()) ffff98c1437dc000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788269948.278732:0:42623:0:(import.c:65:import_set_state_nolock()) ffff98c1435b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269948.278769:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2399:x1875136253055616:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 339us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269948.278773:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2399:x1875136253055744:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 336us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.278777:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788269948.278783:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788269948.279781:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.279841:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056000 00000100:00100000:1.0:1788269948.279845:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056000 00000100:00100000:1.0:1788269948.279873:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269948.279880:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29726:x1875136253056000:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788269948.280524:0:40077:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 582us 00000004:00200000:2.0:1788269948.289015:0:40077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788269948.289163:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29726:x1875136253056000:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 9277us (9376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.289191:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788269948.365093:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269948.365162:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056128 00000100:00100000:1.0:1788269948.365172:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056128 00000100:00100000:1.0:1788269948.365223:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788269948.365244:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29773:x1875136253056128:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:1.0:1788269948.365267:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269948.365300:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e079d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101476 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.365362:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e079d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.365373:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e079d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.365383:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e079d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269948.365427:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269948.365430:0:42351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269948.365456:0:42351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e079d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.365483:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e079d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101476 expref: 8 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.365506:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e079d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101476 expref: 7 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269948.365515:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878000) 00010000:00010000:1.0:1788269948.365518:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269948.365522:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e600, rc 0) 00000100:00100000:1.0:1788269948.365579:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:29773:x1875136253056128:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 337us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269948.365586:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788269948.612606:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262549888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269948.612676:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269948.612791:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262549888 00000100:00100000:2.0:1788269948.612799:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262549888 00000100:00100000:2.0:1788269948.612900:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788269948.612911:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262549888:12345-0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788269948.612928:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:2.0:1788269948.612944:0:40080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446248448 avail 1300008960 00000100:00100000:2.0:1788269948.612995:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262549888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269948.613002:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269948.613084:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262549888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788269949.124309:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262550016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788269949.124410:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269949.124638:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550016 00000100:00100000:1.0:1788269949.124647:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550016 00000100:00080000:0.0:1788269949.124801:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269949.124848:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269949.124861:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262550016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269949.124899:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788269949.124958:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262550016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269949.124966:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269949.125074:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262550016:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788269949.637735:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269950.010645:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269950.010710:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056256 00000100:00100000:0.0:1788269950.010719:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056256 00000100:00100000:0.0:1788269950.010783:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788269950.010792:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29825:x1875136253056256:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:0.0:1788269950.010823:0:40076:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446404096 avail 1300164608 00000100:00100000:0.0:1788269950.010907:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29825:x1875136253056256:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269950.010912:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00080000:3.0:1788269950.010967:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788269950.013488:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269950.013689:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056384 00000100:00100000:0.0:1788269950.013698:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056384 00000100:00100000:0.0:1788269950.013784:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788269950.013790:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29825:x1875136253056384:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:0.0:1788269950.013808:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788269950.013873:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29825:x1875136253056384:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 83us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269950.013878:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00080000:3.0:1788269950.015347:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269950.016905:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269950.017062:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056512 00000100:00100000:0.0:1788269950.017071:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056512 00000100:00100000:0.0:1788269950.017120:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788269950.017128:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29825:x1875136253056512:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:0.0:1788269950.017156:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1788269950.017264:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:29825:x1875136253056512:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 135us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269950.017280:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00080000:3.0:1788269950.019370:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269950.157422:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.157490:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056640 00000100:00100000:1.0:1788269950.157504:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056640 00000100:00100000:1.0:1788269950.157563:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:1.0:1788269950.157572:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:29855:x1875136253056640:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269950.157591:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269950.157616:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9f600/0xc5f5d7a016e079de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610147d expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269950.157645:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9f600/0xc5f5d7a016e079de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610147d expref: 11 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269950.157656:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9f600/0xc5f5d7a016e079de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610147d expref: 11 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269950.157668:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f600, rc 0) 00000100:00100000:1.0:1788269950.157735:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29855:x1875136253056640:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 164us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269950.157739:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:2.0:1788269950.165329:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.165420:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056768 00000100:00100000:3.0:1788269950.165431:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056768 00000100:00100000:3.0:1788269950.165494:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:3.0:1788269950.165505:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27ec8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29855:x1875136253056768:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269950.165678:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27ec8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29855:x1875136253056768:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 174us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.165687:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:2.0:1788269950.167104:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.167162:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253056896 00000100:00100000:1.0:1788269950.167171:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253056896 00000100:00100000:1.0:1788269950.167230:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788269950.167239:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27ec8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29855:x1875136253056896:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788269950.167352:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27ec8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29855:x1875136253056896:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 115us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269950.167359:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:2.0:1788269950.172859:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.173525:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057024 00000100:00100000:1.0:1788269950.173537:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057024 00000100:00100000:1.0:1788269950.173599:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788269950.173611:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27ec8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29862:x1875136253057024:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269950.173794:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27ec8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29862:x1875136253057024:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 185us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269950.173803:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:2.0:1788269950.188386:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.188462:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057152 00000100:00100000:3.0:1788269950.188472:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057152 00000100:00100000:3.0:1788269950.188517:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788269950.188524:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29862:x1875136253057152:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269950.188663:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29862:x1875136253057152:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 139us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.188669:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:2.0:1788269950.191676:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.192142:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057280 00000100:00100000:1.0:1788269950.192151:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057280 00000100:00100000:1.0:1788269950.192260:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:1.0:1788269950.192270:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29862:x1875136253057280:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269950.192409:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29862:x1875136253057280:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 140us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269950.192420:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:0.0:1788269950.196422:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.196491:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057408 00000100:00100000:2.0:1788269950.196503:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057408 00000100:00100000:2.0:1788269950.196558:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:2.0:1788269950.196570:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29855:x1875136253057408:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269950.196597:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269950.196617:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e079e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561014ae expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.196646:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e079e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014ae expref: 12 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.196657:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e079e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014ae expref: 12 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.196667:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d600, rc 0) 00000100:00100000:2.0:1788269950.196727:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29855:x1875136253057408:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.196735:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:2.0:1788269950.208128:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.211421:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057536 00000100:00100000:1.0:1788269950.211434:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057536 00000100:00100000:1.0:1788269950.211489:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788269950.211496:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29855:x1875136253057536:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788269950.211516:0:40069:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788269950.211537:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788269950.211540:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788269950.211542:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788269950.211544:0:40069:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788269950.211546:0:40069:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 26 00000100:00100000:3.0:1788269950.214378:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29855:x1875136253057536:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 2871us (6248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.214393:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:0.0:1788269950.216910:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.216980:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057664 00000100:00100000:2.0:1788269950.216989:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057664 00000100:00100000:2.0:1788269950.217036:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:2.0:1788269950.217075:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29855:x1875136253057664:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269950.217092:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269950.217107:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561014b5 expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.217130:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 13 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.217137:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 13 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.217143:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c000, rc 0) 00000100:00100000:2.0:1788269950.217182:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29855:x1875136253057664:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 113us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.217187:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:0.0:1788269950.222716:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.222787:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057792 00000100:00100000:3.0:1788269950.222795:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057792 00000100:00100000:3.0:1788269950.222839:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788269950.222846:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29855:x1875136253057792:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269950.223018:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29855:x1875136253057792:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 172us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.223026:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:1.0:1788269950.224344:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.225136:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253057920 00000100:00100000:2.0:1788269950.225143:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253057920 00000100:00100000:2.0:1788269950.225180:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:2.0:1788269950.225186:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29855:x1875136253057920:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788269950.225439:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29855:x1875136253057920:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 251us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.225448:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:2.0:1788269950.226492:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269950.226677:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058048 00000100:00100000:0.0:1788269950.226683:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058048 00000100:00100000:0.0:1788269950.226752:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:0.0:1788269950.226759:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29871:x1875136253058048:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269950.226838:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29871:x1875136253058048:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269950.226843:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:0.0:1788269950.234026:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.234087:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058176 00000100:00100000:2.0:1788269950.234095:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058176 00000100:00100000:2.0:1788269950.234145:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:2.0:1788269950.234155:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29871:x1875136253058176:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269950.234313:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29871:x1875136253058176:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 160us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.234322:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788269950.245655:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.246269:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.246866:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058304 00000100:00100000:1.0:1788269950.246880:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.246881:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058304 00000100:00100000:1.0:1788269950.247225:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269950.247252:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.247265:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058560 00000100:00100000:2.0:1788269950.247269:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058560 00000100:00100000:2.0:1788269950.247280:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058944 00000100:00100000:2.0:1788269950.247283:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058944 00000100:00100000:2.0:1788269950.247326:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059072 00000100:00100000:2.0:1788269950.247330:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059072 00000100:00100000:2.0:1788269950.247345:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788269950.247352:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2402:x1875136253058944:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269950.247421:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2402:x1875136253058944:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.247428:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788269950.247444:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788269950.247451:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253059072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269950.247495:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253059072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.247500:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788269950.247509:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788269950.247512:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875136253058304:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788269950.247529:0:40074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp t0 exp 0000000000000000 cur 741 last 0 00000020:00000080:2.0:1788269950.247709:0:40074:0:(genops.c:1385:class_connect()) connect: client 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7, cookie 0xc5f5d7a016e079f3 00000004:00100000:2.0:1788269950.247732:0:40074:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788269950.247806:0:40074:0:(import.c:65:import_set_state_nolock()) ffff98c27699a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269950.247827:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2399:x1875136253058304:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 314us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.247831:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788269950.247841:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788269950.247843:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875136253058560:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788269950.247854:0:40074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp t0 exp 0000000000000000 cur 741 last 0 00000020:00000080:2.0:1788269950.247869:0:40074:0:(genops.c:1385:class_connect()) connect: client 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7, cookie 0xc5f5d7a016e079fa 00000004:00100000:2.0:1788269950.247877:0:40074:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788269950.247904:0:40074:0:(import.c:65:import_set_state_nolock()) ffff98c27699d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269950.247920:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2399:x1875136253058560:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 75us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.247924:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788269950.247962:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059200 00000100:00100000:2.0:1788269950.247965:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059200 00000100:00100000:2.0:1788269950.247984:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788269950.247987:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253059200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269950.248003:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253059200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 15us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.248006:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:1.0:1788269950.248729:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.248796:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059328 00000100:00100000:2.0:1788269950.248800:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059328 00000100:00100000:2.0:1788269950.248829:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788269950.248834:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253059328:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788269950.248860:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269950.248866:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253059328:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.248871:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788269950.258568:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.258622:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.258652:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058432 00000100:00100000:2.0:1788269950.258661:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.258662:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058432 00000100:00100000:0.0:1788269950.258695:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058688 00000100:00100000:0.0:1788269950.258701:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058688 00000100:00100000:3.0:1788269950.258728:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253058816 00000100:00100000:3.0:1788269950.258733:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253058816 00000100:00100000:0.0:1788269950.258736:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:0.0:1788269950.258746:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:0:x1875136253058432:12345-192.168.201.42@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788269950.258758:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788269950.258768:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:0:x1875136253058688:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788269950.258781:0:41798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446248448 avail 1300008960 00000004:00000024:3.0:1788269950.258785:0:40074:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446404096 avail 1300164608 00000100:00100000:1.0:1788269950.258874:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00080000:2.0:1788269950.258911:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269950.258913:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:0:x1875136253058688:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 145us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269950.258915:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:0:x1875136253058432:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 168us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.258926:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00080000:2.0:1788269950.258927:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269950.258932:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788269950.258991:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253058816:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788269950.259003:0:40075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446248448 avail 1300008960 00000100:00100000:1.0:1788269950.259029:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253058816:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 147us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269950.259035:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788269950.261236:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.261294:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059456 00000100:00100000:3.0:1788269950.261303:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059456 00000100:00100000:3.0:1788269950.261350:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788269950.261360:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253059456:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788269950.261440:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253059456:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.261448:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788269950.264189:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269950.264315:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.264338:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059584 00000100:00100000:2.0:1788269950.264347:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059584 00000100:00100000:0.0:1788269950.264367:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.264378:0:40086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059840 00000100:00100000:3.0:1788269950.264384:0:40086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059840 00000100:00100000:2.0:1788269950.264398:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059712 00000100:00100000:2.0:1788269950.264403:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059712 00000100:00100000:3.0:1788269950.264428:0:40086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788269950.264432:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788269950.264445:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788269950.264448:0:40086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253059840:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788269950.264448:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875136253059584:12345-192.168.201.42@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788269950.264457:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875136253059712:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788269950.264484:0:41579:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp t0 exp 0000000000000000 cur 741 last 0 00010000:00080000:0.0:1788269950.264489:0:42634:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp t0 exp 0000000000000000 cur 741 last 0 00000100:00100000:3.0:1788269950.264517:0:40086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253059840:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000020:00000080:2.0:1788269950.264524:0:41579:0:(genops.c:1385:class_connect()) connect: client 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7, cookie 0xc5f5d7a016e07a01 00000020:00000080:0.0:1788269950.264524:0:42634:0:(genops.c:1385:class_connect()) connect: client 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7, cookie 0xc5f5d7a016e07a08 00000100:00100000:3.0:1788269950.264527:0:40086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00002000:00100000:2.0:1788269950.264552:0:41579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7/ffff98c27699f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788269950.264564:0:41579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788269950.264626:0:41579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788269950.264652:0:41579:0:(import.c:65:import_set_state_nolock()) ffff98c27699c000 : changing import state from RECOVER to FULL 00002000:00100000:0.0:1788269950.264689:0:42634:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7/ffff98c1437de800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788269950.264698:0:42634:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788269950.264735:0:42634:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788269950.264751:0:42634:0:(import.c:65:import_set_state_nolock()) ffff98c1437d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269950.264777:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2399:x1875136253059712:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 322us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269950.264786:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788269950.264793:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2399:x1875136253059584:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 240us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.264802:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788269950.266019:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269950.266169:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253059968 00000100:00100000:3.0:1788269950.266174:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253059968 00000100:00100000:3.0:1788269950.266218:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788269950.266230:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253059968:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788269950.266304:0:40078:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788269950.266355:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29855:x1875136253059968:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 130us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269950.266364:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:0.0:1788269950.397998:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269950.398074:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060096 00000100:00100000:2.0:1788269950.398083:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060096 00000100:00100000:2.0:1788269950.398136:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788269950.398144:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:29894:x1875136253060096:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:2.0:1788269950.398162:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269950.398181:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07a0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561014e6 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.398253:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.398263:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.398272:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269950.398307:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788269950.398309:0:41798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269950.398324:0:41798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.398344:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07a0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 8 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.398361:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 7 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269950.398370:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878000) 00010000:00010000:2.0:1788269950.398373:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269950.398377:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5da00, rc 0) 00000100:00100000:2.0:1788269950.398428:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:29894:x1875136253060096:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 285us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269950.398434:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00010000:00010000:2.0:1788269950.660453:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269950.727713:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788269951.684222:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262550272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269951.684292:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.684341:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262550144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269951.684364:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.684407:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550144 00000100:00100000:0.0:1788269951.684413:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550144 00000100:00100000:0.0:1788269951.684454:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788269951.684464:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262550144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788269951.684507:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446404096 avail 1300164608 00000100:00100000:0.0:1788269951.684549:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262550144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269951.684556:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788269951.684597:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262550144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269951.684797:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550272 00000100:00100000:0.0:1788269951.684801:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550272 00000100:00100000:0.0:1788269951.684840:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269951.684847:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262550272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269951.684864:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1788269951.684898:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262550272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269951.684905:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269951.684967:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262550528:0@lo:400:kworker.0 00000100:00100000:3.0:1788269951.684997:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269951.685019:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262551040:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.685032:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262550656:0@lo:400:kworker.0 00000100:00100000:3.0:1788269951.685063:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.685074:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269951.685080:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262551552:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.685088:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262551168:0@lo:400:kworker.0 00000100:00100000:3.0:1788269951.685098:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.685109:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262550784:0@lo:400:kworker.0 00000100:00100000:3.0:1788269951.685124:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550656 00000100:00100000:3.0:1788269951.685127:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550656 00000100:00100000:0.0:1788269951.685128:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.685143:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262551296:0@lo:400:kworker.0 00000100:00100000:3.0:1788269951.685150:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551552 00000100:00100000:3.0:1788269951.685153:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551552 00000100:00100000:0.0:1788269951.685161:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.685204:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262550272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269951.685218:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788269951.685223:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262550400:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.685247:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.685269:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262550912:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.685287:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.685302:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262551424:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.685318:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269951.685381:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550784 00000100:00100000:1.0:1788269951.685384:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550784 00000100:00100000:1.0:1788269951.685409:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269951.685416:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262550784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.685451:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262550784:12345-0@lo:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.685457:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269951.685475:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550528 00000100:00100000:1.0:1788269951.685490:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550528 00000100:00100000:1.0:1788269951.685514:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551040 00000100:00100000:1.0:1788269951.685517:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551040 00000100:00100000:1.0:1788269951.685532:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550912 00000100:00100000:1.0:1788269951.685534:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550912 00000100:00100000:1.0:1788269951.685547:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269951.685553:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262550528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.685586:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262550528:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.685592:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269951.685601:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269951.685607:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262551040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.685945:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262551040:12345-0@lo:400:kworker.0 Request processed in 337us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.685952:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269951.685964:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269951.685970:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262550912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.685996:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262550912:12345-0@lo:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.686001:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269951.694644:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551296 00000100:00100000:1.0:1788269951.694660:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551296 00000100:00100000:0.0:1788269951.694693:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551424 00000100:00100000:0.0:1788269951.694700:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551424 00000100:00100000:1.0:1788269951.694732:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262551040:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.694749:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269951.694754:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262550528:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.694764:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262550656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.694806:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269951.694813:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262551552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.694844:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262550656:12345-0@lo:400:kworker.0 Request processed in 85us (9768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269951.694853:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269951.694863:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262551552:12345-0@lo:400:kworker.0 Request processed in 50us (9763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.694870:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269951.694876:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788269951.694886:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262551424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.694897:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262551552:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.694920:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262551424:12345-0@lo:400:kworker.0 Request processed in 36us (9600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269951.694926:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788269951.694940:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269951.694945:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262551296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.694971:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262551296:12345-0@lo:400:kworker.0 Request processed in 27us (9809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269951.694977:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269951.694995:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269951.695000:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262550400 00000100:00100000:0.0:1788269951.695005:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262550400 00000100:00100000:0.0:1788269951.695034:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788269951.695058:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262550400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.695063:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262551680:0@lo:400:kworker.0 00000100:00100000:0.0:1788269951.695089:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262550400:12345-0@lo:400:kworker.0 Request processed in 32us (9839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269951.695095:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788269951.695114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788269951.695148:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a670000 x1875136262551424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269951.695160:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262551424:0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.695189:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262550656:0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.695228:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551168 00000100:00100000:1.0:1788269951.695245:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551168 00000100:00080000:2.0:1788269951.695248:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788269951.695254:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269951.695258:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269951.695261:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269951.695270:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269951.695300:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262551808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269951.695307:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551680 00000100:00100000:1.0:1788269951.695311:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551680 00000100:00080000:1.0:1788269951.695335:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788269951.695338:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269951.695361:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788269951.695368:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262551168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269951.695387:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788269951.695398:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262551680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.695414:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262551168:12345-0@lo:400:kworker.0 Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.695420:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269951.695438:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262551680:12345-0@lo:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269951.695446:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788269951.695449:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262551168:0@lo:400:kworker.0 00010000:00080000:1.0:1788269951.695467:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a673480 x1875136262551680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269951.695475:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262551680:0@lo:400:kworker.0 00000100:00100000:2.0:1788269951.695544:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262551936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269951.695561:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262550784:0@lo:400:kworker.0 00000100:00100000:2.0:1788269951.695592:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269951.695600:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262551296:0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.695660:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262550400:0@lo:400:kworker.0 00000100:00100000:1.0:1788269951.695694:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262550912:0@lo:400:kworker.0 00010000:00010000:1.0:1788269951.695772:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269951.695784:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551808 00000100:00100000:1.0:1788269951.695810:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551808 00000100:00100000:1.0:1788269951.695845:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262551936 00000100:00100000:1.0:1788269951.695862:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262551936 00000100:00100000:1.0:1788269951.695888:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269951.695895:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262551808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269951.695940:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788269951.696034:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262551808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.696067:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269951.696083:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269951.696090:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262551936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788269951.696125:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1788269951.696195:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262551936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269951.696202:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269951.696260:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262551936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269951.696288:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262551808:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788269951.941424:0:42951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788269952.198028:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:0.0:1788269952.198066:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00000001:00080000:0.0:1788269952.198076:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803778 is committed 00010000:00010000:3.0:1788269952.709564:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788269953.228679:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:2.0:1788269953.228690:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00010000:00010000:2.0:1788269953.732188:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269953.732376:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262552064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269953.732457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269953.732540:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262552064 00000100:00100000:2.0:1788269953.732549:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262552064 00000100:00100000:2.0:1788269953.732618:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269953.732629:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262552064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788269953.732660:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446248448 avail 1300008960 00000100:00100000:2.0:1788269953.732963:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262552064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 336us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269953.732976:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788269953.734915:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262552064:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788269953.925725:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788269954.034451:0:43099:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb03deb0 20000000:00000080:0.0:1788269954.034466:0:43099:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c265e0f400 uarg=0000000000000000 20000000:01000000:0.0:1788269954.034498:0:43099:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788269954.034503:0:43099:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788269954.034506:0:43099:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788269954.035832:0:43100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788269954.035991:0:43099:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788269954.036000:0:43099:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788269954.036020:0:43099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036232:0:43099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036242:0:43099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 23 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036249:0:43099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 23 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036262:0:43099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036271:0:43099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 12 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036279:0:43099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 12 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036286:0:43099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036327:0:43099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 12 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036343:0:43099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 12 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.036359:0:43099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552192:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269954.036497:0:43099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 12 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036503:0:43099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 12 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.036509:0:43099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552320:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269954.036530:0:43099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036542:0:43099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 23 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.036551:0:43099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552448:0@lo:104: 00000100:00100000:3.0:1788269954.036587:0:43099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269954.036661:0:43099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 23 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036670:0:43099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 23 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.036679:0:43099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552576:0@lo:104: 00000100:00100000:3.0:1788269954.036699:0:43099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269954.036735:0:43099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 23 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036743:0:43099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 23 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.036750:0:43099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552704:0@lo:104: 00000100:00100000:3.0:1788269954.036770:0:43099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269954.036785:0:43099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.036793:0:43099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 23 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.036800:0:43099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552832:0@lo:104: 00000100:00100000:3.0:1788269954.036816:0:43099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269954.036823:0:43099:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661540 going to sleep for 11 seconds 00000100:00100000:2.0:1788269954.036873:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262552448 00000100:00100000:2.0:1788269954.036880:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262552448 00000100:00100000:2.0:1788269954.036908:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262552576 00000100:00100000:2.0:1788269954.036909:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262552576 00000100:00100000:2.0:1788269954.036914:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262552704 00000100:00100000:2.0:1788269954.036915:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262552704 00000100:00100000:2.0:1788269954.036920:0:40059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262552832 00000100:00100000:2.0:1788269954.036921:0:40059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262552832 00000100:00100000:2.0:1788269954.036928:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269954.036934:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+6:43099:x1875136262552448:12345-0@lo:104: 00010000:00010000:2.0:1788269954.036943:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.036986:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269954.036991:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+6:43099:x1875136262552448:12345-0@lo:104: Request processed in 57us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269954.036998:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269954.037014:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269954.037020:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+5:43099:x1875136262552576:12345-0@lo:104: 00010000:00010000:2.0:1788269954.037027:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037088:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788269954.037094:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+5:43099:x1875136262552576:12345-0@lo:104: Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269954.037101:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269954.037110:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269954.037115:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+4:43099:x1875136262552704:12345-0@lo:104: 00010000:00010000:2.0:1788269954.037120:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037155:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788269954.037158:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+4:43099:x1875136262552704:12345-0@lo:104: Request processed in 44us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269954.037162:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269954.037170:0:40059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788269954.037173:0:40059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+3:43099:x1875136262552832:12345-0@lo:104: 00010000:00010000:2.0:1788269954.037178:0:40059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037192:0:40059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788269954.037195:0:40059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e129e33-0062-408b-ba53-2e2ae2985734+3:43099:x1875136262552832:12345-0@lo:104: Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269954.037198:0:40059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788269954.037208:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788269954.037212:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037217:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ee00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788269954.037220:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037225:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269954.037230:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269954.037235:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788269954.037274:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037281:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269954.037297:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037304:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418ee00/0xc5f5d7a016e0767a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07681 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037316:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788269954.037319:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037324:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788269954.037327:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037333:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269954.037339:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269954.037344:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788269954.037357:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037363:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269954.037375:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037381:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418e200/0xc5f5d7a016e075e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e075e7 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037390:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269954.037393:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037399:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788269954.037401:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037407:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269954.037413:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269954.037419:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788269954.037430:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037436:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269954.037441:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037447:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c275b56800/0xc5f5d7a016e075a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e075a8 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037460:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269954.037462:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037467:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788269954.037469:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037475:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269954.037480:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269954.037485:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788269954.037497:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037502:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269954.037508:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037514:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c14418e600/0xc5f5d7a016e07593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0759a expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.037525:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269954.037527:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269954.037528:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269954.037535:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269954.037547:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262552960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269954.037575:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269954.037602:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269954.037607:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262553344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269954.037626:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269954.037721:0:43099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552448:0@lo:104: 00000100:00100000:3.0:1788269954.037730:0:43099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552576:0@lo:104: 00000100:00100000:3.0:1788269954.037736:0:43099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552704:0@lo:104: 00000100:00100000:3.0:1788269954.037742:0:43099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552832:0@lo:104: 00010000:00010000:1.0:1788269954.037808:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269954.037832:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262553088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269954.037866:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269954.037901:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269954.037906:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262553216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269954.037925:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269954.037949:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262552960 00000100:00100000:1.0:1788269954.037953:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262552960 00010000:00010000:1.0:1788269954.037973:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 24 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.037987:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262553344 00000100:00100000:1.0:1788269954.037990:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262553344 00010000:00010000:1.0:1788269954.037999:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 25 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.038009:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262553088 00000100:00100000:1.0:1788269954.038011:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262553088 00010000:00010000:1.0:1788269954.038020:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 26 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.038030:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262553216 00000100:00100000:1.0:1788269954.038032:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262553216 00010000:00010000:1.0:1788269954.038071:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 27 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.038086:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269954.038092:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+27:3610:x1875136262552960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269954.038102:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269954.038107:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 27 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038115:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 27 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038125:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bec00/0xc5f5d7a016e07681 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0767a expref: 27 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038145:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269954.038169:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+26:3610:x1875136262552960:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.038174:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269954.038183:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269954.038188:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+25:3610:x1875136262553344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269954.038196:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269954.038200:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 25 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038206:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 25 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038216:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b676e00/0xc5f5d7a016e0759a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07593 expref: 25 pid: 40069 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038225:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269954.038240:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3610:x1875136262553344:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.038244:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269954.038252:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269954.038255:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+23:3607:x1875136262553088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269954.038260:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269954.038262:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 23 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038268:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 23 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038277:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57e00/0xc5f5d7a016e075e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e075e0 expref: 23 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038285:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269954.038311:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+22:3607:x1875136262553088:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.038317:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269954.038329:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269954.038335:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+21:3607:x1875136262553216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269954.038341:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269954.038346:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 21 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038354:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 21 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038363:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418e800/0xc5f5d7a016e075a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e075a1 expref: 21 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.038371:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269954.038391:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+20:3607:x1875136262553216:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.038396:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269954.038424:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262553216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269954.038432:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262553088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269954.038560:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262553344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269954.038569:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262552960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269954.040989:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269954.041028:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269954.041119:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060224 00000100:00100000:1.0:1788269954.041143:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060224 00010000:00010000:1.0:1788269954.041177:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 13 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.041212:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060352 00000100:00100000:1.0:1788269954.041215:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060352 00010000:00010000:1.0:1788269954.041227:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 14 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.041240:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788269954.041248:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+14:2401:x1875136253060224:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269954.041259:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269954.041264:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 14 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041277:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 14 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041295:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269954.041347:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+14:2401:x1875136253060224:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.041353:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788269954.041396:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788269954.041403:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2401:x1875136253060352:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269954.041410:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269954.041414:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 13 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041423:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 13 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041435:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041443:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041456:0:40062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041463:0:40062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041470:0:40062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041476:0:40062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041482:0:40062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269954.041486:0:40062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041494:0:40062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041502:0:40062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.041511:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269954.041527:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2401:x1875136253060352:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 125us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.041533:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00010000:00010000:3.0:1788269954.041872:0:43099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e079ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014b5 expref: 12 pid: 40068 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.041886:0:43099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552192:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269954.041896:0:43099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b676200/0xc5f5d7a016e079ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101445 expref: 11 pid: 40070 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269954.041903:0:43099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43099:1875136262552320:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269954.041930:0:43099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.041939:0:43099:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.041944:0:43099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269954.041950:0:43099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b677600/0xc5f5d7a016e07a1d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269954.244901:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269954.244929:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262553472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269954.245030:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269954.245100:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262553472 00000100:00100000:1.0:1788269954.245107:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262553472 00000100:00100000:1.0:1788269954.245198:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269954.245207:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262553472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269954.245233:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788269954.245278:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262553472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269954.245285:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788269954.245314:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269954.245351:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262553472:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788269954.247609:0:40055:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:2.0:1788269954.247622:0:40055:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00000001:00100000:0.0:1788269954.247912:0:40807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:0.0:1788269954.247919:0:40807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00010000:00010000:2.0:1788269954.757019:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269954.982632:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269954.982964:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060480 00000100:00100000:2.0:1788269954.982975:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060480 00000100:00080000:1.0:1788269954.983084:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269954.983138:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788269954.983151:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:30356:x1875136253060480:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269954.983206:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269954.983241:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561014ed expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983307:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983322:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983334:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983354:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983362:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983369:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983469:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e07a39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983477:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e07a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983484:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e07a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269954.983515:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788269954.983519:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269954.983556:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e07a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983567:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983573:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983579:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983588:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269954.983593:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983599:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983611:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878000) 00010000:00010000:2.0:1788269954.983614:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269954.983618:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983624:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983638:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983644:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983648:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983652:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5cc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269954.983654:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983659:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983670:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98c250e61100) 00010000:00010000:2.0:1788269954.983672:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269954.983675:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983679:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983775:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014ed expref: 8 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983785:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e07a39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014ed expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269954.983790:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c250e61400) 00010000:00010000:2.0:1788269954.983792:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269954.983794:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d800, rc 0) 00000100:00100000:2.0:1788269954.983853:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30356:x1875136253060480:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 706us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269954.983859:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:1.0:1788269954.987304:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269954.987656:0:42865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060608 00000100:00100000:3.0:1788269954.987665:0:42865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060608 00000100:00100000:3.0:1788269954.987731:0:42865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:3.0:1788269954.987742:0:42865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30356:x1875136253060608:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788269954.987841:0:42865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30356:x1875136253060608:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 Request processed in 101us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269954.987848:0:42865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788269954.989262:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269954.989339:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060864 00000100:00100000:1.0:1788269954.989346:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060864 00000100:00100000:1.0:1788269954.989492:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788269954.989503:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30356:x1875136253060864:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269954.989521:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269954.989541:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07a40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561014f4 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989609:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989624:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989635:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989650:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989658:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989665:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989768:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e07a55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989781:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e07a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989788:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e07a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269954.989797:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788269954.989950:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989957:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989964:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989971:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269954.989981:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.989989:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990002:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c250e61400) 00010000:00010000:1.0:1788269954.990005:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269954.990011:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990018:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990029:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990035:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990078:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990083:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269954.990086:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990092:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990098:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c143878500) 00010000:00010000:1.0:1788269954.990101:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269954.990104:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990110:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07a4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990737:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07a40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014f4 expref: 10 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990754:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e07a55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014f4 expref: 9 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269954.990763:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:1.0:1788269954.990765:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269954.990769:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e800, rc 0) 00000100:00100000:1.0:1788269954.990915:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:30356:x1875136253060864:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1414us (1656us total) trans 25769803777 rc 0/0 00000100:00100000:1.0:1788269954.990924:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:0.0:1788269955.001818:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.001949:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253060992 00000100:00100000:1.0:1788269955.001960:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253060992 00000100:00100000:1.0:1788269955.002127:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:1.0:1788269955.002139:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:30356:x1875136253060992:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788269955.002234:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:30356:x1875136253060992:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 98us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.002242:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788269955.007760:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.007864:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253061120 00000100:00100000:2.0:1788269955.007873:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253061120 00000100:00100000:2.0:1788269955.007941:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788269955.007953:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30356:x1875136253061120:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788269955.010274:0:40076:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2282us 00000100:00080000:1.0:1788269955.010345:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269955.018763:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30356:x1875136253061120:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 10805us (11004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.018777:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788269955.065144:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.065286:0:40083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253061248 00000100:00100000:1.0:1788269955.065297:0:40083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253061248 00000100:00100000:1.0:1788269955.065351:0:40083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269955.065362:0:40083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:30365:x1875136253061248:12345-192.168.201.42@tcp:700:mkdir.0 00000100:00100000:1.0:1788269955.065596:0:40083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:30365:x1875136253061248:12345-192.168.201.42@tcp:700:mkdir.0 Request processed in 236us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.065604:0:40083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269955.069649:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.071293:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253061504 00000100:00100000:2.0:1788269955.071307:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253061504 00000100:00100000:2.0:1788269955.071377:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788269955.071388:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:30365:x1875136253061504:12345-192.168.201.42@tcp:36:mkdir.0 00010000:00010000:2.0:1788269955.071447:0:40075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269955.071477:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e079d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101476 expref: 9 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.071500:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878000) 00010000:00010000:2.0:1788269955.071505:0:40075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269955.071562:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.071577:0:40075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 5 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.071586:0:40075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.071619:0:40075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 5 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.071634:0:40075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 5 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269955.071649:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262553600:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269955.071728:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.073817:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.073906:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262553600:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269955.073929:0:40075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.073993:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253061632 00000100:00100000:1.0:1788269955.073999:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253061632 00010000:00010000:1.0:1788269955.074075:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 6 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.074101:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788269955.074124:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2401:x1875136253061632:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269955.074136:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269955.074142:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 6 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.074155:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 6 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.074175:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5da00/0xc5f5d7a016e07a16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014e6 expref: 6 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.074190:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878000) 00010000:00010000:1.0:1788269955.074194:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.074203:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.074211:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.074237:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269955.074277:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2401:x1875136253061632:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 169us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.074285:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00080000:2.0:1788269955.074588:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788269955.074670:0:40075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.074679:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.074702:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.074711:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.074719:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076081:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076097:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076107:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269955.076137:0:40075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd90fd28 reply state 00000000934d99aa transno 25769803778 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076154:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076161:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:3.0:1788269955.076165:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788269955.076168:0:40075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788269955.076173:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788269955.076181:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076188:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076195:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076200:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269955.076204:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076211:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076220:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878000) 00010000:00010000:3.0:1788269955.076222:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269955.076225:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076230:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07a63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269955.076251:0:40075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd90fd28 reply state 00000000934d99aa transno 25769803778 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076259:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.076265:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff98c1429f7200) 00010000:00010000:3.0:1788269955.076267:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788269955.076269:0:40075:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788269955.076544:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:30365:x1875136253061504:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 5151us (7097us total) trans 25769803778 rc 0/0 00000100:00100000:3.0:1788269955.076552:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788269955.083276:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.083333:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253061760 00000100:00100000:1.0:1788269955.083343:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253061760 00000100:00100000:1.0:1788269955.083405:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788269955.083415:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:30366:x1875136253061760:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788269955.083658:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269955.083681:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561014fb expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.083740:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.083754:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.083766:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269955.083807:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269955.083810:0:42351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269955.083844:0:42351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.083865:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 12 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.083883:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 11 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.083892:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:1.0:1788269955.083894:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269955.083898:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ea00, rc 0) 00000100:00100000:1.0:1788269955.087636:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:30366:x1875136253061760:12345-192.168.201.42@tcp:101:rm.0 Request processed in 4211us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.087648:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788269955.089450:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.089501:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253061888 00000100:00100000:2.0:1788269955.089511:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253061888 00000100:00100000:2.0:1788269955.089604:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788269955.089615:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:30366:x1875136253061888:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:2.0:1788269955.089636:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.089655:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101502 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089717:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089730:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089740:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089750:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089757:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089763:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089840:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e07a9b lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089853:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e07a9b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089860:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e07a9b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269955.089894:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788269955.089897:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269955.089915:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e07a9b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089926:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089933:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089940:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089946:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269955.089950:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089958:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089969:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:2.0:1788269955.089972:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269955.089976:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.089988:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090000:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090006:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090012:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090017:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269955.090019:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090025:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090031:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff98c1429f7200) 00010000:00010000:2.0:1788269955.090034:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269955.090074:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090082:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07a94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090119:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101502 expref: 13 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090137:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e07a9b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101502 expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.090145:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:2.0:1788269955.090147:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788269955.090150:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c200, rc 0) 00000100:00100000:2.0:1788269955.090208:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30366:x1875136253061888:12345-192.168.201.42@tcp:101:rm.0 Request processed in 595us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.090216:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:3.0:1788269955.092025:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.092274:0:40085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062016 00000100:00100000:0.0:1788269955.092299:0:40085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062016 00000100:00100000:0.0:1788269955.092344:0:40085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788269955.092352:0:40085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30366:x1875136253062016:12345-192.168.201.42@tcp:900:rm.0 00000100:00100000:0.0:1788269955.092652:0:40085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30366:x1875136253062016:12345-192.168.201.42@tcp:900:rm.0 Request processed in 299us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.092660:0:40085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788269955.094230:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269955.094296:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062144 00000100:00100000:3.0:1788269955.094303:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062144 00000100:00100000:3.0:1788269955.094350:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788269955.094359:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30366:x1875136253062144:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:3.0:1788269955.094374:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269955.094394:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07aa2 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101509 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094480:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094494:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094509:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094530:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094537:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094544:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094587:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094594:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094605:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094612:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269955.094616:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094623:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094634:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:3.0:1788269955.094642:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269955.094646:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094652:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676e00/0xc5f5d7a016e07aa9 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094669:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094674:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094680:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094689:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9eea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269955.094692:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094698:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094705:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c1429f7400) 00010000:00010000:3.0:1788269955.094711:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269955.094714:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094720:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07ab0 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094754:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07aa2 lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101509 expref: 13 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094771:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:3.0:1788269955.094773:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269955.094778:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676a00/0xc5f5d7a016e07aa2 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101509 expref: 13 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.094793:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27b676a00, rc 0) 00000100:00100000:3.0:1788269955.095005:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30366:x1875136253062144:12345-192.168.201.42@tcp:101:rm.0 Request processed in 646us (778us total) trans 0 rc 301/301 00000100:00100000:3.0:1788269955.095011:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788269955.098631:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.098725:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062272 00000100:00100000:1.0:1788269955.098734:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062272 00000100:00100000:1.0:1788269955.098827:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788269955.098838:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30366:x1875136253062272:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788269955.098856:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269955.098874:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07ab7 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101510 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.098944:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.098961:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.098972:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.098990:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099001:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099008:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099092:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099106:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099235:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099241:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269955.099245:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099253:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099265:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269955.099268:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269955.099272:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099278:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07abe lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099289:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099302:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099308:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099313:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269955.099320:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099331:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099338:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c143878200) 00010000:00010000:1.0:1788269955.099340:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269955.099347:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099353:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ac5 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099386:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07ab7 lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101510 expref: 13 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099396:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269955.099403:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269955.099406:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07ab7 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101510 expref: 13 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.099415:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e000, rc 0) 00000100:00100000:1.0:1788269955.099508:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30366:x1875136253062272:12345-192.168.201.42@tcp:101:rm.0 Request processed in 668us (885us total) trans 0 rc 301/301 00000100:00100000:1.0:1788269955.099515:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788269955.139276:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.139364:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062528 00000100:00100000:2.0:1788269955.139374:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062528 00000100:00100000:2.0:1788269955.139440:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788269955.139456:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30372:x1875136253062528:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788269955.139474:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.139493:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07acc lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101517 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.139588:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.139601:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.139612:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.139629:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.139636:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.139643:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269955.139958:0:40076:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x64:0x0], count =62 00000004:00080000:2.0:1788269955.139965:0:40076:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x64:0x0]+62 in llog 00000004:00080000:2.0:1788269955.139977:0:40076:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2:0x0], index 1: 0 00010000:00010000:2.0:1788269955.140817:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140829:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140837:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140865:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140872:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140879:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140885:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269955.140890:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140897:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140908:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:2.0:1788269955.140911:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269955.140916:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140923:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e07ad3 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269955.140935:0:40076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3626c3a reply state 0000000043701895 transno 25769803779 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140945:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140951:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c250e61100) 00010000:00010000:2.0:1788269955.140953:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788269955.140956:0:40076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788269955.140979:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07acc lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 15 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140992:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 14 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.140999:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61d00) 00010000:00010000:2.0:1788269955.141001:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269955.141004:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ce00, rc 0) 00000100:00100000:2.0:1788269955.141183:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+15:30372:x1875136253062528:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1734us (1915us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1788269955.141191:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788269955.143661:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.143884:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062656 00000100:00100000:2.0:1788269955.143892:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062656 00000100:00100000:2.0:1788269955.143945:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788269955.143955:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253062656:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788269955.143969:0:42623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.143989:0:42623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610151e expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269955.144011:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788269955.144060:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1788269955.144065:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269955.144074:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 6 pid: 42623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.144091:0:42623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 6 pid: 42623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.144103:0:42623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788269955.144159:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253062656:12345-192.168.201.42@tcp:101:bash.0 Request processed in 205us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.144166:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00080000:1.0:1788269955.144284:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269955.146622:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.146706:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062784 00000100:00100000:1.0:1788269955.146713:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062784 00000100:00100000:1.0:1788269955.146760:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788269955.146770:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:30372:x1875136253062784:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269955.146784:0:41580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269955.146799:0:41580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101525 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.146824:0:41580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.146833:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269955.146836:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269955.146841:0:41580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.146869:0:41580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.146882:0:41580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.146896:0:41580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:41580:1875136262553728:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269955.146964:0:41580:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.149268:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.149404:0:41580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:41580:1875136262553728:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269955.149444:0:41580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.149474:0:41580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e000, rc 0) 00000100:00100000:1.0:1788269955.149525:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30372:x1875136253062784:12345-192.168.201.42@tcp:101:bash.0 Request processed in 2757us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.149534:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788269955.149905:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253062912 00000100:00100000:3.0:1788269955.149912:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253062912 00010000:00010000:3.0:1788269955.149939:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269955.149970:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788269955.149978:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253062912:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269955.149989:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269955.150006:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.150019:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.150068:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07aef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610151e expref: 7 pid: 42623 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.150082:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269955.150086:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269955.150093:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.150104:0:40061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.150144:0:40061:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269955.150156:0:40061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:40061:1875136262553856:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788269955.150207:0:40061:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2486616c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.153164:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269955.153262:0:40061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:40061:1875136262553856:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788269955.153282:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269955.153327:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253062912:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3349us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.153337:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788269955.153411:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253063168 00000100:00100000:1.0:1788269955.153417:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253063168 00000100:00100000:1.0:1788269955.153464:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788269955.153473:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+15:30372:x1875136253063168:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:1.0:1788269955.153698:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+16:30372:x1875136253063168:12345-192.168.201.42@tcp:35:bash.0 Request processed in 225us (541us total) trans 25769803780 rc 0/0 00000100:00100000:1.0:1788269955.153705:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:2.0:1788269955.207355:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269955.207453:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253063296 00000100:00100000:3.0:1788269955.207463:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253063296 00000100:00100000:3.0:1788269955.207518:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788269955.207527:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+16:30378:x1875136253063296:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269955.207549:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269955.207566:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610152c expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.207627:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee400/0xc5f5d7a016e07b04 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.207640:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee400/0xc5f5d7a016e07b04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.207651:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee400/0xc5f5d7a016e07b04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269955.207692:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788269955.207695:0:40075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788269955.207727:0:40075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee400/0xc5f5d7a016e07b04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.207753:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610152c expref: 18 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.207773:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee400/0xc5f5d7a016e07b04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610152c expref: 17 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.207781:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:3.0:1788269955.207784:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269955.207787:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee400, rc 0) 00000100:00100000:3.0:1788269955.207845:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+17:30378:x1875136253063296:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 319us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.207852:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:2.0:1788269955.211783:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.211873:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253063552 00000100:00100000:1.0:1788269955.211882:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253063552 00000100:00100000:1.0:1788269955.211934:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788269955.211943:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+17:30378:x1875136253063552:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269955.211959:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269955.211978:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07b0b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101533 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.212328:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.212343:0:42351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 18 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.212358:0:42351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 4/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.212389:0:42351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 18 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.212403:0:42351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 18 pid: 40076 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.212428:0:42351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:42351:1875136262553984:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269955.212536:0:42351:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.214812:0:42351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:42351:1875136262553984:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788269955.214837:0:42351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269955.215673:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.215733:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253063680 00000100:00100000:0.0:1788269955.215740:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253063680 00010000:00010000:0.0:1788269955.215776:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 19 pid: 40076 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269955.215815:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:0.0:1788269955.215823:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:2400:x1875136253063680:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269955.215835:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269955.215841:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 19 pid: 40076 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.215854:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 19 pid: 40076 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.215876:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07ae1 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101517 expref: 19 pid: 40076 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.215895:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61d00) 00010000:00010000:0.0:1788269955.215900:0:40060:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.215909:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.215917:0:40060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.215943:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269955.215991:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:2400:x1875136253063680:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 168us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.215998:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00010000:00010000:2.0:1788269955.216203:0:42351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.216211:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269955.216227:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:2.0:1788269955.216337:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07b0b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101533 expref: 19 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.216351:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101533 expref: 18 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.216359:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61d00) 00010000:00010000:2.0:1788269955.216362:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269955.216364:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e400, rc 0) 00000100:00100000:2.0:1788269955.216616:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:30378:x1875136253063552:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 4673us (4840us total) trans 25769803781 rc 0/0 00000100:00100000:2.0:1788269955.216624:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788269955.219974:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.220082:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253063936 00000100:00100000:0.0:1788269955.220090:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253063936 00000100:00100000:0.0:1788269955.220151:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:0.0:1788269955.220160:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:30378:x1875136253063936:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269955.220182:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269955.220185:0:40076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788269955.220207:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07b12 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101533 expref: 18 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.220225:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61d00) 00010000:00010000:0.0:1788269955.220246:0:40076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269955.220260:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07b20 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610153a expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.220357:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07b27 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.220369:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07b27 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.220378:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07b27 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269955.220388:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:0.0:1788269955.220854:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07b20 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610153a expref: 20 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.220868:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07b27 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610153a expref: 19 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.220875:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788269955.220878:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788269955.220881:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:0.0:1788269955.221000:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:30378:x1875136253063936:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 840us (1033us total) trans 25769803782 rc 0/0 00000100:00100000:0.0:1788269955.221007:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788269955.224233:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.224383:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064064 00000100:00100000:2.0:1788269955.224393:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064064 00000100:00100000:2.0:1788269955.224459:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788269955.224468:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:30378:x1875136253064064:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269955.224492:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.224510:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101541 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.224558:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 20 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.224570:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 20 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.224586:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269955.224589:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269955.224592:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ca00, rc 0) 00000100:00100000:2.0:1788269955.224644:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+20:30378:x1875136253064064:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 176us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.224650:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788269955.230166:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.230295:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064192 00000100:00100000:1.0:1788269955.230305:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064192 00000100:00100000:1.0:1788269955.230358:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:1.0:1788269955.230368:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253064192:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:1.0:1788269955.230409:0:41579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.230429:0:41579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.230438:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269955.230442:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269955.230456:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.230494:0:41579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.230508:0:41579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 6 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.230523:0:41579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:41579:1875136262554112:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269955.230593:0:41579:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269955.232018:0:41579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:41579:1875136262554112:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269955.232079:0:41579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269955.233676:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.233824:0:41583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064320 00000100:00100000:1.0:1788269955.233834:0:41583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064320 00002000:00100000:1.0:1788269955.233881:0:41583:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa2:0x0] (0->8) req@ffff98c14262d180 x1875136253064320/t0(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:371/0 lens 504/0 e 0 to 0 dl 1788269966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269955.233894:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262d180 with x1875136253064320 ext(0->8) 00010000:00010000:1.0:1788269955.233903:0:41583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 7 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.233920:0:41583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 7 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269955.233928:0:41583:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c14262d180 00000100:00100000:1.0:1788269955.233956:0:41583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269955.233965:0:41583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253064320:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:1.0:1788269955.235024:0:41583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2401:x1875136253064320:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 1056us (1350us total) trans 25769803779 rc 0/0 00000100:00100000:1.0:1788269955.235034:0:41583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:1.0:1788269955.235060:0:41583:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa2:0x0] (0->8) req@ffff98c14262d180 x1875136253064320/t25769803779(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:371/0 lens 504/448 e 0 to 0 dl 1788269966 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269955.235070:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262d180 with x1875136253064320 ext(0->8) 00010000:00010000:1.0:1788269955.235077:0:41583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 9 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.235092:0:41583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 9 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269955.235100:0:41583:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c14262d180 00000100:00100000:3.0:1788269955.236638:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.236788:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064448 00000100:00100000:2.0:1788269955.236798:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064448 00010000:00010000:2.0:1788269955.236850:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 9 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269955.236903:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788269955.236914:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2401:x1875136253064448:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269955.236932:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788269955.236955:0:40061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788269955.236959:0:40061:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788269955 00002000:00010000:2.0:1788269955.236962:0:40061:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa2:0x0] updating lvb atime from disk: 0 -> 1788269955 00002000:00010000:2.0:1788269955.236965:0:40061:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa2:0x0] updating lvb ctime from disk: 0 -> 1788269955 00002000:00010000:2.0:1788269955.236968:0:40061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788269955.236976:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 9 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.236992:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 9 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.237015:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e07af6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101525 expref: 9 pid: 41580 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.237031:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269955.237036:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269955.237170:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.237181:0:40061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.237221:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269955.237249:0:41579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237262:0:41579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269955.237272:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2401:x1875136253064448:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 358us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.237279:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00010000:00010000:1.0:1788269955.237284:0:41579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237295:0:41579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237305:0:41579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237313:0:41579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269955.237317:0:41579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237327:0:41579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237339:0:41579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.237346:0:41579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e07b3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.237400:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253064192:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 7034us (7244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.237408:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788269955.238829:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.238892:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064704 00000100:00100000:1.0:1788269955.238899:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064704 00000100:00100000:1.0:1788269955.238939:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:1.0:1788269955.238947:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+20:30378:x1875136253064704:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:1.0:1788269955.238997:0:40077:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b11:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07b27 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610153a expref: 20 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269955.239297:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803783 00000001:00080000:1.0:1788269955.239325:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803784 00000001:00080000:1.0:1788269955.239685:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803785 00010000:00010000:1.0:1788269955.239716:0:40077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.239730:0:40077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 24 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.239739:0:40077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.239768:0:40077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 24 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.239782:0:40077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 24 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.239796:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:40077:1875136262554240:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269955.239914:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269955.241919:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.241986:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:40077:1875136262554240:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269955.242009:0:40077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269955.242483:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064832 00000100:00100000:2.0:1788269955.242491:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064832 00010000:00010000:2.0:1788269955.242525:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 25 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269955.242566:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788269955.242578:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:2401:x1875136253064832:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269955.242592:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269955.242599:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 25 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.243692:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 25 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.243774:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e07b35 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101541 expref: 25 pid: 41798 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.243793:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269955.243799:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.243808:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.243817:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.243848:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269955.243875:0:40077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.243884:0:40077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269955.243988:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803786 00000001:00080000:1.0:1788269955.244104:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803787 00000100:00100000:1.0:1788269955.244197:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:40077:1875136262554368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269955.244272:0:40077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.244308:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244540 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.244461:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262554368 00000100:00100000:0.0:1788269955.244467:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262554368 00000100:00100000:0.0:1788269955.244513:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788269955.244520:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:40077:x1875136262554368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788269955.244586:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:40077:x1875136262554368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.244593:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269955.244660:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:2401:x1875136253064832:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 2082us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.244668:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00080000:1.0:1788269955.244720:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269955.244748:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:40077:1875136262554368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269955.244871:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803788 00000100:00100000:1.0:1788269955.244905:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:40077:1875136262554496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269955.244928:0:40077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.244954:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b81b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.245035:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262554496 00000100:00100000:2.0:1788269955.245190:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262554496 00000100:00100000:2.0:1788269955.245242:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269955.245249:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:40077:x1875136262554496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269955.245338:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:40077:x1875136262554496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (408us total) trans 25769803780 rc 0/0 00000100:00100000:2.0:1788269955.245345:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788269955.245390:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:40077:1875136262554496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269955.245430:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803789 00010000:00010000:1.0:1788269955.245462:0:40077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.245471:0:40077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.245478:0:40077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.245485:0:40077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269955.245489:0:40077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.245497:0:40077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.245509:0:40077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788269955.245512:0:40077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788269955.245516:0:40077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.245522:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e07b43 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269955.245594:0:40077:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788269955.245647:0:40077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].2, 64 off8320 00000004:00080000:1.0:1788269955.245657:0:40077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 746952616654ns, next at 747952615124ns, rc = 0 00000001:00080000:1.0:1788269955.245662:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803790 00010000:00010000:1.0:1788269955.245678:0:40077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788269955.245681:0:40077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788269955.245686:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07b27 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610153a expref: 28 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.245750:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:30378:x1875136253064704:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 6803us (6925us total) trans 25769803791 rc 0/0 00000100:00100000:1.0:1788269955.245757:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000020:00080000:1.0:1788269955.245761:0:40077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788269955.248847:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.248988:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253064960 00000100:00100000:2.0:1788269955.248996:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253064960 00000100:00100000:2.0:1788269955.249135:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788269955.249145:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:30378:x1875136253064960:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269955.249167:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.249187:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101548 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.249237:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 28 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.249250:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 28 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.249266:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:2.0:1788269955.249269:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269955.249272:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c400, rc 0) 00000100:00100000:2.0:1788269955.249316:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+28:30378:x1875136253064960:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 173us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.249323:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788269955.262523:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.262660:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065216 00000100:00100000:1.0:1788269955.262669:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065216 00000100:00100000:1.0:1788269955.262729:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788269955.262738:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c243da0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+28:30378:x1875136253065216:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788269955.262979:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c243da0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:30378:x1875136253065216:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 241us (466us total) trans 25769803792 rc 0/0 00000100:00100000:1.0:1788269955.262990:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788269955.265896:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.265981:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065344 00000100:00100000:2.0:1788269955.265990:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065344 00000100:00100000:2.0:1788269955.266035:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:2.0:1788269955.266078:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:29740:x1875136253065344:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269955.266092:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.266198:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e07b51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610154f expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.266226:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e07b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610154f expref: 12 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.266237:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e07b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610154f expref: 12 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.266246:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ca00, rc 0) 00000100:00100000:2.0:1788269955.266297:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29740:x1875136253065344:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 222us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.266304:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:0.0:1788269955.270738:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269955.270856:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065472 00000100:00100000:3.0:1788269955.270865:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065472 00000100:00100000:3.0:1788269955.270913:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:3.0:1788269955.270923:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29740:x1875136253065472:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269955.271086:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29740:x1875136253065472:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 164us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.271094:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:3.0:1788269955.272663:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269955.272843:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065600 00000100:00100000:2.0:1788269955.272851:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065600 00000100:00100000:2.0:1788269955.272891:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:2.0:1788269955.272900:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29740:x1875136253065600:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269955.273100:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29740:x1875136253065600:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 200us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.273120:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:1.0:1788269955.281135:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.281588:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065728 00000100:00100000:0.0:1788269955.281599:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065728 00000100:00100000:0.0:1788269955.281653:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:0.0:1788269955.281663:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:29740:x1875136253065728:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269955.281679:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269955.281696:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f0600/0xc5f5d7a016e07b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101556 expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.281724:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f0600/0xc5f5d7a016e07b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101556 expref: 13 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.281735:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f0600/0xc5f5d7a016e07b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101556 expref: 13 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.281743:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0600, rc 0) 00000100:00100000:0.0:1788269955.281800:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29740:x1875136253065728:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 138us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.281807:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:0.0:1788269955.283009:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269955.283237:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065856 00000100:00100000:3.0:1788269955.283244:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065856 00000100:00100000:3.0:1788269955.283279:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:3.0:1788269955.283287:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29740:x1875136253065856:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269955.283459:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29740:x1875136253065856:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 172us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.283466:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:3.0:1788269955.284688:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.284781:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253065984 00000100:00100000:0.0:1788269955.284785:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253065984 00000100:00100000:0.0:1788269955.285060:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:0.0:1788269955.285069:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29740:x1875136253065984:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269955.285203:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:29740:x1875136253065984:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 135us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.285211:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:1.0:1788269955.327482:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.327872:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253066240 00000100:00100000:0.0:1788269955.327882:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253066240 00000100:00100000:0.0:1788269955.327978:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:0.0:1788269955.327989:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:30390:x1875136253066240:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269955.328010:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269955.328029:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610155d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269955.328169:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788269955.328255:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07b5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610155d expref: 31 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.328270:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:0.0:1788269955.328273:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269955.328278:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610155d expref: 31 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.328289:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1a00, rc 0) 00000100:00100000:0.0:1788269955.328343:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30390:x1875136253066240:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 356us (869us total) trans 25769803793 rc 301/301 00000100:00100000:0.0:1788269955.328350:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788269955.329537:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.329631:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253066368 00000100:00100000:0.0:1788269955.329637:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253066368 00000100:00100000:0.0:1788269955.329674:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:0.0:1788269955.329681:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30390:x1875136253066368:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788269955.329726:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329742:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329756:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329767:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329775:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329782:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329842:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329850:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329856:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269955.329889:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329899:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329906:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329913:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329919:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269955.329923:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329930:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329939:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:0.0:1788269955.329942:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269955.329945:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329952:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07b6d lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329963:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329968:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329974:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329979:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269955.329982:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329989:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.329995:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c250e61100) 00010000:00010000:0.0:1788269955.329997:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269955.329999:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330005:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07b74 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330014:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330019:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330025:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330030:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269955.330032:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330068:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330075:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:0.0:1788269955.330077:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269955.330081:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.330087:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1800/0xc5f5d7a016e07b7b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269955.330146:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30390:x1875136253066368:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 464us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.330153:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788269955.331389:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.331459:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253066624 00000100:00100000:1.0:1788269955.331465:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253066624 00000100:00100000:1.0:1788269955.331507:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788269955.331515:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30390:x1875136253066624:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788269955.331690:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:30390:x1875136253066624:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 175us (304us total) trans 25769803794 rc 0/0 00000100:00100000:1.0:1788269955.331698:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 10000000:01000000:1.0:1788269955.333140:0:40072:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269955.333146:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c24b03b000 from 13 10000000:01000000:1.0:1788269955.333150:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269955.333186:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.333197:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.333206:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.333226:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262554624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.333270:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.333300:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.333851:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262554624 00000100:00100000:2.0:1788269955.333859:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262554624 00000100:00100000:2.0:1788269955.333905:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788269955.333914:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+20:40072:x1875136262554624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269955.333927:0:40068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.333950:0:40068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e07b89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07b82 expref: -99 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.333975:0:40068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e07b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07b82 expref: 21 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.333986:0:40068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e07b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07b82 expref: 21 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.333995:0:40068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5da00, rc 0) 00000100:00100000:2.0:1788269955.334034:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262554624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.334060:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788269955.334544:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262554624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269955.334560:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.334570:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.334640:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262554752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.334665:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.334694:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.334733:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262554752 00000100:00100000:0.0:1788269955.334739:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262554752 00000100:00100000:0.0:1788269955.334772:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788269955.334779:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262554752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269955.334880:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262554752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.334887:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788269955.334946:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262554752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.334970:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262554880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.335001:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.335309:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.336319:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262554880 00000100:00100000:0.0:1788269955.336329:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262554880 00000100:00100000:0.0:1788269955.336375:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788269955.336384:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262554880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269955.336523:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262554880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.336532:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788269955.336549:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262554880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788269955.337516:0:43113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788269955.337629:0:40072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788269955.337647:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269955.337657:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.337667:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269955.337677:0:40072:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269955.337679:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c143776800 from 13 10000000:01000000:1.0:1788269955.337682:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269955.337710:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.337717:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.337727:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.337745:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.337785:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.337817:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269955.337862:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555008 00000100:00100000:3.0:1788269955.337868:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555008 00000100:00100000:3.0:1788269955.337902:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788269955.337910:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+21:40072:x1875136262555008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269955.337919:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269955.337931:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9efc00/0xc5f5d7a016e07b97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07b90 expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.337953:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9efc00/0xc5f5d7a016e07b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07b90 expref: 22 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.337963:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9efc00/0xc5f5d7a016e07b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07b90 expref: 22 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.337971:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9efc00, rc 0) 00000100:00100000:3.0:1788269955.338010:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262555008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.338016:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788269955.338121:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269955.338134:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.338143:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.338194:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.338218:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.338235:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.338346:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555136 00000100:00100000:0.0:1788269955.338350:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555136 00000100:00100000:0.0:1788269955.338376:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788269955.338383:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262555136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269955.338469:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262555136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.338477:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788269955.338561:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.338582:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.338618:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.338632:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.338653:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555264 00000100:00100000:2.0:1788269955.338659:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555264 00000100:00100000:2.0:1788269955.338695:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788269955.338703:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262555264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269955.338787:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262555264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.338794:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788269955.338868:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788269955.341403:0:43114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788269955.341613:0:40072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788269955.341633:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269955.341643:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.341655:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269955.341665:0:40072:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269955.341667:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27b77a000 from 13 10000000:01000000:1.0:1788269955.341670:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269955.341701:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.341708:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.341718:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.341738:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.341793:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.341827:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269955.341897:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555392 00000100:00100000:3.0:1788269955.341903:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555392 00000100:00100000:3.0:1788269955.341942:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788269955.341950:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+22:40072:x1875136262555392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269955.341962:0:40069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269955.341973:0:40069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9ef400/0xc5f5d7a016e07ba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07b9e expref: -99 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.341993:0:40069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ef400/0xc5f5d7a016e07ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07b9e expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.342002:0:40069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9ef400/0xc5f5d7a016e07ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07b9e expref: 23 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269955.342011:0:40069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ef400, rc 0) 00000100:00100000:3.0:1788269955.342064:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262555392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.342074:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788269955.342276:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269955.342289:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.342297:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.342343:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.342366:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.342386:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269955.343182:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555520 00000100:00100000:0.0:1788269955.343187:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555520 00000100:00100000:0.0:1788269955.343229:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788269955.343239:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262555520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269955.343350:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262555520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269955.343359:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788269955.343378:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.343411:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.343450:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.343477:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.343519:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555648 00000100:00100000:2.0:1788269955.343523:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555648 00000100:00100000:2.0:1788269955.343577:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788269955.343584:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262555648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269955.343655:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262555648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.343662:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788269955.343719:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788269955.344828:0:43115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788269955.344898:0:40072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788269955.344923:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269955.344931:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.344942:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269955.344951:0:40072:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269955.344954:0:40072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c145155800 from 13 10000000:01000000:1.0:1788269955.344956:0:40072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269955.344978:0:40072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.344985:0:40072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.344994:0:40072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.345008:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.345079:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.345121:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.346239:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555776 00000100:00100000:2.0:1788269955.346247:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555776 00000100:00100000:2.0:1788269955.346288:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788269955.346297:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+23:40072:x1875136262555776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269955.346311:0:40070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269955.346324:0:40070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e07bb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07bac expref: -99 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.346346:0:40070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e07bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07bac expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.346356:0:40070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e07bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07bac expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269955.346365:0:40070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5dc00, rc 0) 00000100:00100000:2.0:1788269955.346412:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262555776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.346419:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788269955.346449:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269955.346463:0:40072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269955.346472:0:40072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.346519:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.346541:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.346571:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269955.346648:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262555904 00000100:00100000:3.0:1788269955.346652:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262555904 00000100:00100000:3.0:1788269955.346682:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788269955.346689:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2489f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262555904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269955.346782:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2489f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262555904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.346789:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788269955.347608:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262555904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.347638:0:40072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262556032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269955.347701:0:40072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269955.347724:0:40072:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269955.347734:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556032 00000100:00100000:2.0:1788269955.347738:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556032 00000100:00100000:2.0:1788269955.347767:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788269955.347772:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262556032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269955.347843:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:40072:x1875136262556032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.347848:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788269955.347914:0:40072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e129e33-0062-408b-ba53-2e2ae2985734:40072:1875136262556032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788269955.349021:0:43116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788269955.350514:0:40072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788269955.350538:0:40072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269955.350553:0:40072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.350565:0:40072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269955.588971:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.589029:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.589093:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.589125:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.589141:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.589161:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269955.589195:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253066880 00000100:00100000:1.0:1788269955.589203:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253066880 00000100:00100000:3.0:1788269955.589244:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067392 00000100:00100000:3.0:1788269955.589248:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067392 00000100:00100000:3.0:1788269955.589301:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067264 00000100:00100000:3.0:1788269955.589303:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067264 00000100:00100000:3.0:1788269955.589325:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788269955.589334:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269955.589396:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 63us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.589402:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788269955.589416:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788269955.589422:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269955.589441:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 19us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.589447:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00080000:3.0:1788269955.589460:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269955.589464:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269955.589690:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067136 00000100:00100000:0.0:1788269955.589694:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067136 00000100:00080000:3.0:1788269955.589733:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269955.589734:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253066752 00000100:00100000:0.0:1788269955.589739:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253066752 00000100:00100000:0.0:1788269955.589810:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067008 00000100:00100000:0.0:1788269955.589813:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067008 00000100:00100000:1.0:1788269955.589907:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788269955.589914:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253066880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269955.589943:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253066880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269955.589949:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269955.593422:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788269955.593702:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788269955.593703:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269955.593717:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253066752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269955.593783:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 346us (4751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.593788:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253066752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 74us (4659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269955.593798:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788269955.593804:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:2.0:1788269955.593830:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788269955.593842:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269955.593865:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2400:x1875136253067008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269955.594332:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00080000:3.0:1788269955.594343:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269955.641770:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269955.641867:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067648 00000100:00100000:0.0:1788269955.641877:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067648 00000100:00100000:0.0:1788269955.641927:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:0.0:1788269955.641939:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:30406:x1875136253067648:12345-192.168.201.42@tcp:101:multiop.0 00010000:00010000:0.0:1788269955.641963:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269955.641967:0:40076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788269955.641993:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee400/0xc5f5d7a016e07b04 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610152c expref: 31 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642013:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:0.0:1788269955.642017:0:40076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269955.642030:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07bba lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101564 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642209:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642223:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642233:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642243:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642250:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642256:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642305:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642314:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642325:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269955.642333:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:0.0:1788269955.642416:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642424:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642430:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642436:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269955.642441:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642449:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642457:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:0.0:1788269955.642460:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269955.642464:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642470:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07bc1 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642479:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642484:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642490:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642496:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269955.642498:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642504:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642510:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c250e61100) 00010000:00010000:0.0:1788269955.642513:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269955.642515:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642521:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e07bc8 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642570:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e07bba lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 33 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642583:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 32 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269955.642590:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:0.0:1788269955.642592:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269955.642595:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0000, rc 0) 00000100:00100000:0.0:1788269955.642990:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:30406:x1875136253067648:12345-192.168.201.42@tcp:101:multiop.0 Request processed in 1052us (1229us total) trans 25769803795 rc 0/0 00000100:00100000:0.0:1788269955.643002:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00010000:00010000:2.0:1788269955.781288:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269955.847548:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788269955.972607:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788269956.804228:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269956.804251:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262556160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269956.804317:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.805731:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262556288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269956.805771:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269956.805905:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556160 00000100:00100000:3.0:1788269956.805913:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556160 00000100:00100000:3.0:1788269956.805965:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556288 00000100:00100000:3.0:1788269956.805968:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556288 00000100:00100000:3.0:1788269956.805983:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269956.805991:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262556160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269956.806018:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788269956.806093:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262556160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269956.806100:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269956.806116:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269956.806123:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262556288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788269956.806138:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923484672 avail 3691962368 00000100:00080000:1.0:1788269956.806241:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269956.806246:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269956.806272:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803778 gen 2 00010000:00010000:0.0:1788269956.806280:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269956.806304:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262556288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269956.806324:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262556160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269956.806347:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262556416:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788269956.806349:0:40101:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748513307962ns, next at 749513304408ns, rc = 0 00000100:00100000:2.0:1788269956.807202:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262556544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788269956.807378:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262556288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1253us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269956.807387:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269956.807425:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262556800:0@lo:400:kworker.0 00000100:00100000:3.0:1788269956.807437:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262556672:0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.810705:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269956.810719:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.810776:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262556928:0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.810777:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262557056:0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.810827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269956.810832:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269956.810858:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262557568:0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.810862:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262557440:0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.810895:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.810933:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556416 00000100:00100000:1.0:1788269956.810941:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556416 00000100:00100000:2.0:1788269956.810944:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556544 00000100:00100000:2.0:1788269956.810950:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556544 00000100:00100000:1.0:1788269956.810989:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269956.810993:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788269956.811002:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262556416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269956.811006:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262556544:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1788269956.811051:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923484672 avail 3691962368 00000004:00000024:2.0:1788269956.811055:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446404096 avail 1300164608 00000100:00100000:1.0:1788269956.811122:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262556416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269956.811126:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262556544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.811134:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269956.811138:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788269956.811169:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557056 00000100:00100000:2.0:1788269956.811174:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557056 00000100:00100000:2.0:1788269956.811197:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557568 00000100:00100000:2.0:1788269956.811199:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557568 00000100:00100000:2.0:1788269956.811225:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788269956.811231:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262557056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.811262:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262557056:12345-0@lo:400:kworker.0 Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269956.811268:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788269956.811281:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269956.811287:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262557568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.811312:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262557568:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269956.811318:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269956.811356:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262557056:0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.811366:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262557568:0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.811380:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262556544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788269956.811426:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556928 00000100:00100000:2.0:1788269956.811430:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556928 00000100:00100000:1.0:1788269956.812286:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.812319:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262557952:0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.812347:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.812390:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262556416:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788269956.812415:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269956.812424:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557440 00000100:00100000:1.0:1788269956.812427:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557440 00000100:00100000:1.0:1788269956.812448:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557952 00000100:00100000:1.0:1788269956.812450:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557952 00000100:00100000:1.0:1788269956.812469:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788269956.812475:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262557440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.812507:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262557440:12345-0@lo:400:kworker.0 Request processed in 32us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.812524:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788269956.812537:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269956.812542:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262557952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.812566:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262557952:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.813426:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788269956.813446:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269956.813471:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262557440:0@lo:400:kworker.0 00010000:00080000:1.0:1788269956.813484:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c24821f100 x1875136262557952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269956.813501:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262557952:0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.827572:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269956.827595:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262556928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269956.827723:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262556928:12345-0@lo:400:kworker.0 Request processed in 139us (16895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269956.827730:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269956.827813:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262556928:0@lo:400:kworker.0 00000100:00100000:0.0:1788269956.830522:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269956.830565:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262557312:0@lo:400:kworker.0 00000100:00100000:0.0:1788269956.830602:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269956.830618:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262557824:0@lo:400:kworker.0 00000100:00100000:0.0:1788269956.830641:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.831121:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557312 00000100:00100000:1.0:1788269956.831130:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557312 00000100:00100000:1.0:1788269956.831206:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269956.831216:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262557312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.831266:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262557312:12345-0@lo:400:kworker.0 Request processed in 52us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.831273:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269956.831293:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557824 00000100:00100000:1.0:1788269956.831296:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557824 00000100:00100000:1.0:1788269956.831319:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788269956.831325:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262557824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.831350:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262557824:12345-0@lo:400:kworker.0 Request processed in 26us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.831368:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788269956.832448:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269956.832456:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269956.832491:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262557312:0@lo:400:kworker.0 00000100:00100000:0.0:1788269956.832502:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262557824:0@lo:400:kworker.0 00000100:00100000:3.0:1788269956.833525:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269956.834955:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262557184:0@lo:400:kworker.0 00000100:00100000:3.0:1788269956.835002:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269956.835056:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262557696:0@lo:400:kworker.0 00000100:00100000:3.0:1788269956.835092:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269956.836466:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556800 00000100:00100000:1.0:1788269956.836476:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556800 00000100:00100000:1.0:1788269956.836525:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557184 00000100:00100000:1.0:1788269956.836528:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557184 00000100:00100000:1.0:1788269956.836544:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269956.836551:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262556800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.836631:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262556800:12345-0@lo:400:kworker.0 Request processed in 80us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.836637:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269956.836652:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788269956.836658:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262557184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.836685:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262557184:12345-0@lo:400:kworker.0 Request processed in 28us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.836691:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788269956.836708:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262557696 00000100:00100000:1.0:1788269956.836711:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262557696 00000100:00100000:1.0:1788269956.836741:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269956.836747:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262557696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.836774:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262557696:12345-0@lo:400:kworker.0 Request processed in 27us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.836779:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788269956.836804:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269956.836852:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262556800:0@lo:400:kworker.0 00000100:00100000:3.0:1788269956.837671:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262557184:0@lo:400:kworker.0 00010000:00080000:3.0:1788269956.837685:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c24821d880 x1875136262557696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269956.837697:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262557696:0@lo:400:kworker.0 00000100:00100000:0.0:1788269956.838645:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262556672 00000100:00100000:0.0:1788269956.838653:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262556672 00000100:00100000:1.0:1788269956.842320:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788269956.842334:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262556672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269956.842552:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262556672:12345-0@lo:400:kworker.0 Request processed in 219us (9029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269956.842559:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788269956.842717:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262556672:0@lo:400:kworker.0 00010000:00010000:2.0:1788269957.828539:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269958.605113:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.605270:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067776 00000100:00100000:1.0:1788269958.605279:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067776 00000100:00100000:1.0:1788269958.605352:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788269958.605362:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:27818:x1875136253067776:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269958.605381:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269958.605408:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610156b expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.605474:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.605496:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.605508:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269958.605551:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269958.605555:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269958.605571:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.605592:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.605608:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 6 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.605617:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:1.0:1788269958.605621:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269958.605624:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e400, rc 0) 00000100:00100000:1.0:1788269958.605678:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:27818:x1875136253067776:12345-192.168.201.42@tcp:101:bash.0 Request processed in 317us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269958.605686:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00080000:0.0:1788269958.605912:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269958.608705:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.609343:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253067904 00000100:00100000:1.0:1788269958.609351:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253067904 00000100:00100000:1.0:1788269958.609404:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788269958.609413:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:27818:x1875136253067904:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269958.609430:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269958.609446:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101572 expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609508:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609520:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609530:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609541:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609548:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609554:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609630:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e07c00 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609639:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e07c00 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609646:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e07c00 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269958.609675:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269958.609678:0:40074:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269958.609694:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e07c00 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609706:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609713:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609719:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609725:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269958.609729:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609737:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609747:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:1.0:1788269958.609750:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269958.609754:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609760:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609771:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609777:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609783:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609789:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269958.609793:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609798:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609804:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff98c1429f7200) 00010000:00010000:1.0:1788269958.609806:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269958.609809:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609815:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07bf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609836:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101572 expref: 8 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609848:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e07c00 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101572 expref: 7 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.609855:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269958.609857:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788269958.609860:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e600, rc 0) 00000100:00100000:1.0:1788269958.609915:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:27818:x1875136253067904:12345-192.168.201.42@tcp:101:bash.0 Request processed in 502us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269958.609921:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788269958.612550:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.612695:0:40086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253068032 00000100:00100000:1.0:1788269958.612702:0:40086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253068032 00000100:00100000:1.0:1788269958.612758:0:40086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788269958.612766:0:40086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:27818:x1875136253068032:12345-192.168.201.42@tcp:900:bash.0 00000100:00100000:1.0:1788269958.612828:0:40086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:27818:x1875136253068032:12345-192.168.201.42@tcp:900:bash.0 Request processed in 63us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269958.612835:0:40086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00080000:0.0:1788269958.613303:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269958.614277:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269958.614367:0:40084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253068160 00000100:00100000:3.0:1788269958.614372:0:40084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253068160 00000100:00100000:3.0:1788269958.614410:0:40084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788269958.614425:0:40084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:27818:x1875136253068160:12345-192.168.201.42@tcp:700:bash.0 00000100:00100000:3.0:1788269958.614473:0:40084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:27818:x1875136253068160:12345-192.168.201.42@tcp:700:bash.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269958.614480:0:40084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788269958.616136:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.616245:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253068416 00000100:00100000:1.0:1788269958.616251:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253068416 00000100:00100000:1.0:1788269958.616287:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788269958.616295:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:27818:x1875136253068416:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269958.616306:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269958.616323:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c07 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101579 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616444:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616459:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616469:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616479:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616606:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616667:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616718:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c1c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616727:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c1c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616734:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c1c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269958.616744:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:1.0:1788269958.616808:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616815:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616822:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616828:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269958.616832:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616840:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616851:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269958.616854:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269958.616858:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616869:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c0e lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616881:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616886:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616892:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616897:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269958.616900:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616905:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616911:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c250e61100) 00010000:00010000:1.0:1788269958.616913:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269958.616916:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616921:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c15 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616950:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c07 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101579 expref: 10 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616967:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c1c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101579 expref: 9 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.616974:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269958.616976:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269958.616979:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bec00, rc 0) 00000100:00100000:1.0:1788269958.617153:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:27818:x1875136253068416:12345-192.168.201.42@tcp:101:bash.0 Request processed in 858us (1018us total) trans 25769803796 rc 0/0 00000100:00100000:1.0:1788269958.617160:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:2.0:1788269958.626973:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.627085:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253068672 00000100:00100000:1.0:1788269958.627096:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253068672 00000100:00100000:1.0:1788269958.627155:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:1.0:1788269958.627164:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:27818:x1875136253068672:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:1.0:1788269958.627231:0:40076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269958.627256:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c1c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101579 expref: 9 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.627273:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269958.627278:0:40076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269958.627430:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.627444:0:40076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 31 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.627453:0:40076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.627482:0:40076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 31 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.627497:0:40076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 31 pid: 40076 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269958.627510:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:40076:1875136262558080:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269958.627585:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269958.632937:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269958.633008:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253068800 00000100:00100000:2.0:1788269958.633016:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253068800 00010000:00010000:2.0:1788269958.633114:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 32 pid: 40076 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269958.633153:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788269958.633162:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:2400:x1875136253068800:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269958.633175:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269958.633181:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 32 pid: 40076 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.633195:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 32 pid: 40076 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.633215:0:40061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:2.0:1788269958.633220:0:40061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.633229:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.633237:0:40061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.633255:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269958.633296:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:2400:x1875136253068800:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269958.633303:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00010000:00010000:1.0:1788269958.633520:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07bcf lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101564 expref: 31 pid: 40076 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269958.633536:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:40076:1875136262558080:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269958.633553:0:40076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.633561:0:40076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.633568:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269958.633649:0:40076:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803797 00000004:00010000:1.0:1788269958.633685:0:40076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f2645c6 reply state 00000000b15f674b transno 25769803798 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.633696:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.633707:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269958.633710:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269958.633712:0:40076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269958.633785:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253068672:12345-192.168.201.42@tcp:36:bash.0 Request processed in 6622us (6820us total) trans 25769803798 rc 0/0 00000100:00100000:1.0:1788269958.633792:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000020:00080000:1.0:1788269958.633795:0:40076:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788269958.634877:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269958.648579:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269958.648710:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253068928 00000100:00100000:2.0:1788269958.648720:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253068928 00000100:00100000:2.0:1788269958.648781:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788269958.648790:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253068928:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788269958.648821:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269958.648839:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07c31 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101580 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.648891:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07c31 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101580 expref: 12 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.648905:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07c31 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101580 expref: 12 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.648922:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:2.0:1788269958.648925:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269958.648929:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:2.0:1788269958.649019:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+12:27818:x1875136253068928:12345-192.168.201.42@tcp:101:bash.0 Request processed in 230us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269958.649026:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788269958.651478:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.651707:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253069184 00000100:00100000:1.0:1788269958.651714:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253069184 00000100:00100000:1.0:1788269958.651765:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269958.651773:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+12:27818:x1875136253069184:12345-192.168.201.42@tcp:103:bash.0 00010000:00010000:1.0:1788269958.651784:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269958.651803:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07c31 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101580 expref: 12 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.651820:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269958.651825:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269958.651862:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253069184:12345-192.168.201.42@tcp:103:bash.0 Request processed in 90us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269958.651870:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788269958.653529:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.654652:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253069312 00000100:00100000:1.0:1788269958.654660:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253069312 00000100:00100000:1.0:1788269958.654707:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:1.0:1788269958.654715:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253069312:12345-192.168.201.42@tcp:58:bash.0 00010000:00010000:1.0:1788269958.654799:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.654819:0:41798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 30 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.654829:0:41798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.654858:0:41798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 30 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.654872:0:41798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 30 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269958.654886:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:41798:1875136262558208:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269958.655000:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269958.661018:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:41798:1875136262558208:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788269958.661020:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269958.661139:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253069440 00000100:00100000:3.0:1788269958.661146:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253069440 00010000:00010000:1.0:1788269958.661173:0:41798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661186:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 31 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269958.661231:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788269958.661239:0:40062:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788269958.661242:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:2402:x1875136253069440:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788269958.661249:0:40062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788269958.661261:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269958.661272:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 31 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661287:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 31 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661307:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07b4a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101548 expref: 31 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661331:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:3.0:1788269958.661337:0:40060:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661347:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661355:0:40060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269958.661380:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269958.661425:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:2402:x1875136253069440:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 186us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269958.661432:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00010000:00010000:2.0:1788269958.661501:0:41798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269958.661510:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269958.662855:0:41798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269958.663182:0:41798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 64 off8512 00000040:00080000:2.0:1788269958.663311:0:41798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].1, 136 off8328 00000100:00100000:2.0:1788269958.663381:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253069312:12345-192.168.201.42@tcp:58:bash.0 Request processed in 8664us (10205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269958.663390:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788269958.665785:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269958.665875:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253069568 00000100:00100000:1.0:1788269958.665883:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253069568 00000100:00100000:1.0:1788269958.665927:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788269958.665936:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253069568:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269958.665954:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269958.665973:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101587 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.666024:0:40076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 2/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.666034:0:40076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 4/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.666273:0:40076:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.666287:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.666300:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269958.666303:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269958.666307:0:40076:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269958.666316:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e000, rc 0) 00000100:00100000:1.0:1788269958.666360:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+12:27818:x1875136253069568:12345-192.168.201.42@tcp:101:bash.0 Request processed in 425us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269958.666366:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00010000:00010000:2.0:1788269958.857810:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269958.859768:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262558336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788269958.859834:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269958.859895:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262558336 00000100:00100000:3.0:1788269958.859903:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262558336 00000100:00100000:3.0:1788269958.859975:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269958.859992:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262558336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788269958.860033:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446227968 avail 1299988480 00000100:00100000:3.0:1788269958.860131:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262558336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269958.860193:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262558336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269958.860410:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:3.0:1788269959.044250:0:40112:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788269959.044260:0:40112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269959.044284:0:40112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:3.0:1788269959.044292:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1788269959.044421:0:40112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:40112:1875136262558464:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269959.044523:0:40112:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269959.051652:0:40112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:40112:1875136262558464:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269959.053443:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.054442:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253069696 00000100:00100000:1.0:1788269959.054452:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253069696 00000100:00100000:1.0:1788269959.054523:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788269959.054534:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30429:x1875136253069696:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269959.054564:0:40075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269959.054673:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30429:x1875136253069696:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 140us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.054681:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:0.0:1788269959.060776:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.060882:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253069824 00000100:00100000:2.0:1788269959.060892:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253069824 00000100:00100000:2.0:1788269959.060955:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:2.0:1788269959.060966:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30429:x1875136253069824:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788269959.062663:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062682:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062694:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062711:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062719:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062725:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062748:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062757:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062764:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269959.062811:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788269959.062816:0:41798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269959.062828:0:41798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062839:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062845:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062851:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062857:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269959.062861:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062868:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062880:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:2.0:1788269959.062884:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269959.062889:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062895:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07c46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062909:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062915:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062920:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062925:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5cc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269959.062927:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062932:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062939:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb72e0cac (ffff98c250e61800) 00010000:00010000:2.0:1788269959.062941:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269959.062944:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062949:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c4d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062975:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062981:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062987:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.062992:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269959.063003:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.063010:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.063017:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:2.0:1788269959.063020:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269959.063023:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.063028:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c54 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269959.063152:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30429:x1875136253069824:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 2186us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.063161:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:2.0:1788269959.072166:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.073092:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253070080 00000100:00100000:1.0:1788269959.073103:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253070080 00000100:00100000:1.0:1788269959.073172:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:1.0:1788269959.073183:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:30429:x1875136253070080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.073204:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.073223:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610158e expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073324:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073340:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073352:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269959.073363:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788269959.073722:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073731:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073738:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073744:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.073748:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073756:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073767:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.073770:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269959.073775:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073780:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c62 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073818:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c5b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610158e expref: 32 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073829:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:1.0:1788269959.073832:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269959.073836:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610158e expref: 32 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.073844:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f400, rc 0) 00000100:00100000:1.0:1788269959.073906:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:30429:x1875136253070080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 724us (1750us total) trans 25769803799 rc 301/301 00000100:00100000:1.0:1788269959.073913:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788269959.082911:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.082999:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253070208 00000100:00100000:1.0:1788269959.083009:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253070208 00000100:00100000:1.0:1788269959.083824:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788269959.083837:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:30429:x1875136253070208:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269959.083869:0:40074:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269959.083970:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:30429:x1875136253070208:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 137us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.083988:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788269959.091310:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.091726:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253070464 00000100:00100000:2.0:1788269959.091736:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253070464 00000100:00100000:2.0:1788269959.091798:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:2.0:1788269959.091810:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:30429:x1875136253070464:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269959.091831:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269959.091852:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c70 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101595 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269959.092251:0:41798:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x63:0x0], count =63 00000004:00080000:2.0:1788269959.092257:0:41798:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x63:0x0]+63 in llog 00000004:00080000:2.0:1788269959.092266:0:41798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2:0x0], index 0: 0 00010000:00010000:2.0:1788269959.092557:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c77 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.092571:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c77 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.092583:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c77 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.092637:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07c70 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101595 expref: 34 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.092656:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c77 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101595 expref: 33 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.092665:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c250e61800) 00010000:00010000:2.0:1788269959.092667:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269959.092671:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5cc00, rc 0) 00000100:00100000:2.0:1788269959.092716:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:30429:x1875136253070464:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 909us (1415us total) trans 25769803800 rc 0/0 00000100:00100000:2.0:1788269959.092722:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788269959.104096:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.104224:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253070720 00000100:00100000:1.0:1788269959.104235:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253070720 00000100:00100000:1.0:1788269959.104291:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788269959.104301:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:30429:x1875136253070720:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.104354:0:40076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269959.104395:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07c77 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101595 expref: 33 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104415:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c250e61800) 00010000:00010000:1.0:1788269959.104448:0:40076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269959.104469:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104482:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104491:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104505:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104511:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104521:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104561:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104568:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104574:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104579:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.104583:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104590:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104597:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269959.104600:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.104603:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104608:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07c85 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104617:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104622:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104628:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104633:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.104635:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104641:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104648:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x98915848 (ffff98c143878600) 00010000:00010000:1.0:1788269959.104650:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.104653:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.104659:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07c8c lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x98915848 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.104735:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:30429:x1875136253070720:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 434us (701us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269959.104741:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:0.0:1788269959.107218:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.107569:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253070848 00000100:00100000:3.0:1788269959.107577:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253070848 00000100:00100000:3.0:1788269959.107630:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788269959.107640:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:30429:x1875136253070848:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269959.107657:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269959.107676:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07c93 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610159c expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.107707:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.107719:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.107729:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.107833:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07c93 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 34 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.107850:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 33 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.107859:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:3.0:1788269959.107862:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269959.107865:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eea00, rc 0) 00000100:00100000:3.0:1788269959.107916:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:30429:x1875136253070848:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 277us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.107923:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:0.0:1788269959.110621:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.110951:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253071104 00000100:00100000:1.0:1788269959.110960:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253071104 00000100:00100000:1.0:1788269959.111028:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788269959.111089:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:30429:x1875136253071104:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.111161:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.111177:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.111188:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269959.111348:0:40075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].2, 88 off8344 00000004:00080000:1.0:1788269959.111359:0:40075:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 750818318983ns, next at 751818316753ns, rc = 0 00000004:00010000:1.0:1788269959.111418:0:40075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058d7d8f0 reply state 0000000019d20e85 transno 25769803801 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.111431:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.111439:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:1.0:1788269959.111442:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788269959.111445:0:40075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269959.111532:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+35:30429:x1875136253071104:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 494us (915us total) trans 25769803801 rc 0/0 00000100:00100000:1.0:1788269959.111540:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788269959.118342:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.118617:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253071232 00000100:00100000:2.0:1788269959.118626:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253071232 00000100:00100000:2.0:1788269959.118680:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788269959.118692:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+35:30429:x1875136253071232:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269959.118714:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269959.118734:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015a3 expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.118788:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 36 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.118801:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 36 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.118819:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:2.0:1788269959.118822:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269959.118826:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d200, rc 0) 00000100:00100000:2.0:1788269959.118875:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:30429:x1875136253071232:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 185us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.118882:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788269959.120942:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.121019:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253071360 00000100:00100000:0.0:1788269959.121025:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253071360 00000100:00100000:0.0:1788269959.121116:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:0.0:1788269959.121125:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253071360:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788269959.121328:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253071360:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 203us (388us total) trans 25769803779 rc 0/0 00000100:00100000:0.0:1788269959.121335:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00080000:1.0:1788269959.121669:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269959.142129:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.142293:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253071616 00000100:00100000:1.0:1788269959.142303:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253071616 00000100:00100000:1.0:1788269959.142360:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788269959.142370:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:30429:x1875136253071616:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788269959.142581:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:30429:x1875136253071616:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 211us (461us total) trans 25769803802 rc 0/0 00000100:00100000:1.0:1788269959.142589:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269959.152818:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.153003:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253071872 00000100:00100000:2.0:1788269959.153013:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253071872 00000100:00100000:2.0:1788269959.153123:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:2.0:1788269959.153135:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:30429:x1875136253071872:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269959.153234:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:30429:x1875136253071872:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.153241:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788269959.158624:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.159024:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072000 00000100:00100000:0.0:1788269959.159033:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072000 00000100:00100000:0.0:1788269959.159141:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:0.0:1788269959.159150:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:30429:x1875136253072000:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269959.159167:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269959.159185:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07caf lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015aa expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.159250:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07cb6 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.159264:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07cb6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.159276:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07cb6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269959.159316:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788269959.159334:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07cb6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.159357:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07caf lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015aa expref: 39 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.159373:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07cb6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015aa expref: 38 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.159382:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:0.0:1788269959.159396:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788269959.159399:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0400, rc 0) 00000100:00100000:0.0:1788269959.159451:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:30429:x1875136253072000:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 302us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269959.159457:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:0.0:1788269959.168695:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.168927:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072128 00000100:00100000:2.0:1788269959.168937:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072128 00000100:00100000:2.0:1788269959.168992:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788269959.169003:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253072128:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269959.169018:0:41579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269959.169254:0:41579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015b1 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269959.169282:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d587, blocks: 0x0 00010000:00010000:2.0:1788269959.169300:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1788269959.169305:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269959.169314:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 7 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.169333:0:41579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 7 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.169346:0:41579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788269959.169748:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253072128:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 745us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.169756:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788269959.182821:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.183773:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072384 00000100:00100000:3.0:1788269959.183784:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072384 00000100:00100000:3.0:1788269959.183840:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:3.0:1788269959.183850:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:30429:x1875136253072384:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788269959.183952:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:30429:x1875136253072384:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 103us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.183959:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:3.0:1788269959.187592:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.187692:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072512 00000100:00100000:1.0:1788269959.187700:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072512 00000100:00100000:1.0:1788269959.187743:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788269959.187753:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30429:x1875136253072512:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.187770:0:41580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.187788:0:41580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015b8 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.187830:0:41580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 8 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.187839:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269959.187844:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269959.187849:0:41580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 8 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.187883:0:41580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 8 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.187897:0:41580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 8 pid: 41579 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.187910:0:41580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:41580:1875136262558592:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269959.187987:0:41580:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269959.190716:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.190767:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072640 00000100:00100000:2.0:1788269959.190774:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072640 00010000:00010000:2.0:1788269959.190806:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 9 pid: 41579 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269959.190839:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788269959.190847:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2400:x1875136253072640:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269959.190859:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269959.190878:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 9 pid: 41579 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.190893:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 9 pid: 41579 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.190914:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269959.190918:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269959.190927:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 9 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.190936:0:40061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 9 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.190970:0:40061:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 9 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269959.190982:0:40061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:40061:1875136262558720:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788269959.191068:0:40061:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1449ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1788269959.194393:0:40061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:40061:1875136262558720:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788269959.194417:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269959.194473:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2400:x1875136253072640:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3625us (3760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.194483:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00010000:00010000:1.0:1788269959.195350:0:41580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e07cbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b1 expref: 8 pid: 41579 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.195369:0:41580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:41580:1875136262558592:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269959.195399:0:41580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.195413:0:41580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ec00, rc 0) 00000100:00100000:1.0:1788269959.195452:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30429:x1875136253072512:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 7700us (7867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.195460:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788269959.199101:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.199295:0:41585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072768 00000100:00100000:1.0:1788269959.199303:0:41585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072768 00002000:00100000:1.0:1788269959.199345:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (0->8) req@ffff98c27a623100 x1875136253072768/t0(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:375/0 lens 504/0 e 0 to 0 dl 1788269970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269959.199355:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623100 with x1875136253072768 ext(0->8) 00002000:00010000:1.0:1788269959.199360:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a623100 00000100:00100000:1.0:1788269959.199395:0:41585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788269959.199404:0:41585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2403:x1875136253072768:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788269959.200895:0:41585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2403:x1875136253072768:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 1487us (1797us total) trans 25769803780 rc 0/0 00000100:00100000:1.0:1788269959.200906:0:41585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:1.0:1788269959.200914:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (0->8) req@ffff98c27a623100 x1875136253072768/t25769803780(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:375/0 lens 504/448 e 0 to 0 dl 1788269970 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269959.200923:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623100 with x1875136253072768 ext(0->8) 00002000:00010000:1.0:1788269959.200927:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a623100 00000100:00100000:3.0:1788269959.203152:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.203236:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253072896 00000100:00100000:1.0:1788269959.203245:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253072896 00000100:00100000:1.0:1788269959.203300:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788269959.203309:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:30429:x1875136253072896:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788269959.205683:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803802 is committed 00000004:00080000:1.0:1788269959.205699:0:40055:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788269959.205737:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803798 is committed 00000004:00080000:1.0:1788269959.205746:0:40055:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788269959.205764:0:40055:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788269959.205773:0:40055:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c251244600 refcount 2 committed 0 result 0 batchid 21474836491 00000020:00080000:1.0:1788269959.205778:0:40055:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c243e07e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c251244540 00000020:00080000:1.0:1788269959.205781:0:40055:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c243e07400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14524f200 00000100:00100000:1.0:1788269959.205890:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269959.205908:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262558848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788269959.205984:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269959.206033:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262558848 00010000:00010000:3.0:1788269959.206429:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.206441:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 2/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.206450:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.206457:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269959.206462:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.206470:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 4/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.206485:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:3.0:1788269959.206489:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269959.206493:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 2/0,0 mode: --/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.206499:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e07c2a lrc: 0/0,0 mode: --/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788269959.206520:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836491 committed batchid 17179869276 00000020:00080000:3.0:1788269959.206575:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869276 00000100:00100000:3.0:1788269959.206584:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269959.206593:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1437b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262558976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788269959.206626:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269959.206702:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262558976 00000100:00100000:2.0:1788269959.206708:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262558976 00000100:00100000:2.0:1788269959.206767:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269959.206777:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262558976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788269959.206878:0:42634:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788269959.206882:0:42634:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788269959 00002000:00010000:2.0:1788269959.206885:0:42634:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788269959.206887:0:42634:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1788269959 -> 1788269959 00002000:00010000:2.0:1788269959.206889:0:42634:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788269959.206927:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262558976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (299us total) trans 25769803781 rc 0/0 00000100:00100000:2.0:1788269959.206933:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788269959.209314:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788269959.209365:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1437b2300/2, rc 0, transno 25769803781 00000100:00100000:3.0:1788269959.209373:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1437b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262558976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788269959.209484:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262558848 00000100:00100000:1.0:1788269959.209553:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269959.209562:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262558848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788269959.209585:0:42623:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:162 count 1 00002000:00010000:1.0:1788269959.209614:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2:0x0] initial LVB size: 9, mtime: 0x6a96d583, atime: 0x6a96d583, ctime: 0x6a96d583, blocks: 0x8 00010000:00010000:1.0:1788269959.209622:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209637:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1788269959.209641:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269959.209648:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209669:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209679:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209686:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209705:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788269959.209842:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262558848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 281us (3857us total) trans 25769803781 rc 0/0 00000100:00100000:1.0:1788269959.209849:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788269959.209963:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269959.209970:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209979:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269959.209984:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.209993:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.210009:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.210017:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e07ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.210035:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269959.210479:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788269959.210541:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269959.210543:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788269959.210567:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1451c1500/2, rc 0, transno 25769803781 00000100:00100000:1.0:1788269959.210573:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262558848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788269959.210689:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+15:30429:x1875136253072896:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 7379us (7540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.210697:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00010000:00010000:0.0:1788269959.220913:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.220933:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.220944:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.220951:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269959.220955:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.220963:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.220981:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff98c1429f7200) 00010000:00010000:0.0:1788269959.220985:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269959.220989:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.220995:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b677600/0xc5f5d7a016e07a6a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221018:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221025:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 2/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221031:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221036:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269959.221076:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221087:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 4/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221096:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:0.0:1788269959.221098:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269959.221102:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 2/0,0 mode: --/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221108:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27b676200/0xc5f5d7a016e07a71 lrc: 0/0,0 mode: --/TXN res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221122:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221129:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 2/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221135:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221141:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269959.221143:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221149:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 4/0,0 mode: TXN/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221158:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c250e61100) 00010000:00010000:0.0:1788269959.221160:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269959.221164:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 2/0,0 mode: --/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221170:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07ada lrc: 0/0,0 mode: --/TXN res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221196:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221203:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 2/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221208:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221213:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269959.221215:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221221:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 4/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221229:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:0.0:1788269959.221231:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788269959.221234:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 2/0,0 mode: --/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.221240:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e07ca1 lrc: 0/0,0 mode: --/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269959.222565:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.222629:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253073024 00000100:00100000:1.0:1788269959.222639:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253073024 00000100:00100000:1.0:1788269959.222691:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788269959.222702:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2403:x1875136253073024:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788269959.223982:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803781 is committed 00000001:00080000:3.0:1788269959.223992:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803780 is committed 00000100:00100000:1.0:1788269959.224596:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2403:x1875136253073024:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1892us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.224605:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788269959.229199:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.229284:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253073280 00000100:00100000:1.0:1788269959.229295:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253073280 00000100:00100000:1.0:1788269959.229353:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788269959.229363:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30429:x1875136253073280:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.229415:0:40074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269959.229440:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07cb6 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015aa expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.229459:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:1.0:1788269959.229464:0:40074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269959.229491:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.229506:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.229515:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269959.229635:0:40074:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000deb66426 reply state 000000002669be99 transno 25769803803 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.229648:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.229655:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:1.0:1788269959.229657:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269959.229660:0:40074:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269959.229748:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:30429:x1875136253073280:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 386us (558us total) trans 25769803803 rc 0/0 00000100:00100000:1.0:1788269959.229756:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788269959.233408:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.233484:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253073408 00000100:00100000:2.0:1788269959.233493:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253073408 00000100:00100000:2.0:1788269959.233548:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788269959.233558:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253073408:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788269959.233700:0:41579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788269959.233704:0:41579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1788269959 -> 1788269958 00002000:00010000:2.0:1788269959.233707:0:41579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 0 -> 1788269955 00002000:00010000:2.0:1788269959.233709:0:41579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1788269959 -> 1788269958 00002000:00010000:2.0:1788269959.233712:0:41579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788269959.233847:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253073408:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 290us (447us total) trans 25769803782 rc 0/0 00000100:00100000:2.0:1788269959.233855:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788269959.252278:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.252387:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253073664 00000100:00100000:1.0:1788269959.252397:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253073664 00000100:00100000:1.0:1788269959.252456:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:1.0:1788269959.252468:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:30429:x1875136253073664:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.252535:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.252553:0:41798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 13 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.252562:0:41798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.252595:0:41798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 13 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.252610:0:41798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 13 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.252624:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:41798:1875136262559104:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269959.252715:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269959.255379:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.255488:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:41798:1875136262559104:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269959.255511:0:41798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.255575:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253073792 00000100:00100000:3.0:1788269959.255582:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253073792 00010000:00010000:3.0:1788269959.255614:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 14 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.255650:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788269959.255659:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+14:2401:x1875136253073792:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269959.255671:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269959.255677:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 14 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.255690:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 14 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.255711:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07c9a lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610159c expref: 14 pid: 42351 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.255726:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:3.0:1788269959.255730:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.255738:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.255745:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.255774:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269959.255824:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2401:x1875136253073792:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 166us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.255833:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00010000:00010000:1.0:1788269959.255888:0:41798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255895:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255931:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255939:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255946:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255952:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.255964:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255972:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255982:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:1.0:1788269959.255984:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788269959.255988:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.255993:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cd9 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.256030:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30429:x1875136253073664:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 3565us (3761us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788269959.256090:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:2.0:1788269959.265008:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.265125:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253073920 00000100:00100000:1.0:1788269959.265136:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253073920 00000100:00100000:1.0:1788269959.265194:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788269959.265205:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2402:x1875136253073920:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.265247:0:41578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.265268:0:41578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.265277:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269959.265281:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269959.265286:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.265318:0:41578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.265333:0:41578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 7 pid: 41580 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.265348:0:41578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262559232:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269959.265432:0:41578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269959.268397:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.268478:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253074048 00000100:00100000:3.0:1788269959.268486:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253074048 00000100:00100000:1.0:1788269959.268500:0:41578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262559232:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269959.268525:0:41578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.268529:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 8 pid: 41580 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.268579:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788269959.268588:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2400:x1875136253074048:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269959.268601:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269959.268620:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 8 pid: 41580 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.268634:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 8 pid: 41580 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.268656:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065b3cf68/0xc5f5d7a016e07cc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015b8 expref: 8 pid: 41580 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.268685:0:40060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269959.268690:0:40060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269959.268696:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.268706:0:40060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.268741:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269959.268779:0:41578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268789:0:41578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.268798:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253074048:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 209us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.268807:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00010000:00010000:1.0:1788269959.268814:0:41578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268823:0:41578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268830:0:41578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268836:0:41578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269959.268840:0:41578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268853:0:41578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268866:0:41578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.268873:0:41578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e07ce0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.268929:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253073920:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 3726us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.268941:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269959.276522:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.279142:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253074304 00000100:00100000:1.0:1788269959.279157:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253074304 00000100:00100000:1.0:1788269959.279215:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788269959.279227:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:30429:x1875136253074304:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788269959.279303:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279319:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279330:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279498:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279509:0:40075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 13 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279518:0:40075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279549:0:40075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 13 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.279563:0:40075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 13 pid: 40074 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.279581:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262559360:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269959.279671:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269959.283694:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.283748:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253074432 00000100:00100000:3.0:1788269959.283758:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253074432 00000100:00100000:1.0:1788269959.283980:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262559360:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269959.284014:0:40075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284194:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 14 pid: 40074 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269959.284236:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788269959.284246:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+14:2401:x1875136253074432:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269959.284259:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269959.284265:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 14 pid: 40074 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284280:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 14 pid: 40074 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284299:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ca8 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015a3 expref: 14 pid: 40074 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284316:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:0.0:1788269959.284321:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284330:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284336:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.284363:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269959.284412:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2401:x1875136253074432:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 167us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269959.284419:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00010000:00010000:1.0:1788269959.284499:0:40075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.284506:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269959.284594:0:40075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803804 00000001:00080000:1.0:1788269959.284695:0:40075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803805 00000001:00080000:1.0:1788269959.284729:0:40075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803806 00000100:00100000:1.0:1788269959.284798:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:40075:1875136262559488:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788269959.284858:0:40075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269959.284887:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269959.284942:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262559488 00000100:00100000:2.0:1788269959.284947:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262559488 00000100:00100000:2.0:1788269959.284984:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788269959.284992:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:40075:x1875136262559488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788269959.285112:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:40075:x1875136262559488:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.285119:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269959.285376:0:40075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803781 gen 2 00000004:00080000:1.0:1788269959.285382:0:40075:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1437b2300, transno 25769803781 00000100:00100000:1.0:1788269959.285399:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:40075:1875136262559488:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788269959.285498:0:40075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803807 00000100:00100000:1.0:1788269959.285536:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:40075:1875136262559616:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788269959.285563:0:40075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269959.285582:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269959.285675:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262559616 00000100:00100000:3.0:1788269959.285680:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262559616 00000100:00100000:3.0:1788269959.285724:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788269959.285733:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:40075:x1875136262559616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788269959.285846:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:40075:x1875136262559616:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (280us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1788269959.285853:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269959.287692:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:40075:1875136262559616:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788269959.287735:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287744:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287752:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287758:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269959.287763:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287770:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287784:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:2.0:1788269959.287788:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269959.287792:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287799:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ec00/0xc5f5d7a016e07cee lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287829:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287836:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287841:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287846:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269959.287849:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287854:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287861:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:2.0:1788269959.287863:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269959.287870:0:40075:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287881:0:40075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287890:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.287943:0:40075:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269959.287961:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262559744:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788269959.288060:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1449ea600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269959.292209:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.292330:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262559744:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788269959.292357:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292368:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e07c38 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292409:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292422:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292433:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292444:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292450:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292457:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292462:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.292466:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292472:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292482:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.292486:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.292490:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292496:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e07cf5 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292504:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292510:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292516:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292520:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.292523:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292528:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292534:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.292537:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269959.292540:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.292546:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e200/0xc5f5d7a016e07ce7 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.292606:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253074560 00000100:00100000:3.0:1788269959.292614:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253074560 00000100:00100000:3.0:1788269959.292668:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269959.292679:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:27818:x1875136253074560:12345-192.168.201.42@tcp:49:bash.0 00000100:00100000:1.0:1788269959.292701:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+16:30429:x1875136253074304:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 13475us (16187us total) trans 25769803808 rc 0/0 00000100:00100000:1.0:1788269959.292714:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000020:00080000:1.0:1788269959.292719:0:40075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788269959.292771:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:27818:x1875136253074560:12345-192.168.201.42@tcp:49:bash.0 Request processed in 93us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.292778:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000040:00080000:0.0:1788269959.293094:0:40112:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788269959.293099:0:40112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269959.293137:0:40112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788269959.293144:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1788269959.296241:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.296334:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253074816 00000100:00100000:3.0:1788269959.296342:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253074816 00000100:00100000:3.0:1788269959.296389:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788269959.296398:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+16:30429:x1875136253074816:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788269959.296614:0:40078:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269959.296642:0:40078:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803809 00010000:00010000:3.0:1788269959.296670:0:40078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.296687:0:40078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.296700:0:40078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.296709:0:40078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.296715:0:40078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.296722:0:40078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.296744:0:40078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269959.296871:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:30429:x1875136253074816:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 472us (637us total) trans 25769803810 rc 0/0 00000100:00100000:3.0:1788269959.296879:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000020:00080000:3.0:1788269959.296884:0:40078:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269959.296888:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269959.296898:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.296907:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9eea00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788269959.296911:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.296919:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.296932:0:40064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:2.0:1788269959.296935:0:40064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269959.296940:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.296946:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eea00/0xc5f5d7a016e07cfc lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.296958:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269959.296960:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269959.296961:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269959.307608:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.307734:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253074944 00000100:00100000:2.0:1788269959.307744:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253074944 00000100:00100000:2.0:1788269959.307812:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788269959.307823:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:27818:x1875136253074944:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788269959.307841:0:41580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269959.307860:0:41580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015bf expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269959.307885:0:41580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 9, mtime: 0x6a96d586, atime: 0x6a96d583, ctime: 0x6a96d586, blocks: 0x8 00010000:00010000:2.0:1788269959.307906:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=751s v=(0 0) 00010000:00010000:2.0:1788269959.307911:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269959.307919:0:41580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.307937:0:41580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269959.307950:0:41580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ce00, rc 0) 00000100:00100000:2.0:1788269959.308025:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:27818:x1875136253074944:12345-192.168.201.42@tcp:101:bash.0 Request processed in 203us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269959.308032:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00080000:3.0:1788269959.309373:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269959.313095:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.316160:0:41583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253075072 00000100:00100000:2.0:1788269959.316176:0:41583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253075072 00002000:00010000:2.0:1788269959.316219:0:41583:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/162 (0->18446744073709551615) 00002000:00100000:2.0:1788269959.316225:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dce00 with x1875136253075072 ext(0->18446744073709551615) 00002000:00010000:2.0:1788269959.316237:0:41583:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27d7dce00. 00000100:00100000:2.0:1788269959.316274:0:41583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788269959.316284:0:41583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2400:x1875136253075072:12345-192.168.201.42@tcp:10:bash.0 00002000:00010000:2.0:1788269959.316541:0:41583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788269959.316545:0:41583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1788269958 -> 1788269958 00002000:00010000:2.0:1788269959.316548:0:41583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1788269955 -> 1788269955 00002000:00010000:2.0:1788269959.316549:0:41583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1788269958 -> 1788269958 00002000:00010000:2.0:1788269959.316551:0:41583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788269959.316620:0:41583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:2400:x1875136253075072:12345-192.168.201.42@tcp:10:bash.0 Request processed in 337us (3581us total) trans 25769803784 rc 0/0 00000100:00100000:2.0:1788269959.316628:0:41583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00002000:00010000:2.0:1788269959.316632:0:41583:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/162 (0->18446744073709551615) 00002000:00100000:2.0:1788269959.316635:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dce00 with x1875136253075072 ext(0->18446744073709551615) 00002000:00010000:2.0:1788269959.316639:0:41583:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27d7dce00. 00000100:00100000:0.0:1788269959.321344:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.323280:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253075328 00000100:00100000:1.0:1788269959.323294:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253075328 00000100:00100000:1.0:1788269959.325196:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:1.0:1788269959.325215:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:27818:x1875136253075328:12345-192.168.201.42@tcp:55:bash.0 00010000:00010000:1.0:1788269959.325282:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325299:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325311:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325503:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325512:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325519:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325524:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.325528:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325536:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325549:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.325552:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788269959.325556:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.325562:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d0a lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.325631:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:27818:x1875136253075328:12345-192.168.201.42@tcp:55:bash.0 Request processed in 423us (4297us total) trans 25769803811 rc 0/0 00000100:00100000:1.0:1788269959.325639:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788269959.330421:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.330596:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253075584 00000100:00100000:3.0:1788269959.330606:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253075584 00000100:00100000:3.0:1788269959.330665:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788269959.330686:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:27818:x1875136253075584:12345-192.168.201.42@tcp:35:bash.0 00000001:00080000:3.0:1788269959.330899:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803812 00000100:00100000:3.0:1788269959.331014:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:27818:x1875136253075584:12345-192.168.201.42@tcp:35:bash.0 Request processed in 329us (601us total) trans 25769803813 rc 0/0 00000100:00100000:3.0:1788269959.331022:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000020:00080000:3.0:1788269959.331027:0:40077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788269959.364323:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262559872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788269959.364406:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269959.364601:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262559872 00000100:00100000:1.0:1788269959.364610:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262559872 00000100:00100000:1.0:1788269959.364689:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269959.364699:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262559872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269959.364719:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:1.0:1788269959.364776:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262559872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.364783:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788269959.364849:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269959.365703:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262559872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269959.455562:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.455725:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253075840 00000100:00100000:1.0:1788269959.455735:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253075840 00000100:00100000:1.0:1788269959.455792:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:1.0:1788269959.455803:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:30439:x1875136253075840:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269959.455828:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.455848:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015c6 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269959.455976:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788269959.456126:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015c6 expref: 20 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.456141:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:1.0:1788269959.456144:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269959.456150:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015c6 expref: 20 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.456174:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192400, rc 0) 00000100:00100000:1.0:1788269959.456362:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:30439:x1875136253075840:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 560us (810us total) trans 25769803814 rc 301/301 00000100:00100000:1.0:1788269959.456370:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:0.0:1788269959.459680:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.459757:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253075968 00000100:00100000:1.0:1788269959.459767:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253075968 00000100:00100000:1.0:1788269959.459817:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:1.0:1788269959.459826:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:30439:x1875136253075968:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788269959.459894:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.459909:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.459920:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.459935:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.459942:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.459949:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460018:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460026:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460062:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269959.460109:0:40075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460120:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460127:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460133:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460139:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.460143:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460151:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460164:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269959.460166:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.460170:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460176:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d1f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460203:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460210:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460216:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460220:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.460223:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460228:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460237:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c143878600) 00010000:00010000:1.0:1788269959.460240:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.460242:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460248:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d26 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460265:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460270:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460275:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460279:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.460281:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460286:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460293:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.460295:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.460298:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.460303:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d2d lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.460372:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:30439:x1875136253075968:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 547us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.460380:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:2.0:1788269959.466286:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.466442:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253076224 00000100:00100000:3.0:1788269959.466452:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253076224 00000100:00100000:3.0:1788269959.466502:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269959.466512:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:30439:x1875136253076224:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269959.466707:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+20:30439:x1875136253076224:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 196us (429us total) trans 25769803815 rc 0/0 00000100:00100000:3.0:1788269959.466715:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269959.549846:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.549923:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253076480 00000100:00100000:1.0:1788269959.549934:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253076480 00000100:00100000:1.0:1788269959.550005:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:1.0:1788269959.550016:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+20:30446:x1875136253076480:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788269959.550072:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.550094:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d34 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015cd expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550173:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550186:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550197:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550211:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550217:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550223:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550323:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550331:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550338:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269959.550351:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:1.0:1788269959.550418:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550426:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550433:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550439:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.550443:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550450:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550462:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269959.550465:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.550469:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550475:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d3b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550488:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550495:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550505:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550509:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.550512:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550518:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550740:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c143878600) 00010000:00010000:1.0:1788269959.550743:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.550746:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550751:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d42 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550812:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d34 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 23 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550823:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 22 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.550828:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.550830:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269959.550832:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192400, rc 0) 00000100:00100000:1.0:1788269959.550882:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:30446:x1875136253076480:12345-192.168.201.42@tcp:101:cat.0 Request processed in 868us (1047us total) trans 25769803816 rc 0/0 00000100:00100000:1.0:1788269959.550894:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:0.0:1788269959.554650:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.554758:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253076608 00000100:00100000:1.0:1788269959.554768:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253076608 00000100:00100000:1.0:1788269959.554853:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788269959.554865:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253076608:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788269959.554880:0:42623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.554896:0:42623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a20a1b/0xc5f5d7a016e07d57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015d4 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.554947:0:42623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:42623:1875136262560000:192.168.201.42@tcp:106: 00000100:00100000:1.0:1788269959.555023:0:42623:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c480 going to sleep for 11 seconds 00002000:00010000:1.0:1788269959.556950:0:42623:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size: 0 -> 14 00002000:00010000:1.0:1788269959.556957:0:42623:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1788269958 -> 1788269959 00002000:00010000:1.0:1788269959.556960:0:42623:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1788269958 -> 1788269959 00002000:00010000:1.0:1788269959.556963:0:42623:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1788269959.556982:0:42623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:42623:1875136262560000:192.168.201.42@tcp:106: 00010000:00010000:1.0:1788269959.557012:0:42623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0a20a1b/0xc5f5d7a016e07d57 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015d4 expref: 7 pid: 42623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.557063:0:42623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a20a1b/0xc5f5d7a016e07d57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015d4 expref: 7 pid: 42623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.557079:0:42623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193800, rc 0) 00000100:00100000:1.0:1788269959.557132:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253076608:12345-192.168.201.42@tcp:101:cat.0 Request processed in 2268us (2490us total) trans 0 rc 301/301 00000100:00100000:1.0:1788269959.557143:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788269959.559558:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.559640:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253076736 00000100:00100000:0.0:1788269959.559648:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253076736 00000100:00100000:0.0:1788269959.559694:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:0.0:1788269959.559704:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:30446:x1875136253076736:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:0.0:1788269959.559719:0:41578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269959.559735:0:41578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015db expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.559762:0:41578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.559771:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269959.559775:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269959.559781:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 7 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.559812:0:41578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 6 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.559831:0:41578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 6 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269959.559844:0:41578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262560128:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788269959.559915:0:41578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788269959.561369:0:41578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262560128:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269959.561408:0:41578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 7 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.561434:0:41578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:3.0:1788269959.561483:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:30446:x1875136253076736:12345-192.168.201.42@tcp:101:cat.0 Request processed in 1780us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.561491:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788269959.562648:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.562879:0:41585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253076864 00000100:00100000:0.0:1788269959.562887:0:41585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253076864 00002000:00100000:0.0:1788269959.562924:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (0->13) req@ffff98c27d7dc700 x1875136253076864/t0(0) o4->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:375/0 lens 504/0 e 0 to 0 dl 1788269970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269959.562935:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dc700 with x1875136253076864 ext(0->13) 00010000:00010000:0.0:1788269959.562942:0:41585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 7 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.562956:0:41585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 7 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269959.562963:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27d7dc700 00000100:00100000:0.0:1788269959.563069:0:41585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:0.0:1788269959.563081:0:41585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+7:2401:x1875136253076864:12345-192.168.201.42@tcp:4:bash.0 00000100:00100000:0.0:1788269959.563780:0:41585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2401:x1875136253076864:12345-192.168.201.42@tcp:4:bash.0 Request processed in 697us (1131us total) trans 25769803785 rc 0/0 00000100:00100000:0.0:1788269959.563789:0:41585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00002000:00100000:0.0:1788269959.563797:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (0->13) req@ffff98c27d7dc700 x1875136253076864/t25769803785(0) o4->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:375/0 lens 504/448 e 0 to 0 dl 1788269970 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269959.563805:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dc700 with x1875136253076864 ext(0->13) 00010000:00010000:0.0:1788269959.563811:0:41585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 9 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.563822:0:41585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 9 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269959.563828:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27d7dc700 00000100:00100000:3.0:1788269959.565266:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.565308:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253076992 00000100:00100000:1.0:1788269959.565316:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253076992 00010000:00010000:1.0:1788269959.565348:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 9 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.565385:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788269959.565395:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2402:x1875136253076992:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269959.565407:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788269959.565421:0:40060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1788269959.565427:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 9 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.565441:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 9 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.565463:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e07d03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015bf expref: 9 pid: 41580 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.565478:0:40060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269959.565483:0:40060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269959.565491:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.565500:0:40060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.565547:0:40060:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.565563:0:40060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:40060:1875136262560256:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788269959.565687:0:40060:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788269959.567479:0:40060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:40060:1875136262560256:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788269959.567499:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269959.567552:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:2402:x1875136253076992:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 2158us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.567562:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788269959.568402:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.568467:0:41583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253077120 00000100:00100000:1.0:1788269959.568475:0:41583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253077120 00002000:00100000:1.0:1788269959.568514:0:41583:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (0->4095) req@ffff98c14262f800 x1875136253077120/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:375/0 lens 488/0 e 0 to 0 dl 1788269970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269959.568533:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262f800 with x1875136253077120 ext(0->4095) 00002000:00010000:1.0:1788269959.568539:0:41583:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262f800 00000100:00100000:1.0:1788269959.568565:0:41583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788269959.568575:0:41583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253077120:12345-192.168.201.42@tcp:3:cat.0 00000100:00100000:1.0:1788269959.568722:0:41583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253077120:12345-192.168.201.42@tcp:3:cat.0 Request processed in 149us (323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788269959.568728:0:41583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00002000:00100000:1.0:1788269959.568732:0:41583:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (0->4095) req@ffff98c14262f800 x1875136253077120/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:375/0 lens 488/4536 e 0 to 0 dl 1788269970 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269959.568742:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262f800 with x1875136253077120 ext(0->4095) 00002000:00010000:1.0:1788269959.568745:0:41583:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262f800 00000100:00100000:3.0:1788269959.572734:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.572982:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253077376 00000100:00100000:2.0:1788269959.572993:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253077376 00000100:00100000:3.0:1788269959.573173:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:3.0:1788269959.573186:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:30446:x1875136253077376:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:3.0:1788269959.573545:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+23:30446:x1875136253077376:12345-192.168.201.42@tcp:35:cat.0 Request processed in 361us (820us total) trans 25769803817 rc 0/0 00000100:00100000:3.0:1788269959.573552:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788269959.657137:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.657317:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253077632 00000100:00100000:3.0:1788269959.657326:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253077632 00000100:00100000:3.0:1788269959.657388:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788269959.657398:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+23:30406:x1875136253077632:12345-192.168.201.42@tcp:35:multiop.0 00000100:00100000:3.0:1788269959.657618:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+24:30406:x1875136253077632:12345-192.168.201.42@tcp:35:multiop.0 Request processed in 220us (489us total) trans 25769803818 rc 0/0 00000100:00100000:3.0:1788269959.657626:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788269959.729583:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.729776:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253077888 00000100:00100000:1.0:1788269959.729785:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253077888 00000100:00100000:1.0:1788269959.729836:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:1.0:1788269959.729847:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+24:30467:x1875136253077888:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788269959.729871:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.729890:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193800/0xc5f5d7a016e07d65 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015e2 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.729977:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d6c lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.729990:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d6c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.730000:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d6c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269959.730010:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:1.0:1788269959.730144:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193800/0xc5f5d7a016e07d65 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e2 expref: 27 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.730160:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d6c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e2 expref: 26 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.730169:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.730172:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788269959.730175:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193400, rc 0) 00000100:00100000:1.0:1788269959.730243:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:30467:x1875136253077888:12345-192.168.201.42@tcp:101:cat.0 Request processed in 396us (668us total) trans 25769803819 rc 0/0 00000100:00100000:1.0:1788269959.730250:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788269959.751282:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.751594:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253078144 00000100:00100000:1.0:1788269959.751606:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253078144 00000100:00100000:1.0:1788269959.751702:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788269959.751714:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:30468:x1875136253078144:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788269959.751737:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.751758:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193800/0xc5f5d7a016e07d7a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015e9 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.751832:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.751846:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.751856:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.751870:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.751877:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.751884:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752010:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752020:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752219:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269959.752232:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:1.0:1788269959.752307:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752314:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752321:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752326:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.752331:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752338:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752349:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269959.752352:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.752356:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752365:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07d81 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752515:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752521:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752527:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752532:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269959.752535:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752541:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752548:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff98c143878600) 00010000:00010000:1.0:1788269959.752550:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269959.752553:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752560:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07d88 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752600:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193800/0xc5f5d7a016e07d7a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 14 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752618:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 13 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.752626:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.752628:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269959.752630:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192200, rc 0) 00000100:00100000:1.0:1788269959.752697:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+13:30468:x1875136253078144:12345-192.168.201.42@tcp:101:cat.0 Request processed in 985us (1424us total) trans 25769803820 rc 0/0 00000100:00100000:1.0:1788269959.752704:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:2.0:1788269959.755755:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.755832:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253078272 00000100:00100000:1.0:1788269959.755841:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253078272 00000100:00100000:1.0:1788269959.755891:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788269959.755899:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:2401:x1875136253078272:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788269959.755916:0:41579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.755931:0:41579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015f0 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.755954:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269959.755958:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269959.755978:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 9 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.756001:0:41579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 9 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.756021:0:41579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193e00, rc 0) 00000100:00100000:1.0:1788269959.756111:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2401:x1875136253078272:12345-192.168.201.42@tcp:101:cat.0 Request processed in 212us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.756117:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788269959.759516:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.759641:0:41585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253078400 00000100:00100000:0.0:1788269959.759649:0:41585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253078400 00002000:00100000:0.0:1788269959.759691:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (0->4095) req@ffff98c14262ca80 x1875136253078400/t0(0) o3->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:375/0 lens 488/0 e 0 to 0 dl 1788269970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269959.759700:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262ca80 with x1875136253078400 ext(0->4095) 00002000:00010000:0.0:1788269959.759705:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262ca80 00000100:00100000:0.0:1788269959.759732:0:41585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788269959.759740:0:41585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2403:x1875136253078400:12345-192.168.201.42@tcp:3:cat.0 00000100:00100000:0.0:1788269959.759920:0:41585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2403:x1875136253078400:12345-192.168.201.42@tcp:3:cat.0 Request processed in 180us (410us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788269959.759929:0:41585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00002000:00100000:0.0:1788269959.759936:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (0->4095) req@ffff98c14262ca80 x1875136253078400/t0(0) o3->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:375/0 lens 488/4536 e 0 to 0 dl 1788269970 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269959.759943:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262ca80 with x1875136253078400 ext(0->4095) 00002000:00010000:0.0:1788269959.759947:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262ca80 00000100:00100000:0.0:1788269959.763428:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.764235:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253078656 00000100:00100000:3.0:1788269959.764246:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253078656 00000100:00100000:2.0:1788269959.764485:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788269959.764495:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+13:30468:x1875136253078656:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:2.0:1788269959.764686:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+14:30468:x1875136253078656:12345-192.168.201.42@tcp:35:cat.0 Request processed in 192us (1269us total) trans 25769803821 rc 0/0 00000100:00100000:2.0:1788269959.764691:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788269959.767154:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.767285:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253078912 00000100:00100000:1.0:1788269959.767291:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253078912 00000100:00100000:1.0:1788269959.767331:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:1.0:1788269959.767337:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+14:27818:x1875136253078912:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269959.767353:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.767377:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193800/0xc5f5d7a016e07da4 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015f7 expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767462:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767473:0:40074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 25 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767479:0:40074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 15 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767484:0:40074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 5/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767507:0:40074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 15 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767523:0:40074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 15 pid: 40076 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.767535:0:40074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:40074:1875136262560384:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269959.767611:0:40074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 25 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.767618:0:40074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 25 pid: 40074 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269959.767624:0:40074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:40074:1875136262560512:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269959.767641:0:40074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269959.770385:0:40074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:40074:1875136262560384:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269959.770394:0:40074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:40074:1875136262560512:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269959.770413:0:40074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269959.770948:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269959.771015:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.771115:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079040 00000100:00100000:0.0:1788269959.771121:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079040 00010000:00010000:0.0:1788269959.771149:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 16 pid: 40076 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269959.771181:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079168 00000100:00100000:0.0:1788269959.771184:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079168 00010000:00010000:0.0:1788269959.771196:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 26 pid: 40074 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269959.771222:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788269959.771232:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+16:2400:x1875136253079040:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269959.771243:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269959.771249:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 16 pid: 40076 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771261:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 16 pid: 40076 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771281:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e07d8f lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e9 expref: 16 pid: 40076 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771296:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:0.0:1788269959.771299:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771305:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771310:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269959.771345:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+15:2400:x1875136253079040:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 116us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269959.771351:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788269959.771375:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788269959.771380:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:2400:x1875136253079168:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269959.771387:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269959.771390:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 26 pid: 40074 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771396:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 26 pid: 40074 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771404:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e07d49 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015cd expref: 26 pid: 40074 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771410:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:0.0:1788269959.771413:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771426:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771431:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771446:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269959.771458:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:2400:x1875136253079168:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 79us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269959.771463:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00010000:00010000:0.0:1788269959.771522:0:40074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771529:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269959.771545:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:0.0:1788269959.771648:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193800/0xc5f5d7a016e07da4 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f7 expref: 16 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771660:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f7 expref: 15 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269959.771665:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:0.0:1788269959.771666:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788269959.771668:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192000, rc 0) 00000100:00100000:0.0:1788269959.771690:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+15:27818:x1875136253078912:12345-192.168.201.42@tcp:101:bash.0 Request processed in 4354us (4542us total) trans 25769803822 rc 0/0 00000100:00100000:0.0:1788269959.771694:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:2.0:1788269959.775430:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.775528:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079296 00000100:00100000:1.0:1788269959.775537:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079296 00000100:00100000:1.0:1788269959.775596:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788269959.775608:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+15:27818:x1875136253079296:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269959.775629:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269959.775648:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07db9 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561015fe expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.775686:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193a00/0xc5f5d7a016e07dc0 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.775702:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193a00/0xc5f5d7a016e07dc0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.775713:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193a00/0xc5f5d7a016e07dc0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.775822:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07db9 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015fe expref: 17 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.775841:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193a00/0xc5f5d7a016e07dc0 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015fe expref: 16 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.775850:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.775853:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269959.775857:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193a00, rc 0) 00000100:00100000:1.0:1788269959.775920:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+16:27818:x1875136253079296:12345-192.168.201.42@tcp:101:bash.0 Request processed in 315us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269959.775927:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:0.0:1788269959.780555:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.780632:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079552 00000100:00100000:1.0:1788269959.780641:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079552 00000100:00100000:1.0:1788269959.780700:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:1.0:1788269959.780710:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+16:27818:x1875136253079552:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:1.0:1788269959.780930:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.780950:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.780961:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269959.781002:0:40076:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803823 00000004:00010000:1.0:1788269959.781024:0:40076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039719c3a reply state 000000000f1578e9 transno 25769803824 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.781086:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269959.781094:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269959.781097:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269959.781100:0:40076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269959.781195:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+19:27818:x1875136253079552:12345-192.168.201.42@tcp:36:bash.0 Request processed in 485us (647us total) trans 25769803824 rc 0/0 00000100:00100000:1.0:1788269959.781201:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000020:00080000:1.0:1788269959.781206:0:40076:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788269959.783744:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.783823:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079680 00000100:00100000:3.0:1788269959.783832:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079680 00000100:00100000:3.0:1788269959.783879:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788269959.783889:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:27818:x1875136253079680:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788269959.783902:0:41578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269959.783917:0:41578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101605 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.783945:0:41578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.783959:0:41578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.783967:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269959.783971:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269959.783977:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101605 expref: 10 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.784010:0:41578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.784024:0:41578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 851 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.784087:0:41578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262560640:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269959.784174:0:41578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.784185:0:41578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 6 pid: 41578 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.784195:0:41578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262560768:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788269959.784220:0:41578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269959.789103:0:41578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262560640:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788269959.789119:0:41578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262560768:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269959.789151:0:41578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101605 expref: 10 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.789183:0:41578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eee00, rc 0) 00000100:00100000:3.0:1788269959.789237:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:27818:x1875136253079680:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5348us (5498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.789246:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788269959.793131:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269959.793185:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269959.793343:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079808 00000100:00100000:3.0:1788269959.793354:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079808 00010000:00010000:3.0:1788269959.793403:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 7 pid: 41578 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.793456:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253079936 00000100:00100000:3.0:1788269959.793459:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253079936 00010000:00010000:3.0:1788269959.793473:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 851 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.793500:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788269959.793510:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253079808:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269959.793523:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269959.793529:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 7 pid: 41578 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793540:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 7 pid: 41578 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793563:0:43117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e07d5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015db expref: 7 pid: 41578 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793580:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269959.793624:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253079808:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 116us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.793631:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788269959.793649:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269959.793655:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2400:x1875136253079936:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269959.793664:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269959.793669:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793682:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793696:0:43117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d781c55a/0xc5f5d7a016e07d9d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f0 expref: 10 pid: 41579 timeout: 851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793708:0:43117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269959.793712:0:43117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269959.793718:0:43117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101605 expref: 9 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793733:0:43117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101605 expref: 9 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269959.793768:0:43117:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101605 expref: 9 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269959.793783:0:43117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:43117:1875136262560896:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788269959.793834:0:43117:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269959.797723:0:43117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:43117:1875136262560896:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788269959.797747:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269959.797797:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2400:x1875136253079936:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 4142us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269959.797808:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788269959.799217:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269959.799569:0:41583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080064 00000100:00100000:1.0:1788269959.799578:0:41583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080064 00002000:00010000:1.0:1788269959.799616:0:41583:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/162 (0->18446744073709551615) 00002000:00100000:1.0:1788269959.799621:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a621c00 with x1875136253080064 ext(0->18446744073709551615) 00002000:00010000:1.0:1788269959.799632:0:41583:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a621c00. 00000100:00100000:1.0:1788269959.799664:0:41583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788269959.799673:0:41583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2401:x1875136253080064:12345-192.168.201.42@tcp:10:bash.0 00002000:00010000:1.0:1788269959.799906:0:41583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 14 -> 0 00002000:00010000:1.0:1788269959.799911:0:41583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1788269959 -> 1788269959 00002000:00010000:1.0:1788269959.799914:0:41583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1788269955 -> 1788269955 00002000:00010000:1.0:1788269959.799916:0:41583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1788269959 -> 1788269959 00002000:00010000:1.0:1788269959.799918:0:41583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788269959.799971:0:41583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2401:x1875136253080064:12345-192.168.201.42@tcp:10:bash.0 Request processed in 299us (757us total) trans 25769803786 rc 0/0 00000100:00100000:1.0:1788269959.799979:0:41583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00002000:00010000:1.0:1788269959.799982:0:41583:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/162 (0->18446744073709551615) 00002000:00100000:1.0:1788269959.799985:0:41583:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a621c00 with x1875136253080064 ext(0->18446744073709551615) 00002000:00010000:1.0:1788269959.799989:0:41583:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a621c00. 00010000:00010000:2.0:1788269959.876196:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269960.714355:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714393:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269960.714503:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080448 00000100:00100000:1.0:1788269960.714513:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080448 00000100:00100000:1.0:1788269960.714610:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788269960.714622:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2401:x1875136253080448:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269960.714693:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2401:x1875136253080448:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 74us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269960.714700:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00080000:1.0:1788269960.714721:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269960.714864:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714900:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714920:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714940:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714957:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714970:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.714992:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269960.715023:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080960 00000100:00100000:0.0:1788269960.715027:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080960 00000100:00100000:0.0:1788269960.715085:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080320 00000100:00100000:0.0:1788269960.715088:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080320 00000100:00100000:0.0:1788269960.715105:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080832 00000100:00100000:0.0:1788269960.715108:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080832 00000100:00100000:0.0:1788269960.715129:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788269960.715137:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2401:x1875136253080960:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269960.715173:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2401:x1875136253080960:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269960.715180:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788269960.715198:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788269960.715205:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:2401:x1875136253080320:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269960.715233:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:2401:x1875136253080320:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269960.715238:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788269960.715250:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788269960.715257:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+19:2401:x1875136253080832:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269960.715281:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+19:2401:x1875136253080832:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269960.715290:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788269960.715306:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080704 00000100:00100000:0.0:1788269960.715310:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080704 00000100:00100000:0.0:1788269960.715331:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081216 00000100:00100000:0.0:1788269960.715334:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081216 00000100:00100000:0.0:1788269960.715344:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080576 00000100:00100000:0.0:1788269960.715346:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080576 00000100:00100000:0.0:1788269960.715353:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081088 00000100:00100000:0.0:1788269960.715355:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081088 00000100:00100000:0.0:1788269960.715367:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:0.0:1788269960.715372:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253080704:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269960.715394:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253080704:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269960.715399:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:0.0:1788269960.715410:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788269960.715415:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2401:x1875136253081216:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269960.715519:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788269960.715526:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253080576:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269960.715550:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253080576:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269960.715555:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788269960.715567:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788269960.715572:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2401:x1875136253081088:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269960.715591:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2401:x1875136253081088:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 19us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269960.715596:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00080000:1.0:1788269960.715626:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269960.715629:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269960.715631:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269960.716152:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2401:x1875136253081216:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 735us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269960.716160:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788269960.716181:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253080192 00000100:00100000:2.0:1788269960.716187:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253080192 00000100:00100000:2.0:1788269960.716271:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:2.0:1788269960.716281:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2401:x1875136253080192:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269960.716322:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2401:x1875136253080192:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 43us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269960.716329:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 160 00010000:00010000:1.0:1788269960.911159:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269960.968986:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788269961.420509:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803781 is committed 00000001:00080000:2.0:1788269961.420526:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803779 is committed 00000100:00100000:1.0:1788269961.924242:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788269961.924381:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269961.926504:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262561152:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.926584:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.926633:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262561664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269961.926660:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.926696:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269961.926704:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262561280:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.926742:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.926802:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561152 00000100:00100000:1.0:1788269961.926810:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561152 00000100:00100000:1.0:1788269961.926860:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788269961.926868:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262561152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.926936:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262561152:12345-0@lo:400:kworker.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269961.926944:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788269961.927000:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561664 00000100:00100000:1.0:1788269961.927004:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561664 00000100:00100000:1.0:1788269961.927056:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269961.927063:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262561664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788269961.927088:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1788269961.927135:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262561664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269961.927141:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269961.927174:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262561152:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.927193:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262561664:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788269961.927216:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269961.927231:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262561536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269961.927256:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.927284:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561536 00000100:00100000:1.0:1788269961.927288:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561536 00000100:00100000:1.0:1788269961.927320:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269961.927326:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262561536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269961.927340:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 34000576 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788269961.927372:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262561536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269961.927378:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788269961.927394:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269961.927414:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262561536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269961.927441:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262561408:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.927468:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.927487:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262561024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788269961.927507:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.927542:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561408 00000100:00100000:1.0:1788269961.927546:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561408 00000100:00100000:0.0:1788269961.927787:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269961.927797:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262561792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269961.927826:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269961.927851:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561792 00000100:00100000:0.0:1788269961.927854:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561792 00000100:00100000:0.0:1788269961.927884:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269961.927891:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262561792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269961.927903:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1788269961.927950:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262561792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269961.927957:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788269961.927974:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269961.927988:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803781 gen 2 00000004:00080000:0.0:1788269961.928004:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803780 committed transno 25769803781 00000004:00080000:0.0:1788269961.928021:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1451c1500, transno 25769803781 00000100:00100000:0.0:1788269961.928035:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262561792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269961.928325:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561280 00000100:00100000:3.0:1788269961.928331:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561280 00000100:00100000:3.0:1788269961.928425:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561024 00000100:00100000:3.0:1788269961.928429:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561024 00000100:00100000:3.0:1788269961.928443:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788269961.928451:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262561280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.928496:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262561280:12345-0@lo:400:kworker.0 Request processed in 46us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269961.928502:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788269961.928516:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788269961.928521:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262561024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788269961.928543:0:40080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446404096 avail 1300164608 00000100:00100000:3.0:1788269961.928595:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262561024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269961.928601:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788269961.928636:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262561024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269961.928905:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262561280:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.929029:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269961.929060:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262561408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.929106:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262561408:12345-0@lo:400:kworker.0 Request processed in 70us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269961.929113:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269961.929409:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262561408:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.929587:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262561920:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.929623:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269961.929728:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262562304:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.929887:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262562432:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.929923:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.931034:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262562048:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.931102:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.931131:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262562560:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.931176:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262562176:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.931219:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269961.931238:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262562688:0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.931271:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562176 00000100:00100000:1.0:1788269961.931277:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562176 00000100:00100000:1.0:1788269961.931328:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788269961.931337:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262562176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269961.931385:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262562176:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269961.931392:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788269961.931421:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269961.931847:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562048 00000100:00100000:2.0:1788269961.931853:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562048 00000100:00100000:2.0:1788269961.931886:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788269961.931893:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262562048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269961.931941:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262562048:12345-0@lo:400:kworker.0 Request processed in 49us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269961.931948:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788269961.936767:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269961.939397:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262561920 00000100:00100000:0.0:1788269961.939412:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262561920 00000100:00100000:0.0:1788269961.939483:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562432 00000100:00100000:0.0:1788269961.939486:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562432 00000100:00100000:0.0:1788269961.939523:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788269961.939534:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262561920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269961.939628:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262561920:12345-0@lo:400:kworker.0 Request processed in 96us (10004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269961.939636:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788269961.939653:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788269961.939660:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262562432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269961.939689:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262562432:12345-0@lo:400:kworker.0 Request processed in 30us (9766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269961.939695:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788269961.939722:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269961.942952:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262562432:0@lo:400:kworker.0 00000100:00100000:2.0:1788269961.942970:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262561920:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.943566:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262562048:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.943602:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269961.943635:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262562176:0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.943656:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562560 00000100:00100000:3.0:1788269961.943662:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562560 00000100:00100000:3.0:1788269961.943709:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562688 00000100:00100000:3.0:1788269961.943712:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562688 00000100:00100000:3.0:1788269961.943737:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269961.943744:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262562560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.943815:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262562560:12345-0@lo:400:kworker.0 Request processed in 71us (7056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269961.943822:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269961.943839:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269961.943844:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262562688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269961.943876:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262562688:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269961.943882:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788269961.943914:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14483ad80 x1875136262562560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269961.943925:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262562560:0@lo:400:kworker.0 00000100:00080000:3.0:1788269961.943941:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788269961.943946:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269961.943974:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262562688:0@lo:400:kworker.0 00000100:00100000:2.0:1788269961.945576:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269961.945619:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262562816:0@lo:400:kworker.0 00000100:00100000:2.0:1788269961.945667:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269961.945744:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562304 00000100:00100000:0.0:1788269961.945752:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562304 00000100:00100000:0.0:1788269961.945800:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562816 00000100:00100000:0.0:1788269961.945804:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562816 00000100:00100000:0.0:1788269961.945835:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788269961.945843:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262562304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269961.945895:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262562304:12345-0@lo:400:kworker.0 Request processed in 53us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269961.945901:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788269961.945916:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788269961.945921:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262562816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269961.945951:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262562816:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269961.945968:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788269961.945987:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269961.946029:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262562304:0@lo:400:kworker.0 00010000:00080000:0.0:1788269961.946066:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14483b100 x1875136262562816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269961.946077:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262562816:0@lo:400:kworker.0 00010000:00010000:2.0:1788269962.948168:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269963.397288:0:40112:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788269963.397295:0:40112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269963.397309:0:40112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788269963.397316:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1788269963.490850:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269963.490945:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081344 00000100:00100000:3.0:1788269963.490955:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081344 00000100:00100000:3.0:1788269963.491081:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:3.0:1788269963.491093:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:30356:x1875136253081344:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788269963.491194:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:30356:x1875136253081344:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269963.491203:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00080000:0.0:1788269963.491311:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269963.493296:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269963.493379:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081472 00000100:00100000:2.0:1788269963.493388:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081472 00000100:00100000:2.0:1788269963.493449:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:2.0:1788269963.493459:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30356:x1875136253081472:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788269963.493547:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30356:x1875136253081472:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269963.493556:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00080000:0.0:1788269963.493618:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788269963.495381:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269963.495460:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081728 00000100:00100000:3.0:1788269963.495467:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081728 00000100:00100000:3.0:1788269963.495514:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788269963.495524:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:30356:x1875136253081728:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788269963.495719:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:30356:x1875136253081728:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 196us (342us total) trans 25769803825 rc 0/0 00000100:00100000:3.0:1788269963.495728:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788269963.779617:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269963.779691:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269963.779692:0:41584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081856 00000100:00100000:3.0:1788269963.779702:0:41584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081856 00002000:00100000:3.0:1788269963.779763:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (0->13) req@ffff98c248218700 x1875136253081856/t0(0) o4->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:379/0 lens 504/0 e 0 to 0 dl 1788269974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788269963.779775:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253081984 00002000:00100000:3.0:1788269963.779779:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c248218700 with x1875136253081856 ext(0->13) 00000100:00100000:2.0:1788269963.779780:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253081984 00002000:00010000:3.0:1788269963.779785:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c248218700 00000100:00100000:3.0:1788269963.779813:0:41584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788269963.779813:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788269963.779822:0:41584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253081856:12345-192.168.201.42@tcp:4:bash.0 00000100:00100000:2.0:1788269963.779822:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253081984:12345-192.168.201.42@tcp:16:kworker.0 00000100:00100000:3.0:1788269963.782513:0:41584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+13:2402:x1875136253081856:12345-192.168.201.42@tcp:4:bash.0 Request processed in 2685us (2898us total) trans 25769803787 rc 0/0 00000100:00100000:3.0:1788269963.782523:0:41584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00002000:00100000:3.0:1788269963.782541:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (0->13) req@ffff98c248218700 x1875136253081856/t25769803787(0) o4->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:379/0 lens 504/448 e 0 to 0 dl 1788269974 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788269963.782551:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c248218700 with x1875136253081856 ext(0->13) 00002000:00010000:3.0:1788269963.782557:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c248218700 00000001:00080000:3.0:1788269963.784648:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803786 is committed 00000001:00080000:3.0:1788269963.784671:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803783 is committed 00000001:00080000:3.0:1788269963.784676:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803782 is committed 00000100:00080000:0.0:1788269963.785103:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269963.785297:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:2402:x1875136253081984:12345-192.168.201.42@tcp:16:kworker.0 Request processed in 5470us (5599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269963.785309:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788269963.972410:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788269963.972430:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262562944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788269963.972557:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269963.972595:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262562944 00000100:00100000:2.0:1788269963.972604:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262562944 00000100:00100000:2.0:1788269963.972660:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788269963.972669:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262562944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788269963.972702:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446227968 avail 1299988480 00000100:00100000:2.0:1788269963.972770:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262562944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269963.972781:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788269963.972848:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262562944:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788269963.972992:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269964.484658:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262563072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269964.484735:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269964.484894:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262563072 00000100:00100000:1.0:1788269964.484903:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262563072 00000100:00100000:1.0:1788269964.484983:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269964.484995:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262563072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269964.485017:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 28672 free 3923505152 avail 3691954176 00000100:00100000:1.0:1788269964.485093:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262563072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269964.485100:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788269964.485194:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269964.485231:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262563072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788269964.996223:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788269965.000255:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803825 is committed 00000001:00080000:1.0:1788269965.000281:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803824 is committed 00000020:00080000:1.0:1788269965.000317:0:40055:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c24880ca80 refcount 2 committed 0 result 0 batchid 21474836492 00000020:00080000:1.0:1788269965.000322:0:40055:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c24ad02200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c24880c3c0 00000020:00080000:1.0:1788269965.000326:0:40055:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c243e07d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14297ba00 00000020:00080000:1.0:1788269965.000351:0:40055:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836491 batchid updated 00000020:00080000:2.0:1788269965.000409:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836492 committed batchid 21474836491 00000020:00080000:2.0:1788269965.000472:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836491 00010000:00010000:0.0:1788269965.000533:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269965.000545:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269965.000553:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269965.000560:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269965.000565:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269965.000573:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269965.000588:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff98c1429f7700) 00010000:00010000:0.0:1788269965.000591:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269965.000596:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 2/0,0 mode: --/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269965.000602:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e07cd2 lrc: 0/0,0 mode: --/TXN res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000671:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000679:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 2/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000690:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000695:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269965.000698:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000704:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 4/0,0 mode: TXN/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000714:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:3.0:1788269965.000716:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269965.000719:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 2/0,0 mode: --/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269965.000726:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e07dc7 lrc: 0/0,0 mode: --/TXN res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269965.826164:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.826199:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.826228:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.826247:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.826263:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.826273:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.826287:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269965.826457:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082624 00000100:00100000:0.0:1788269965.826467:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082624 00000100:00100000:0.0:1788269965.826521:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082496 00000100:00100000:0.0:1788269965.826524:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082496 00000100:00100000:0.0:1788269965.826549:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788269965.826559:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253082624:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269965.826630:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253082624:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 72us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269965.826638:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:1.0:1788269965.826654:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082368 00000100:00100000:0.0:1788269965.826659:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:1.0:1788269965.826660:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082368 00000100:00100000:0.0:1788269965.826670:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253082496:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.826694:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082880 00000100:00100000:1.0:1788269965.826698:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082880 00000100:00100000:0.0:1788269965.826699:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253082496:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269965.826708:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:1.0:1788269965.826710:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082240 00000100:00100000:1.0:1788269965.826713:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082240 00000100:00100000:1.0:1788269965.826725:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082752 00000100:00100000:1.0:1788269965.826726:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082752 00000100:00080000:0.0:1788269965.826729:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269965.826735:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269965.826738:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00080000:0.0:1788269965.826739:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269965.826744:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269965.826747:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253082368:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.826776:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253082368:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269965.826781:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788269965.826793:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788269965.826798:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2402:x1875136253082880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.826815:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2402:x1875136253082880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 17us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269965.826818:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788269965.826825:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788269965.826829:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:2402:x1875136253082240:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.826845:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:2402:x1875136253082240:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 17us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269965.826849:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788269965.826858:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:1.0:1788269965.826864:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2402:x1875136253082752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.826909:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2402:x1875136253082752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269965.826914:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:2.0:1788269965.827010:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253082112 00000100:00100000:2.0:1788269965.827015:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253082112 00000100:00100000:1.0:1788269965.827067:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:1.0:1788269965.827073:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253082112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.827415:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253082112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 342us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269965.827423:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:0.0:1788269965.830737:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269965.830840:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269965.832508:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083008 00000100:00100000:0.0:1788269965.832520:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083008 00000100:00100000:3.0:1788269965.832559:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083136 00000100:00100000:3.0:1788269965.832566:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083136 00000100:00100000:1.0:1788269965.832670:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788269965.832682:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:2403:x1875136253083008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269965.832761:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:2403:x1875136253083008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269965.832770:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788269965.832805:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788269965.832817:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2403:x1875136253083136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788269965.832862:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2403:x1875136253083136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269965.832873:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00080000:0.0:1788269965.832956:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269965.832960:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788269966.021034:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269966.215649:0:43301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3a: Repeat attach/detach operations === 09:39:25 (1788269965) 00000100:00100000:1.0:1788269966.533839:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.534208:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083392 00000100:00100000:0.0:1788269966.534219:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083392 00000100:00100000:0.0:1788269966.534284:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:0.0:1788269966.534295:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:31114:x1875136253083392:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269966.534316:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.534336:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07dd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610160c expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534415:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534428:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534440:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534454:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534460:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534466:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534561:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07dea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534570:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07dea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534576:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07dea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269966.534585:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788269966.534662:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534672:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534678:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534683:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.534687:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534694:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534707:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c250e61400) 00010000:00010000:0.0:1788269966.534710:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.534715:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534721:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ddc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534734:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534739:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534745:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534750:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.534753:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534758:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534764:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429f2000) 00010000:00010000:0.0:1788269966.534766:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.534769:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.534773:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07de3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.535126:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07dd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610160c expref: 13 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.535141:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07dea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610160c expref: 12 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.535149:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:0.0:1788269966.535152:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.535155:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1e00, rc 0) 00000100:00100000:0.0:1788269966.535219:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31114:x1875136253083392:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 926us (1391us total) trans 25769803826 rc 0/0 00000100:00100000:0.0:1788269966.535227:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788269966.540135:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.540181:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083520 00000100:00100000:2.0:1788269966.540191:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083520 00000100:00100000:1.0:1788269966.540222:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.540280:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:2.0:1788269966.540292:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31114:x1875136253083520:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788269966.540306:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083648 00000100:00100000:0.0:1788269966.540310:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083648 00000100:00100000:0.0:1788269966.540382:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:0.0:1788269966.540390:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2403:x1875136253083648:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269966.540401:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269966.540424:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07dea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610160c expref: 13 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.540442:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:0.0:1788269966.540447:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269966.540467:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2403:x1875136253083648:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.540471:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31114:x1875136253083520:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.540475:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788269966.540478:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:3.0:1788269966.546602:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269966.546667:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083776 00000100:00100000:1.0:1788269966.546677:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083776 00000100:00100000:1.0:1788269966.546753:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:1.0:1788269966.546761:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:31114:x1875136253083776:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788269966.546859:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:31114:x1875136253083776:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269966.546867:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:1.0:1788269966.631325:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.631394:0:40083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253083904 00000100:00100000:3.0:1788269966.631404:0:40083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253083904 00000100:00100000:3.0:1788269966.631460:0:40083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788269966.631472:0:40083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:31129:x1875136253083904:12345-192.168.201.42@tcp:700:mkdir.0 00000100:00100000:3.0:1788269966.631550:0:40083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:31129:x1875136253083904:12345-192.168.201.42@tcp:700:mkdir.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.631558:0:40083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:2.0:1788269966.636209:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269966.636268:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084160 00000100:00100000:1.0:1788269966.636277:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084160 00000100:00100000:1.0:1788269966.636324:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:1.0:1788269966.636334:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:31129:x1875136253084160:12345-192.168.201.42@tcp:36:mkdir.0 00000100:00100000:1.0:1788269966.636488:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID:40076:1875136262563200:0@lo:900:mdt00_002.0 00000100:00100000:1.0:1788269966.636526:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269966.636568:0:40086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262563200 00000100:00100000:3.0:1788269966.636581:0:40086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262563200 00000100:00100000:1.0:1788269966.636585:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.636611:0:40086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269966.636618:0:40086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:40076:x1875136262563200:12345-0@lo:900:mdt00_002.0 00000100:00100000:3.0:1788269966.636675:0:40086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:40076:x1875136262563200:12345-0@lo:900:mdt00_002.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.636680:0:40086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269966.636829:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID:40076:1875136262563200:0@lo:900:mdt00_002.0 00000100:00100000:1.0:1788269966.636887:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563328:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.636935:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.636957:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.637143:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262563328 00000100:00100000:3.0:1788269966.637147:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262563328 00000100:00100000:3.0:1788269966.637173:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788269966.637178:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269966.637226:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563328:12345-0@lo:1000:mdt00_002.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.637231:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269966.637343:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563328:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.637391:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563456:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.637413:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.637441:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.637494:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262563456 00000100:00100000:2.0:1788269966.637498:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262563456 00000100:00100000:2.0:1788269966.637530:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788269966.637537:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788269966.637601:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563456:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.637607:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788269966.637676:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563456:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.637701:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563584:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.637717:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.637731:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.637768:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262563584 00000100:00100000:2.0:1788269966.637772:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262563584 00000100:00100000:2.0:1788269966.637806:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788269966.637812:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788269966.638100:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563584:12345-0@lo:1000:mdt00_002.0 Request processed in 287us (380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269966.638107:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788269966.638166:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563584:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788269966.638214:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.638221:0:40076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.638228:0:40076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269966.638237:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563712:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1788269966.638253:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.638270:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.638309:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262563712 00000100:00100000:3.0:1788269966.638312:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262563712 00000100:00100000:3.0:1788269966.638334:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269966.638345:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:40076:x1875136262563712:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788269966.638354:0:40815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269966.638369:0:40815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07df8 expref: -99 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.638391:0:40815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 10 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.638400:0:40815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 9 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.638408:0:40815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.638433:0:40815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 9 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.638444:0:40815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 9 pid: 40076 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269966.638454:0:40815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:40815:1875136262563840:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269966.638537:0:40815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 10 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.638553:0:40815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 10 pid: 42351 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269966.638559:0:40815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:40815:1875136262563968:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788269966.638583:0:40815:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2812160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.641458:0:40815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:40815:1875136262563840:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269966.641561:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.641700:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084416 00000100:00100000:0.0:1788269966.641708:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084416 00010000:00010000:0.0:1788269966.641743:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 11 pid: 42351 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.641846:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788269966.641857:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:2401:x1875136253084416:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269966.641872:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269966.641879:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 11 pid: 42351 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.641889:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 11 pid: 42351 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.641918:0:43117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:0.0:1788269966.641925:0:43117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.641940:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269966.641990:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:2401:x1875136253084416:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 135us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.641997:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788269966.642356:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.642442:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084288 00000100:00100000:0.0:1788269966.642447:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084288 00010000:00010000:0.0:1788269966.642510:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 10 pid: 40076 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.642586:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788269966.642594:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2401:x1875136253084288:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269966.642601:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269966.642606:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 10 pid: 40076 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642621:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 10 pid: 40076 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642634:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e07be4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610156b expref: 10 pid: 40076 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642650:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:0.0:1788269966.642654:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642664:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642679:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642711:0:40062:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.642724:0:40062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:40062:1875136262564096:0@lo:105: 00000100:00100000:0.0:1788269966.642763:0:40062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.642800:0:40062:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24aa70600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269966.642825:0:40058:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788269966.642846:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564096 00000100:00100000:0.0:1788269966.642849:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564096 00000100:00100000:0.0:1788269966.642881:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269966.642888:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14288e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:40062:x1875136262564096:12345-0@lo:105: 00010000:00010000:0.0:1788269966.642904:0:40058:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642926:0:40058:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642935:0:40058:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.642947:0:40058:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.643086:0:40058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.643101:0:40058:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.643115:0:40058:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98c144192400) 00000100:00100000:0.0:1788269966.643149:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14288e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:40062:x1875136262564096:12345-0@lo:105: Request processed in 262us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.643154:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269966.643208:0:40062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:40062:1875136262564096:0@lo:105: 00010000:00010000:0.0:1788269966.643222:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269966.643239:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2401:x1875136253084288:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 648us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.643243:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00010000:00010000:3.0:1788269966.643763:0:40815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e07a7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014fb expref: 10 pid: 42351 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269966.643776:0:40815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:40815:1875136262563968:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269966.643792:0:40815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 6 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.643797:0:40815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:3.0:1788269966.643800:0:40815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269966.643802:0:40815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee200, rc 0) 00000100:00100000:1.0:1788269966.643929:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1410e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262563712:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1788269966.643944:0:40076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269966.643963:0:40076:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788269966.643997:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.644005:0:40076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.644013:0:40076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269966.644029:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564224:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1788269966.644033:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:40076:x1875136262563712:12345-0@lo:101:mdt00_002.0 Request processed in 5690us (5778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.644059:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788269966.644073:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.644090:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.644121:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564224 00000100:00100000:3.0:1788269966.644126:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564224 00000100:00100000:3.0:1788269966.644159:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269966.644167:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:40076:x1875136262564224:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788269966.644181:0:40080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269966.644195:0:40080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07e06 expref: -99 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.644212:0:40080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07e06 expref: 7 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.644223:0:40080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07e06 expref: 7 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.644228:0:40080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff98c1429fd400) 00010000:00010000:3.0:1788269966.644229:0:40080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269966.644231:0:40080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9efe00, rc 0) 00000100:00100000:3.0:1788269966.644257:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564224:12345-0@lo:101:mdt00_002.0 Request processed in 91us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.644262:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788269966.644284:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564224:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1788269966.644294:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.644305:0:40076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269966.644316:0:40076:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1788269966.644342:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564352:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.644377:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.644397:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.644521:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564352 00000100:00100000:3.0:1788269966.644525:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564352 00000100:00100000:3.0:1788269966.644546:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269966.644552:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269966.644639:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564352:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.644645:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788269966.644664:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564352:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.644700:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564480:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.644722:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.644742:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.645796:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564480 00000100:00100000:3.0:1788269966.645805:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564480 00000100:00100000:3.0:1788269966.645855:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788269966.645864:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1410e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269966.645982:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1410e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564480:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (1258us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269966.645989:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788269966.646138:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564480:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788269966.646212:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564608:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788269966.646233:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.646253:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.646289:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564608 00000100:00100000:3.0:1788269966.646292:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564608 00000100:00100000:3.0:1788269966.646313:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788269966.646318:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269966.646363:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564608:12345-0@lo:1000:mdt00_002.0 Request processed in 44us (127us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269966.646369:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788269966.646528:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564608:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.646566:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564736:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.646595:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.646609:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.646678:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564736 00000100:00100000:3.0:1788269966.646681:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564736 00000100:00100000:3.0:1788269966.646695:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788269966.646698:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269966.646743:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564736:12345-0@lo:1000:mdt00_002.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.646749:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788269966.646770:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564736:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.646943:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564864:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.646967:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.646989:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.647014:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564864 00000100:00100000:3.0:1788269966.647019:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564864 00000100:00100000:3.0:1788269966.647058:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788269966.647065:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.647195:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564864:12345-0@lo:1000:mdt00_002.0 Request processed in 129us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.647201:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788269966.647245:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564864:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.647283:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564992:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.647302:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.647323:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269966.647338:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262564992 00000100:00100000:0.0:1788269966.647342:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262564992 00000100:00100000:0.0:1788269966.647405:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788269966.647413:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.647451:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262564992:12345-0@lo:1000:mdt00_002.0 Request processed in 39us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.647457:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788269966.647479:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262564992:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.647571:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262565120:0@lo:700:mdt00_002.0 00000100:00100000:1.0:1788269966.647595:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.647622:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269966.647663:0:40084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262565120 00000100:00100000:0.0:1788269966.647666:0:40084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262565120 00000100:00100000:0.0:1788269966.647689:0:40084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269966.647695:0:40084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262565120:12345-0@lo:700:mdt00_002.0 00000100:00100000:0.0:1788269966.647763:0:40084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262565120:12345-0@lo:700:mdt00_002.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.647767:0:40084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269966.647896:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262565120:0@lo:700:mdt00_002.0 00000100:00100000:1.0:1788269966.647997:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262565248:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.648022:0:40076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.648076:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262565248 00000100:00100000:0.0:1788269966.648080:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262565248 00000100:00100000:0.0:1788269966.648112:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788269966.648119:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262565248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269966.648155:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24520f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269966.648165:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40076:x1875136262565248:12345-0@lo:1000:mdt00_002.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269966.648166:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a670380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:40076:1875136262565248:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269966.648171:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:1.0:1788269966.648225:0:40076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269966.648268:0:40076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1788269966.648275:0:40076:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c2759f5cc0 with version 1 00000004:00080000:0.0:1788269966.648304:0:40812:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c1436fcd80 version 1 rpc_version 1 00000040:00080000:1.0:1788269966.648325:0:40076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00100000:0.0:1788269966.648325:0:40812:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788269966.648333:0:40812:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c275907b80 x1875136262565504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:1.0:1788269966.648336:0:40076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1788269966.648340:0:40076:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c24aa70300 with version 2 00000100:00100000:0.0:1788269966.648346:0:40812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262565504:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788269966.648375:0:40812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.648439:0:40812:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.648469:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262565504 00000100:00100000:2.0:1788269966.648473:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262565504 00000100:00100000:2.0:1788269966.648528:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788269966.648534:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:40812:x1875136262565504:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1788269966.652374:0:40076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269966.652561:0:40076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1788269966.652979:0:40076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b11:0x1:0x0].1, 984 off33752 00000040:00080000:1.0:1788269966.653105:0:40076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200002b13:0x1:0x0].1, 1136 off33904 00000004:00080000:1.0:1788269966.653113:0:40076:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c2759f5300 with version 3 00000001:00080000:0.0:1788269966.653315:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803827 is committed 00000001:00080000:0.0:1788269966.653324:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803826 is committed 00000020:00080000:0.0:1788269966.653329:0:40055:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836492 batchid updated 00000020:00080000:2.0:1788269966.653425:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836492 00000020:00080000:2.0:1788269966.653436:0:40113:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836492 00000100:00100000:2.0:1788269966.654135:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:40812:x1875136262565504:12345-0@lo:1000:osp_up0-1.0 Request processed in 5598us (5755us total) trans 25769803827 rc 0/0 00000100:00100000:2.0:1788269966.654144:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1788269966.654204:0:40812:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803827 committed transno 25769803827 00000100:00100000:0.0:1788269966.654208:0:40812:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803827 gen 2 00000100:00100000:0.0:1788269966.654222:0:40812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262565504:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788269966.654251:0:40812:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c1436fcd80 version 2 rpc_version 2 00000020:00100000:0.0:1788269966.654273:0:40812:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788269966.654278:0:40812:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c275907b80 x1875136262565760/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269966.654293:0:40812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262565760:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788269966.654320:0:40812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.654378:0:40812:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.654444:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262565760 00000100:00100000:2.0:1788269966.654450:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262565760 00000100:00100000:2.0:1788269966.654483:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788269966.654492:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40812:x1875136262565760:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1788269966.658851:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803828 is committed 00000100:00100000:2.0:1788269966.659168:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:40812:x1875136262565760:12345-0@lo:1000:osp_up0-1.0 Request processed in 4673us (4842us total) trans 25769803828 rc 0/0 00000100:00100000:2.0:1788269966.659180:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788269966.659406:0:40812:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803828 committed transno 25769803828 00000100:00100000:0.0:1788269966.659412:0:40812:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803828 gen 2 00000100:00100000:0.0:1788269966.659431:0:40812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262565760:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788269966.659458:0:40812:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c1436fcd80 version 3 rpc_version 3 00000020:00100000:0.0:1788269966.659488:0:40812:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788269966.659495:0:40812:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c275907b80 x1875136262566016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269966.659576:0:40812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262566016:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788269966.659617:0:40812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.659687:0:40812:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.659729:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566016 00000100:00100000:2.0:1788269966.659736:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566016 00000100:00100000:2.0:1788269966.659830:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788269966.659841:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:40812:x1875136262566016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788269966.660541:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:40812:x1875136262566016:12345-0@lo:1000:osp_up0-1.0 Request processed in 701us (923us total) trans 25769803829 rc 0/0 00000100:00100000:2.0:1788269966.660547:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269966.660618:0:40812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262566016:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788269966.660798:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660810:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660821:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269966.660834:0:40076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d918bea reply state 00000000730645ca transno 25769803781 ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660845:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660851:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269966.660854:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788269966.660858:0:40076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788269966.660864:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00000004:00080000:1.0:1788269966.660871:0:40076:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788269966.660881:0:40076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660890:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660896:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660939:0:40076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788269966.660944:0:40076:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788269966.660948:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.660957:0:40076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269966.661036:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:31129:x1875136253084160:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 24703us (24835us total) trans 25769803781 rc 0/0 00000100:00100000:1.0:1788269966.661055:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00010000:00010000:0.0:1788269966.661183:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269966.661188:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.661194:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:0.0:1788269966.661198:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269966.661203:0:40063:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.661225:0:40063:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.661316:0:40063:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269966.661537:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.661544:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192400/0xc5f5d7a016e07df8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07dff expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.661565:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269966.661567:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269966.661569:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269966.661577:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269966.661590:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262566144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269966.661627:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269966.662172:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566144 00000100:00100000:1.0:1788269966.662179:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566144 00000100:00100000:1.0:1788269966.662227:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269966.662235:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3608:x1875136262566144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269966.662246:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269966.662263:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee200/0xc5f5d7a016e07dff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07df8 expref: 8 pid: 40815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.662277:0:40061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878500) 00010000:00010000:1.0:1788269966.662284:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269966.662320:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262566144:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269966.662327:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269966.662368:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262566144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269966.674129:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.675258:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084544 00000100:00100000:2.0:1788269966.675270:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084544 00000100:00100000:2.0:1788269966.675331:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:2.0:1788269966.675341:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:31130:x1875136253084544:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788269966.675372:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269966.675591:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101613 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.675661:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07e22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.675674:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.675685:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269966.675772:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788269966.675776:0:41798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269966.675816:0:41798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.675852:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101613 expref: 11 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.675968:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07e22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101613 expref: 10 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.675978:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:2.0:1788269966.675981:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269966.675984:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5de00, rc 0) 00000100:00100000:2.0:1788269966.676086:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:31130:x1875136253084544:12345-192.168.201.42@tcp:101:dd.0 Request processed in 746us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.676095:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788269966.679187:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.680713:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084672 00000100:00100000:3.0:1788269966.680732:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084672 00000100:00100000:3.0:1788269966.680813:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:3.0:1788269966.680826:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:31130:x1875136253084672:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788269966.680850:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269966.680872:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee600/0xc5f5d7a016e07e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610161a expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681121:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681136:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681148:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681160:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681171:0:40075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07e06 expref: 6 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681181:0:40075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.681220:0:40075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e07e06 expref: 6 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269966.681242:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262566272:0@lo:104: 00000100:00100000:3.0:1788269966.681382:0:40075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269966.681580:0:40058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566272 00000100:00100000:0.0:1788269966.681585:0:40058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566272 00000100:00100000:0.0:1788269966.681626:0:40058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269966.681633:0:40058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:40075:x1875136262566272:12345-0@lo:104: 00010000:00010000:0.0:1788269966.681648:0:40058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.681704:0:40058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788269966.681710:0:40058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:40075:x1875136262566272:12345-0@lo:104: Request processed in 78us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.681716:0:40058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269966.681774:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2812160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.681798:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:40075:1875136262566272:0@lo:104: 00010000:00010000:3.0:1788269966.681815:0:40075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.682101:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269966.682108:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.682117:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:2.0:1788269966.682123:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269966.682131:0:40064:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.682167:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.682174:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269966.682203:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.682211:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192200/0xc5f5d7a016e07e06 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e07e0d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.682232:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269966.682234:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269966.682235:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269966.682369:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262566400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269966.682423:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.682504:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566400 00000100:00100000:2.0:1788269966.682510:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566400 00010000:00010000:2.0:1788269966.682530:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc5f5d7a016e07e06 expref: 7 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.682560:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269966.682568:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262566400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269966.682578:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1788269966.684692:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803829 is committed 00010000:00010000:2.0:1788269966.684801:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efe00/0xc5f5d7a016e07e0d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e07e06 expref: 6 pid: 40080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.684819:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff98c1429fd400) 00010000:00010000:2.0:1788269966.684824:0:40060:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.684837:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.684843:0:40060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.685002:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269966.685110:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262566400:12345-0@lo:103:ldlm_bl.0 Request processed in 2541us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.685120:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788269966.685439:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262566400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269966.685616:0:40075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.685625:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.685799:0:40075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:40075:1875136262566528:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788269966.685837:0:40075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.686004:0:40075:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788269966.686157:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566528 00000100:00100000:0.0:1788269966.686164:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566528 00000100:00100000:0.0:1788269966.686317:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788269966.686328:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:40075:x1875136262566528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788269966.686405:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:40075:x1875136262566528:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.686413:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788269966.686467:0:40075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:40075:1875136262566528:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788269966.686507:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e3e lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686520:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e3e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686529:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e3e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269966.686550:0:40075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e3e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686562:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686569:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686577:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686583:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9efa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.686587:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686595:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686606:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:2.0:1788269966.686609:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269966.686612:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686619:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9efa00/0xc5f5d7a016e07e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686629:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686635:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686641:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686646:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9eec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.686649:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686659:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686666:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff98c1429fd400) 00010000:00010000:2.0:1788269966.686669:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269966.686672:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686678:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9eec00/0xc5f5d7a016e07e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686713:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c24a9ee600/0xc5f5d7a016e07e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610161a expref: 12 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686726:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e3e lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610161a expref: 11 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.686733:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2596bed00) 00010000:00010000:2.0:1788269966.686735:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269966.686737:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788269966.686786:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:31130:x1875136253084672:12345-192.168.201.42@tcp:101:dd.0 Request processed in 5963us (7609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.686793:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:3.0:1788269966.691182:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.691599:0:42865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084800 00000100:00100000:2.0:1788269966.691608:0:42865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084800 00000100:00100000:2.0:1788269966.691655:0:42865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788269966.691665:0:42865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:31130:x1875136253084800:12345-192.168.201.42@tcp:900:dd.0 00000100:00100000:2.0:1788269966.691748:0:42865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:31130:x1875136253084800:12345-192.168.201.42@tcp:900:dd.0 Request processed in 84us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.691756:0:42865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788269966.693681:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.693825:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253084928 00000100:00100000:0.0:1788269966.693831:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253084928 00000100:00100000:0.0:1788269966.693874:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788269966.693884:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:31130:x1875136253084928:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788269966.693901:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.693932:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07e45 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101621 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.693988:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07e4c lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.694002:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07e4c lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.694020:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07e4c lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269966.694085:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788269966.694089:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788269966.694137:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e07e45 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101621 expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.694160:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07e4c lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101621 expref: 6 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.694167:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:0.0:1788269966.694169:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788269966.694172:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0000, rc 0) 00000100:00100000:0.0:1788269966.694212:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:31130:x1875136253084928:12345-192.168.201.42@tcp:101:dd.0 Request processed in 330us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.694218:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:1.0:1788269966.695896:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.696546:0:40083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253085056 00000100:00100000:3.0:1788269966.696556:0:40083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253085056 00000100:00100000:3.0:1788269966.696645:0:40083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788269966.696655:0:40083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:31130:x1875136253085056:12345-192.168.201.42@tcp:700:dd.0 00000100:00100000:3.0:1788269966.696731:0:40083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:31130:x1875136253085056:12345-192.168.201.42@tcp:700:dd.0 Request processed in 77us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.696738:0:40083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788269966.699352:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.699593:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253085312 00000100:00100000:2.0:1788269966.699603:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253085312 00000100:00100000:2.0:1788269966.699700:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:2.0:1788269966.699711:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:31130:x1875136253085312:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788269966.699731:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269966.699753:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07e53 lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101628 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.699849:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.699858:0:41798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.699868:0:41798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.699902:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262566656:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1788269966.700245:0:41798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.700364:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269966.700404:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566656 00000100:00100000:0.0:1788269966.700409:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566656 00000100:00100000:0.0:1788269966.700478:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269966.700486:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:41798:x1875136262566656:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788269966.700500:0:40079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.700512:0:40079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e07e5a expref: -99 pid: 40079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.700533:0:40079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e07e5a expref: 6 pid: 40079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.700552:0:40079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e07e5a expref: 6 pid: 40079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.700560:0:40079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:0.0:1788269966.700563:0:40079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788269966.700567:0:40079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0a00, rc 0) 00000100:00100000:0.0:1788269966.700613:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:41798:x1875136262566656:12345-0@lo:101:mdt00_003.0 Request processed in 128us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.700619:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788269966.700682:0:41798:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803829 gen 2 00000004:00080000:2.0:1788269966.700688:0:41798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803829 committed transno 25769803829 00000100:00100000:2.0:1788269966.700731:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262566656:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788269966.700744:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700760:0:41798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269966.700773:0:41798:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788269966.700781:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700788:0:41798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700843:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700853:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700863:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700948:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700955:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.700962:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.701102:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262566784:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788269966.701132:0:41798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.701395:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.701444:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262566784 00000100:00100000:3.0:1788269966.701448:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262566784 00000100:00100000:3.0:1788269966.701466:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788269966.701470:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:41798:x1875136262566784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788269966.701535:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:41798:x1875136262566784:12345-0@lo:1000:mdt00_003.0 Request processed in 65us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.701540:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788269966.701587:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262566784:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1788269966.702186:0:41798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa2:0x0], index 0: 0 00010000:00010000:2.0:1788269966.702303:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702312:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702317:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702339:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702343:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 2/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702347:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702351:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.702354:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702358:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 4/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702365:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269966.702367:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269966.702371:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702375:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07e68 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269966.702383:0:41798:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0a96f66 reply state 000000009a1adf7a transno 25769803782 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702389:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702393:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c2596be500) 00010000:00010000:2.0:1788269966.702394:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788269966.702396:0:41798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788269966.702418:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07e53 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 9 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702426:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 8 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.702431:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:2.0:1788269966.702433:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269966.702434:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:2.0:1788269966.702471:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:31130:x1875136253085312:12345-192.168.201.42@tcp:101:dd.0 Request processed in 2763us (3127us total) trans 25769803782 rc 0/0 00000100:00100000:2.0:1788269966.702478:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:1.0:1788269966.705002:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.705099:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253085440 00000100:00100000:0.0:1788269966.705109:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253085440 00000100:00100000:0.0:1788269966.705235:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:0.0:1788269966.705246:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+8:31130:x1875136253085440:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788269966.705262:0:41578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.705281:0:41578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610162f expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269966.705305:0:41578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788269966.705325:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=758s v=(0 0) 00010000:00010000:0.0:1788269966.705329:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269966.705335:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 9 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.705349:0:41578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 9 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.705363:0:41578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1e00, rc 0) 00000100:00100000:0.0:1788269966.705405:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:31130:x1875136253085440:12345-192.168.201.42@tcp:101:dd.0 Request processed in 163us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.705412:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788269966.712753:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.713090:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253085696 00000100:00100000:3.0:1788269966.713101:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253085696 00000100:00100000:3.0:1788269966.713216:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788269966.713227:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:31130:x1875136253085696:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:3.0:1788269966.713728:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:31130:x1875136253085696:12345-192.168.201.42@tcp:35:dd.0 Request processed in 500us (981us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1788269966.713736:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788269966.780228:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269966.780459:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253085824 00000100:00100000:1.0:1788269966.780470:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253085824 00000100:00100000:1.0:1788269966.780531:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788269966.780542:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:31136:x1875136253085824:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269966.780562:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269966.780582:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e07e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101636 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.780642:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e07e92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.780655:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e07e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.780666:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e07e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269966.780710:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269966.780714:0:40075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269966.780732:0:40075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e07e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.780759:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e07e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101636 expref: 11 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.780790:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e07e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101636 expref: 10 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.780798:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:1.0:1788269966.780801:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269966.780805:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192600, rc 0) 00000100:00100000:1.0:1788269966.780862:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:31136:x1875136253085824:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 321us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269966.780869:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788269966.785211:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.785308:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253085952 00000100:00100000:0.0:1788269966.785318:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253085952 00000100:00100000:0.0:1788269966.785378:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:0.0:1788269966.785388:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:31136:x1875136253085952:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269966.785407:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.785427:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610163d expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785486:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785499:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785510:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785525:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785531:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785538:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785591:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0800/0xc5f5d7a016e07eae lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785598:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0800/0xc5f5d7a016e07eae lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785603:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0800/0xc5f5d7a016e07eae lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269966.785622:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0800/0xc5f5d7a016e07eae lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785633:0:40076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785639:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785645:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785650:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785655:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.785659:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785666:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785677:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:0.0:1788269966.785680:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.785685:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785691:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785705:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785710:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785716:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785720:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.785723:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785728:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785734:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff98c1429f2400) 00010000:00010000:0.0:1788269966.785736:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.785739:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785744:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785781:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610163d expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785801:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0800/0xc5f5d7a016e07eae lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610163d expref: 11 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.785808:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2596bed00) 00010000:00010000:0.0:1788269966.785810:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269966.785812:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0800, rc 0) 00000100:00100000:0.0:1788269966.785876:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31136:x1875136253085952:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 489us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.785883:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788269966.788174:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.788251:0:40086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253086080 00000100:00100000:3.0:1788269966.788259:0:40086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253086080 00000100:00100000:3.0:1788269966.788310:0:40086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269966.788320:0:40086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31136:x1875136253086080:12345-192.168.201.42@tcp:900:lfs.0 00000100:00100000:3.0:1788269966.788389:0:40086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31136:x1875136253086080:12345-192.168.201.42@tcp:900:lfs.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.788396:0:40086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269966.790641:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.791899:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253086208 00000100:00100000:2.0:1788269966.791920:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253086208 00000100:00100000:2.0:1788269966.791981:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:2.0:1788269966.791992:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:31136:x1875136253086208:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269966.792012:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269966.792035:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07eb5 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101644 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.792111:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ebc lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.792125:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ebc lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.792137:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ebc lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269966.792179:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788269966.792183:0:41798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788269966.792356:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07eb5 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101644 expref: 9 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.792375:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ebc lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101644 expref: 8 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.792383:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269966.792387:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269966.792390:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d200, rc 0) 00000100:00100000:2.0:1788269966.792456:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:31136:x1875136253086208:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 465us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.792465:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:1.0:1788269966.795183:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.795320:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253086336 00000100:00100000:0.0:1788269966.795329:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253086336 00000100:00100000:0.0:1788269966.795380:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:0.0:1788269966.795391:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:31136:x1875136253086336:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269966.795409:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.795428:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ec3 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610164b expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795488:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795508:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795515:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795522:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795527:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795530:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795585:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795590:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795593:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269966.795621:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00000004:00200000:0.0:1788269966.795624:0:40074:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788269966.795638:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795645:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795651:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795655:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795659:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795665:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.795668:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795673:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795680:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:0.0:1788269966.795682:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.795685:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795688:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07eca lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795696:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795700:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795703:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795706:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.795708:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795711:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795717:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c2596be500) 00010000:00010000:0.0:1788269966.795718:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.795720:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795723:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07ed1 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795738:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e07ec3 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 10 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795745:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 9 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.795749:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:0.0:1788269966.795750:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269966.795752:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0e00, rc 0) 00000100:00100000:0.0:1788269966.795806:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:31136:x1875136253086336:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 418us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.795813:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:1.0:1788269966.798357:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.798486:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253086464 00000100:00100000:0.0:1788269966.798495:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253086464 00000100:00100000:0.0:1788269966.798582:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:0.0:1788269966.798592:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2403:x1875136253086464:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269966.798607:0:41579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.798625:0:41579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07edf lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101652 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.798693:0:41579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:41579:1875136262566912:192.168.201.42@tcp:106: 00000100:00100000:0.0:1788269966.798780:0:41579:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a10c0 going to sleep for 11 seconds 00002000:00010000:0.0:1788269966.800621:0:41579:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size: 0 -> 1024 00002000:00010000:0.0:1788269966.800629:0:41579:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime: 0 -> 1788269966 00002000:00010000:0.0:1788269966.800632:0:41579:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime: 0 -> 1788269966 00002000:00010000:0.0:1788269966.800634:0:41579:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime: 0 -> 1788269966 00002000:00010000:0.0:1788269966.800636:0:41579:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1788269966.800656:0:41579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:41579:1875136262566912:192.168.201.42@tcp:106: 00010000:00010000:0.0:1788269966.800689:0:41579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07edf lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101652 expref: 6 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.800712:0:41579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07edf lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101652 expref: 6 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.800726:0:41579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1400, rc 0) 00000100:00100000:0.0:1788269966.800782:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2403:x1875136253086464:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 2191us (2435us total) trans 0 rc 301/301 00000100:00100000:0.0:1788269966.800790:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:2.0:1788269966.803569:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269966.803888:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253086720 00000100:00100000:1.0:1788269966.803896:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253086720 00000100:00100000:1.0:1788269966.803965:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:1.0:1788269966.803974:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:31136:x1875136253086720:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269966.803992:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269966.804008:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e07ee6 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101659 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.804135:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e07eed lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.804146:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e07eed lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.804154:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e07eed lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269966.804163:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:1.0:1788269966.804315:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e07ee6 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101659 expref: 12 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.804329:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e07eed lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101659 expref: 11 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.804335:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:1.0:1788269966.804337:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269966.804339:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192200, rc 0) 00000100:00100000:1.0:1788269966.804388:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31136:x1875136253086720:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 414us (827us total) trans 25769803784 rc 0/0 00000100:00100000:1.0:1788269966.804394:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:1.0:1788269966.807440:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269966.807480:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.807589:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087104 00000100:00100000:2.0:1788269966.807589:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253086976 00000100:00100000:3.0:1788269966.807598:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087104 00000100:00100000:2.0:1788269966.807598:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253086976 00000100:00100000:2.0:1788269966.807660:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:2.0:1788269966.807671:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31136:x1875136253086976:12345-192.168.201.42@tcp:101:lfs.0 00000100:00100000:3.0:1788269966.807698:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788269966.807706:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2401:x1875136253087104:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269966.807722:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269966.807736:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269966.807749:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e07eed lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101659 expref: 12 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.807751:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07efb lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101660 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269966.807772:0:40061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:3.0:1788269966.807777:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269966.807832:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2401:x1875136253087104:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 127us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.807840:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00010000:00010000:2.0:1788269966.808026:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f02 lrc: 3/0,1 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.808066:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f02 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.808077:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f02 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269966.808089:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:2.0:1788269966.808185:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07efb lrc: 0/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101660 expref: 13 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.808198:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f02 lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101660 expref: 12 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.808206:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:2.0:1788269966.808208:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788269966.808212:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c800, rc 0) 00000100:00100000:2.0:1788269966.808314:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31136:x1875136253086976:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 644us (881us total) trans 25769803785 rc 0/0 00000100:00100000:2.0:1788269966.808320:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:1.0:1788269966.817804:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.818079:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087232 00000100:00100000:2.0:1788269966.818090:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087232 00000100:00100000:2.0:1788269966.818144:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788269966.818154:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:31136:x1875136253087232:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269966.818171:0:42634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269966.818190:0:42634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101667 expref: -99 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.818221:0:42634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 8 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.818230:0:42634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269966.818234:0:42634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269966.818240:0:42634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 4/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 6 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.818284:0:42634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 8 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.818298:0:42634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 8 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.818312:0:42634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:42634:1875136262567040:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269966.818625:0:42634:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.821770:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.821854:0:41585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087360 00000100:00100000:0.0:1788269966.821863:0:41585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087360 00002000:00100000:0.0:1788269966.821924:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->1023) req@ffff98c27d7f1180 x1875136253087360/t0(0) o4->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:382/0 lens 1512/0 e 0 to 0 dl 1788269977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269966.821936:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f1180 with x1875136253087360 ext(0->1023) 00010000:00010000:0.0:1788269966.821946:0:41585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 9 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.821965:0:41585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 9 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269966.821973:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27d7f1180 00000100:00100000:0.0:1788269966.822008:0:41585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:0.0:1788269966.822017:0:41585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+9:2400:x1875136253087360:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788269966.822562:0:42634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:42634:1875136262567040:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788269966.822588:0:42634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 3/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 6 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.822604:0:42634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c000, rc 0) 00000100:00100000:0.0:1788269966.822651:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:31136:x1875136253087232:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 4499us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.822659:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:1.0:1788269966.824418:0:41585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2400:x1875136253087360:12345-192.168.201.42@tcp:4:dd.0 Request processed in 2394us (2649us total) trans 25769803788 rc 0/0 00000100:00100000:1.0:1788269966.824432:0:41585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00002000:00100000:1.0:1788269966.824442:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->1023) req@ffff98c27d7f1180 x1875136253087360/t25769803788(0) o4->0c97af8c-d97a-48dd-9f8f-2f83c7b756c7@192.168.201.42@tcp:382/0 lens 1512/448 e 0 to 0 dl 1788269977 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269966.824452:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f1180 with x1875136253087360 ext(0->1023) 00010000:00010000:1.0:1788269966.824462:0:41585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 11 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.824480:0:41585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 11 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269966.824487:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27d7f1180 00000100:00100000:1.0:1788269966.826801:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.826898:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087488 00000100:00100000:0.0:1788269966.826923:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087488 00010000:00010000:0.0:1788269966.826966:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 11 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.827071:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:0.0:1788269966.827082:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253087488:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269966.827096:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788269966.827115:0:40062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1788269966.827122:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 11 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.827137:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 11 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.827161:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b439514/0xc5f5d7a016e07e84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610162f expref: 11 pid: 41578 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.827177:0:40062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269966.827181:0:40062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269966.827189:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 5 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.827199:0:40062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 5 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.827236:0:40062:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 5 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.827263:0:40062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:40062:1875136262567168:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788269966.827334:0:40062:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.831131:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.831576:0:40062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:40062:1875136262567168:192.168.201.42@tcp:105: 00010000:00010000:0.0:1788269966.831600:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269966.831715:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2402:x1875136253087488:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 4634us (4922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.831730:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788269966.831982:0:41584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087616 00000100:00100000:3.0:1788269966.831990:0:41584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087616 00002000:00100000:2.0:1788269966.832194:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa2:0x0] (0->4095) req@ffff98c27a61b480 x1875136253087616/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:382/0 lens 488/0 e 0 to 0 dl 1788269977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269966.832205:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a61b480 with x1875136253087616 ext(0->4095) 00002000:00010000:2.0:1788269966.832210:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a61b480 00000100:00100000:2.0:1788269966.832229:0:41584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788269966.832238:0:41584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253087616:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:2.0:1788269966.832626:0:41584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253087616:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 386us (1503us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788269966.832633:0:41584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00002000:00100000:2.0:1788269966.832639:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa2:0x0] (0->4095) req@ffff98c27a61b480 x1875136253087616/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:382/0 lens 488/4536 e 0 to 0 dl 1788269977 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269966.832647:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a61b480 with x1875136253087616 ext(0->4095) 00002000:00010000:2.0:1788269966.832651:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a61b480 00000100:00100000:2.0:1788269966.836360:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.836463:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087744 00000100:00100000:0.0:1788269966.836472:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087744 00000100:00100000:0.0:1788269966.836560:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788269966.836571:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253087744:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:0.0:1788269966.836612:0:41578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.836634:0:41578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 6 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.836643:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269966.836647:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269966.836652:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.836689:0:41578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 6 pid: 42634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.836703:0:41578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 6 pid: 42634 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.836718:0:41578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262567296:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788269966.836794:0:41578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1425a1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.840149:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.840272:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253087872 00000100:00100000:2.0:1788269966.840281:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253087872 00010000:00010000:2.0:1788269966.840313:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 7 pid: 42634 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.840345:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788269966.840351:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253087872:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269966.840362:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269966.840380:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 7 pid: 42634 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.840391:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 7 pid: 42634 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.840410:0:43117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269966.840413:0:43117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269966.840426:0:43117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.840432:0:43117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.840448:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269966.840485:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253087872:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 134us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.840489:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00010000:00010000:0.0:1788269966.841509:0:41578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744edfc3/0xc5f5d7a016e07f10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101667 expref: 6 pid: 42634 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.841530:0:41578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:41578:1875136262567296:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788269966.841551:0:41578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841561:0:41578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841567:0:41578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841589:0:41578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841597:0:41578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841604:0:41578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841611:0:41578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269966.841615:0:41578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841624:0:41578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841638:0:41578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.841645:0:41578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e07f17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.841748:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2401:x1875136253087744:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 5179us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.841754:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788269966.843372:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.843589:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253088128 00000100:00100000:2.0:1788269966.843596:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253088128 00000100:00100000:2.0:1788269966.843661:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788269966.843668:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31136:x1875136253088128:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:2.0:1788269966.843717:0:40077:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x240002b12:0x1:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f02 lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101660 expref: 12 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269966.843877:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803786 00000001:00080000:2.0:1788269966.843932:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803787 00000001:00080000:2.0:1788269966.844207:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803788 00010000:00010000:2.0:1788269966.844239:0:40077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.844253:0:40077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 9 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.844261:0:40077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 16 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.844270:0:40077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 5/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.844302:0:40077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 16 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.844317:0:40077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 16 pid: 40074 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.844331:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:40077:1875136262567424:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269966.844406:0:40077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 9 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.844414:0:40077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 9 pid: 41798 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.844423:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:40077:1875136262567552:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269966.844444:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.846995:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.847145:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253088256 00000100:00100000:0.0:1788269966.847154:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253088256 00010000:00010000:0.0:1788269966.847189:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 5/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 17 pid: 40074 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.847222:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788269966.847232:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+17:2401:x1875136253088256:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269966.847246:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269966.847252:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 5/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 17 pid: 40074 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.847266:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 17 pid: 40074 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.847286:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:0.0:1788269966.847292:0:40060:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.847300:0:40060:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.847306:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269966.847358:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+17:2401:x1875136253088256:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.847365:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788269966.847761:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.847818:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253088384 00000100:00100000:0.0:1788269966.847823:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253088384 00010000:00010000:0.0:1788269966.847840:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 5/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 10 pid: 41798 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269966.847868:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:0.0:1788269966.847875:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2401:x1875136253088384:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269966.847884:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269966.847888:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 5/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 10 pid: 41798 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.847898:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 10 pid: 41798 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.848025:0:43117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:0.0:1788269966.848030:0:43117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.848063:0:43117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.848073:0:43117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 4/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.848087:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269966.848104:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+10:2401:x1875136253088384:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 230us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.848108:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00010000:00010000:2.0:1788269966.848400:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e07ed8 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610164b expref: 16 pid: 40074 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.848424:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:40077:1875136262567424:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269966.848438:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07e76 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101628 expref: 9 pid: 41798 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.848449:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:40077:1875136262567552:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269966.848468:0:40077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.848477:0:40077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.848482:0:40077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269966.848579:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803789 00000001:00080000:2.0:1788269966.848685:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803790 00000001:00080000:2.0:1788269966.848719:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803791 00000100:00100000:2.0:1788269966.848790:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262567680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269966.848832:0:40077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.849036:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269966.849460:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262567680 00000100:00100000:3.0:1788269966.849467:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262567680 00000100:00100000:3.0:1788269966.849523:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269966.849532:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2587ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:40077:x1875136262567680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788269966.849599:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2587ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:40077:x1875136262567680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269966.849604:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788269966.849871:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262567680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788269966.850103:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803792 00000100:00100000:2.0:1788269966.850143:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262567808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269966.850187:0:40077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269966.850207:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269966.850221:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262567808 00000100:00100000:2.0:1788269966.850225:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262567808 00000100:00100000:2.0:1788269966.850248:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788269966.850255:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:40077:x1875136262567808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269966.850340:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:40077:x1875136262567808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (152us total) trans 25769803789 rc 0/0 00000100:00100000:2.0:1788269966.850347:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788269966.850370:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262567808:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1788269966.850389:0:40077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.850395:0:40077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 2/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.850400:0:40077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.850404:0:40077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5cc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.850407:0:40077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.850412:0:40077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 4/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.850423:0:40077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:2.0:1788269966.850426:0:40077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788269966.850430:0:40077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 2/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.850436:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f1e lrc: 0/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269966.850514:0:40077:0:(mdd_object.c:4014:mdd_close()) Object [0x240002b10:0x2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788269966.850570:0:40077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].2, 64 off8320 00000004:00080000:2.0:1788269966.850579:0:40077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 758557539355ns, next at 759557537415ns, rc = 0 00000001:00080000:2.0:1788269966.850584:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803793 00010000:00010000:2.0:1788269966.850599:0:40077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c2596be000) 00010000:00010000:2.0:1788269966.850601:0:40077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788269966.850606:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f02 lrc: 0/0,0 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101660 expref: 20 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.850664:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:31136:x1875136253088128:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 6997us (7300us total) trans 25769803794 rc 0/0 00000100:00100000:2.0:1788269966.850669:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000020:00080000:2.0:1788269966.850671:0:40077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1788269966.851033:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269966.852380:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.852556:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253088512 00000100:00100000:0.0:1788269966.852562:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253088512 00000100:00100000:0.0:1788269966.852635:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:0.0:1788269966.852642:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+19:31136:x1875136253088512:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269966.852657:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.852672:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1400/0xc5f5d7a016e07f25 lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610166e expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.852709:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1400/0xc5f5d7a016e07f25 lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610166e expref: 20 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.852718:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1400/0xc5f5d7a016e07f25 lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610166e expref: 20 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.852729:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788269966.852731:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269966.852734:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1400, rc 0) 00000100:00100000:0.0:1788269966.852776:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+20:31136:x1875136253088512:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 134us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.852782:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:2.0:1788269966.854419:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.854510:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253088768 00000100:00100000:3.0:1788269966.854517:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253088768 00000100:00100000:3.0:1788269966.854580:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788269966.854587:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+20:31136:x1875136253088768:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269966.854783:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+21:31136:x1875136253088768:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 195us (367us total) trans 25769803795 rc 0/0 00000100:00100000:3.0:1788269966.854790:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788269966.907876:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.907974:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253089024 00000100:00100000:2.0:1788269966.907985:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253089024 00000100:00100000:2.0:1788269966.908078:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:2.0:1788269966.908090:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+21:31146:x1875136253089024:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269966.908117:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269966.908211:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e07f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101675 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269966.908555:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788269966.908654:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e07f2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101675 expref: 23 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.908670:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143876900) 00010000:00010000:1.0:1788269966.908673:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269966.908678:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e07f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101675 expref: 23 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269966.908695:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192800, rc 0) 00000100:00100000:1.0:1788269966.909844:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:31146:x1875136253089024:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1751us (1971us total) trans 25769803796 rc 301/301 00000100:00100000:1.0:1788269966.909854:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:1.0:1788269966.913451:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.913695:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253089152 00000100:00100000:2.0:1788269966.913707:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253089152 00000100:00100000:2.0:1788269966.913769:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788269966.913780:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:31146:x1875136253089152:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788269966.913853:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.913870:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.913881:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.913892:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.913900:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.913928:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914005:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914014:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914020:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269966.914097:0:41798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914109:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914115:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914122:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914132:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5cc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.914136:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914144:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914157:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269966.914160:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269966.914164:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914170:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f3a lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914181:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914188:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914194:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914199:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.914202:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914208:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914231:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c2596be500) 00010000:00010000:2.0:1788269966.914234:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269966.914237:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914242:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f41 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914252:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914258:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914264:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914268:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269966.914271:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914276:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914282:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269966.914284:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269966.914287:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 2/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.914293:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e07f48 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269966.914360:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:31146:x1875136253089152:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 581us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269966.914367:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788269966.917690:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.917794:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253089408 00000100:00100000:0.0:1788269966.917804:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253089408 00000100:00100000:0.0:1788269966.917897:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788269966.917927:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:31146:x1875136253089408:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788269966.918166:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+23:31146:x1875136253089408:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 258us (485us total) trans 25769803797 rc 0/0 00000100:00100000:0.0:1788269966.918175:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788269966.982877:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269966.982991:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253089536 00000100:00100000:0.0:1788269966.983001:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253089536 00000100:00100000:0.0:1788269966.983150:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788269966.983161:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+23:31152:x1875136253089536:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269966.983185:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269966.983205:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07f4f lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610167c expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983287:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983302:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983323:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983335:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983341:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983352:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983418:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983426:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983433:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269966.983471:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00000004:00200000:0.0:1788269966.983475:0:40074:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788269966.983506:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983517:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983526:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983531:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983538:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983544:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.983548:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983556:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983568:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:0.0:1788269966.983571:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.983576:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983583:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07f56 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983596:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983603:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983608:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983614:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269966.983617:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983624:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983630:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c2596be500) 00010000:00010000:0.0:1788269966.983633:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269966.983636:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983646:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07f5d lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983671:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07f4f lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610167c expref: 25 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983684:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610167c expref: 24 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269966.983691:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788269966.983693:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269966.983696:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1600, rc 0) 00000100:00100000:0.0:1788269966.983745:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+24:31152:x1875136253089536:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 586us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269966.983752:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:1.0:1788269966.989460:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269966.994188:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253089792 00000100:00100000:2.0:1788269966.994204:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253089792 00000100:00100000:2.0:1788269966.994287:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:2.0:1788269966.994298:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+24:31152:x1875136253089792:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269966.994319:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269966.994340:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f6b lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101683 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.994450:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f72 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.994471:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f72 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.994483:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f72 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269966.994665:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:2.0:1788269966.994775:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f6b lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101683 expref: 27 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.994794:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f72 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101683 expref: 26 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269966.994810:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269966.994813:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269966.994817:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5cc00, rc 0) 00000100:00100000:2.0:1788269966.994888:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:31152:x1875136253089792:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 591us (5437us total) trans 25769803798 rc 0/0 00000100:00100000:2.0:1788269966.994895:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:2.0:1788269966.997944:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269966.998027:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253090048 00000100:00100000:3.0:1788269966.998036:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253090048 00000100:00100000:3.0:1788269966.998122:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788269966.998132:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:31152:x1875136253090048:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269966.998643:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31152:x1875136253090048:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 512us (708us total) trans 25769803799 rc 0/0 00000100:00100000:3.0:1788269966.998652:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788269967.001414:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269967.001515:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253090176 00000100:00100000:3.0:1788269967.001525:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253090176 00000100:00100000:3.0:1788269967.001600:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788269967.001611:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:2400:x1875136253090176:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269967.001627:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269967.001653:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f72 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101683 expref: 27 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269967.001673:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788269967.001678:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269967.001722:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:2400:x1875136253090176:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 114us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269967.001729:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00080000:1.0:1788269967.002503:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269967.044274:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269967.044349:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269967.044388:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262568064:0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.044415:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269967.044447:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269967.044453:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262568192:0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.044474:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269967.044550:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262567936 00000100:00100000:1.0:1788269967.044556:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262567936 00000100:00100000:1.0:1788269967.044614:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788269967.044624:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262567936:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788269967.044640:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788269967.044653:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1788269967.044704:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262567936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269967.044712:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788269967.044743:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262568320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269967.044765:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269967.044765:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269967.044781:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269967.044787:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262568448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269967.044807:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269967.044823:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568320 00000100:00100000:1.0:1788269967.044826:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568320 00000100:00100000:1.0:1788269967.044854:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568448 00000100:00100000:1.0:1788269967.044857:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568448 00000100:00100000:1.0:1788269967.044870:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788269967.044875:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262568320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269967.044884:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50847424 pending 57344 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788269967.044927:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262568320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269967.044933:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788269967.044934:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788269967.044937:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269967.044946:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269967.044952:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262568448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788269967.044961:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1788269967.044984:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262568448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269967.044990:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269967.045015:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262568448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788269967.045022:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 2 00000004:00080000:1.0:1788269967.045027:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803783 committed transno 25769803783 00000100:00100000:1.0:1788269967.045068:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262568320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269967.045090:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568192 00000100:00100000:1.0:1788269967.045094:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568192 00000100:00100000:1.0:1788269967.045123:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269967.045130:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262568192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.045165:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262568192:12345-0@lo:400:kworker.0 Request processed in 36us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269967.045171:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269967.045180:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262568192:0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.045200:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568064 00000100:00100000:1.0:1788269967.045203:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568064 00000100:00100000:1.0:1788269967.045234:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788269967.045241:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3609:x1875136262568064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.045274:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3609:x1875136262568064:12345-0@lo:400:kworker.0 Request processed in 33us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269967.045281:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788269967.045310:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262568064:0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.045447:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262568576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788269967.045475:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269967.045508:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269967.045514:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262568704:0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.045534:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269967.045558:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568576 00000100:00100000:3.0:1788269967.045562:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568576 00000100:00100000:3.0:1788269967.045587:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788269967.045594:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262568576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788269967.045617:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788269967.045649:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262568576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269967.045655:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788269967.045681:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262568576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269967.047194:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568704 00000100:00100000:0.0:1788269967.047203:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568704 00000100:00100000:0.0:1788269967.047246:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269967.047254:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262568704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269967.047315:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262568704:12345-0@lo:400:kworker.0 Request processed in 62us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269967.047321:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269967.047358:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262568704:0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.054632:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262568832:0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.054707:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269967.054844:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262568960:0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.054874:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269967.055011:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568832 00000100:00100000:0.0:1788269967.055020:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568832 00000100:00100000:0.0:1788269967.055090:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262568960 00000100:00100000:0.0:1788269967.055094:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262568960 00000100:00080000:0.0:1788269967.055113:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269967.055137:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788269967.055145:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262568832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.055198:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269967.055207:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262568960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.055245:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262568960:12345-0@lo:400:kworker.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269967.055252:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269967.055290:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262568960:0@lo:400:kworker.0 00000100:00100000:2.0:1788269967.062572:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262569216:0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.062600:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262569088:0@lo:400:kworker.0 00000100:00100000:2.0:1788269967.062639:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269967.062660:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262569216 00000100:00100000:3.0:1788269967.062667:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262569216 00000100:00100000:3.0:1788269967.062721:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269967.062729:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262569216:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788269967.062730:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269967.062736:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269967.062743:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262569344:0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.062776:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262569216:12345-0@lo:400:kworker.0 Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269967.062779:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269967.062784:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269967.062798:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262569344 00000100:00100000:3.0:1788269967.062801:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262569344 00000100:00100000:2.0:1788269967.062814:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262569216:0@lo:400:kworker.0 00000100:00100000:3.0:1788269967.062816:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269967.062821:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262569344:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788269967.062851:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269967.062853:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262569344:12345-0@lo:400:kworker.0 Request processed in 32us (73us total) trans 0 rc 0/0 00000100:00080000:2.0:1788269967.062855:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269967.062863:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269967.062874:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269967.062883:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262569088 00000100:00100000:3.0:1788269967.062885:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262569088 00000100:00100000:3.0:1788269967.062919:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269967.062926:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262569088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269967.064386:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262569344:0@lo:400:kworker.0 00000100:00080000:2.0:1788269967.064441:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269967.072535:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262569088:12345-0@lo:400:kworker.0 Request processed in 8556us (8617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269967.072553:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269967.072637:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262569088:0@lo:400:kworker.0 00000100:00100000:0.0:1788269967.074415:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262568832:12345-0@lo:400:kworker.0 Request processed in 19261us (19700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269967.074429:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788269967.075031:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262568832:0@lo:400:kworker.0 00000100:00100000:1.0:1788269967.082986:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269967.083242:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253090432 00000100:00100000:2.0:1788269967.083252:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253090432 00000100:00100000:0.0:1788269967.083397:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:0.0:1788269967.083419:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:31162:x1875136253090432:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269967.083444:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269967.083467:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610168a expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269967.083563:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788269967.083656:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07f80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610168a expref: 28 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.083670:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f2800) 00010000:00010000:0.0:1788269967.083673:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269967.083678:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e07f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610168a expref: 28 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.083696:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1200, rc 0) 00000100:00100000:0.0:1788269967.083762:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31162:x1875136253090432:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 354us (786us total) trans 25769803800 rc 301/301 00000100:00100000:0.0:1788269967.084230:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:2.0:1788269967.101593:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269967.101933:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253090688 00000100:00100000:3.0:1788269967.101946:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253090688 00000100:00100000:3.0:1788269967.102007:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788269967.102019:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31162:x1875136253090688:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269967.102247:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+28:31162:x1875136253090688:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 230us (676us total) trans 25769803801 rc 0/0 00000100:00100000:3.0:1788269967.102255:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000040:00080000:3.0:1788269967.109283:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788269967.225315:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269967.225427:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253090944 00000100:00100000:2.0:1788269967.225437:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253090944 00000100:00100000:2.0:1788269967.225497:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:2.0:1788269967.225508:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+28:31168:x1875136253090944:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269967.225532:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269967.225552:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f8e lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101691 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.225655:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f95 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.225669:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f95 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.225681:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f95 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269967.225691:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:2.0:1788269967.225805:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e07f8e lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101691 expref: 31 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.225824:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f95 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101691 expref: 30 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.225833:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269967.225835:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269967.225847:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5cc00, rc 0) 00000100:00100000:2.0:1788269967.225919:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31168:x1875136253090944:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 413us (621us total) trans 25769803802 rc 0/0 00000100:00100000:2.0:1788269967.225926:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:1.0:1788269967.236350:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269967.236435:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269967.238488:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253091328 00000100:00100000:2.0:1788269967.238518:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253091328 00000100:00100000:2.0:1788269967.238616:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788269967.238628:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:2400:x1875136253091328:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269967.238644:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269967.238682:0:43117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07f95 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101691 expref: 30 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.238703:0:43117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269967.238708:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269967.238777:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:2400:x1875136253091328:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 152us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269967.238785:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788269967.243624:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253091200 00000100:00100000:0.0:1788269967.243641:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253091200 00000100:00100000:0.0:1788269967.243790:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:0.0:1788269967.243799:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31168:x1875136253091200:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269967.243820:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269967.243842:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fa3 lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101698 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.244013:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07faa lrc: 3/0,1 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.244030:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07faa lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.244066:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07faa lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269967.244083:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:0.0:1788269967.244210:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fa3 lrc: 0/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101698 expref: 32 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.244229:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07faa lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101698 expref: 31 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269967.244248:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788269967.244251:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788269967.244254:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0400, rc 0) 00000100:00100000:0.0:1788269967.244442:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31168:x1875136253091200:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 642us (8136us total) trans 25769803803 rc 0/0 00000100:00100000:0.0:1788269967.244450:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:2.0:1788269967.249687:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269967.249749:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253091584 00000100:00100000:3.0:1788269967.249757:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253091584 00000100:00100000:3.0:1788269967.249834:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788269967.249842:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31168:x1875136253091584:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:3.0:1788269967.249853:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788269967.249875:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e07f64 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610167c expref: 31 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269967.249895:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1400/0xc5f5d7a016e07f25 lrc: 0/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610166e expref: 30 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269967.249916:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788269967.249921:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269967.249977:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31168:x1875136253091584:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269967.249985:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788269967.253218:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269967.253292:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253091712 00000100:00100000:3.0:1788269967.253301:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253091712 00000100:00100000:3.0:1788269967.253354:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:3.0:1788269967.253365:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31168:x1875136253091712:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:3.0:1788269967.253465:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269967.253481:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269967.253489:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269967.255306:0:40074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269967.255387:0:40074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788269967.255517:0:40074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 136 off8328 00000100:00100000:0.0:1788269967.255603:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31168:x1875136253091712:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 2236us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269967.255613:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:2.0:1788269967.258482:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269967.258585:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253091840 00000100:00100000:3.0:1788269967.258593:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253091840 00000100:00100000:2.0:1788269967.258699:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:2.0:1788269967.258707:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31168:x1875136253091840:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269967.258723:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269967.258740:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610169f expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.258801:0:42351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 2/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.258811:0:42351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 4/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 30 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.258833:0:42351:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.258845:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 3/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 30 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.258857:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269967.258859:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269967.258862:0:42351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 3/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 30 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269967.258870:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5cc00, rc 0) 00000100:00100000:2.0:1788269967.258935:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31168:x1875136253091840:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 228us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269967.258942:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000040:00080000:0.0:1788269967.492250:0:40112:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788269967.492260:0:40112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269967.492281:0:40112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788269967.492290:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1788269968.075294:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269968.132241:0:40828:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269968.132250:0:40828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269968.132276:0:40828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 2 count 2 00000040:00080000:3.0:1788269968.132284:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788269968.132413:0:40828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:40828:1875136262569472:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269968.132509:0:40828:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269968.147781:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.148159:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253091968 00000100:00100000:0.0:1788269968.148169:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253091968 00000100:00100000:0.0:1788269968.148225:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:0.0:1788269968.148235:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31170:x1875136253091968:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269968.148266:0:40076:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x240002b12:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269968.148401:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31170:x1875136253091968:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 167us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.148409:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:3.0:1788269968.148742:0:40828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:40828:1875136262569472:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788269968.152997:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.153078:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253092096 00000100:00100000:0.0:1788269968.153087:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253092096 00000100:00100000:0.0:1788269968.153155:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:0.0:1788269968.153166:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31170:x1875136253092096:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788269968.153252:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.153269:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.153552:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.153571:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.153578:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.153585:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.153656:0:40074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:40074:1875136262569600:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788269968.153699:0:40074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269968.153730:0:40074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269968.153782:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262569600 00000100:00100000:1.0:1788269968.153787:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262569600 00000100:00100000:1.0:1788269968.153820:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788269968.153827:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:40074:x1875136262569600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788269968.153899:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:40074:x1875136262569600:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.153905:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788269968.153940:0:40074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275904380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:40074:1875136262569600:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788269968.153983:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.153992:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154000:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269968.154015:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154025:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154031:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154067:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154074:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.154078:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154085:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154096:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:1.0:1788269968.154099:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.154103:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154109:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0200/0xc5f5d7a016e07fc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154119:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154124:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154142:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154148:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.154151:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154157:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154163:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x82807a08 (ffff98c1429f2400) 00010000:00010000:1.0:1788269968.154165:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.154168:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154173:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e07fcd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x82807a08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154186:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154192:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154198:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154202:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.154205:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154210:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154216:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c143876900) 00010000:00010000:1.0:1788269968.154218:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269968.154221:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 2/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.154227:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193000/0xc5f5d7a016e07fd4 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.154280:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31170:x1875136253092096:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 1115us (1291us total) trans 0 rc 0/0 00000100:00080000:2.0:1788269968.154431:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269968.154758:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:1.0:1788269968.192862:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.192932:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253092224 00000100:00100000:2.0:1788269968.192943:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253092224 00000100:00100000:2.0:1788269968.193069:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788269968.193080:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31170:x1875136253092224:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788269968.193156:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193175:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193197:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269968.193243:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00000004:00200000:2.0:1788269968.193248:0:42351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788269968.193288:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193295:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193302:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193308:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.193312:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193320:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193332:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269968.193335:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269968.193340:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 2/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.193346:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07fdb lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.193429:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31170:x1875136253092224:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 341us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.193446:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788269968.203003:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.209326:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253092480 00000100:00100000:1.0:1788269968.209341:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253092480 00000100:00100000:1.0:1788269968.209554:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:1.0:1788269968.209565:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31170:x1875136253092480:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269968.209585:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.209608:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e07fe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016a6 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209709:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 3/1,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209724:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 3/1,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209735:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 3/1,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269968.209745:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:1.0:1788269968.209818:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 3/1,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209831:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 2/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209838:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209844:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.209849:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209856:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 4/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209868:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788269968.209870:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788269968.209874:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209892:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e07fe9 lrc: 0/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209934:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e07fe2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016a6 expref: 32 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209944:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143876900) 00010000:00010000:1.0:1788269968.209946:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269968.209950:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e07fe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016a6 expref: 32 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.209963:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192a00, rc 0) 00000100:00100000:1.0:1788269968.210103:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31170:x1875136253092480:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 539us (7111us total) trans 25769803804 rc 301/301 00000100:00100000:1.0:1788269968.210118:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:1.0:1788269968.218571:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.218663:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253092608 00000100:00100000:0.0:1788269968.218673:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253092608 00000100:00100000:0.0:1788269968.218873:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:0.0:1788269968.218895:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31170:x1875136253092608:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269968.218928:0:40074:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x240002b12:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269968.219515:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31170:x1875136253092608:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 159us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.219524:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:1.0:1788269968.224625:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.224704:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253092864 00000100:00100000:2.0:1788269968.224714:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253092864 00000100:00100000:2.0:1788269968.224766:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:2.0:1788269968.224776:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31170:x1875136253092864:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269968.224795:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269968.224798:0:42351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269968.224825:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e07ebc lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101644 expref: 31 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.224844:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269968.224849:0:42351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269968.224861:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07ff7 lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016ad expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269968.225652:0:42351:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x83:0x0], count =31 00000004:00080000:2.0:1788269968.225659:0:42351:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x83:0x0]+31 in llog 00000004:00080000:2.0:1788269968.225669:0:42351:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa2:0x0], index 1: 0 00010000:00010000:2.0:1788269968.225799:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c000/0xc5f5d7a016e07ffe lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.225812:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c000/0xc5f5d7a016e07ffe lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.225822:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c000/0xc5f5d7a016e07ffe lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.225871:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c400/0xc5f5d7a016e07ff7 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016ad expref: 33 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.226972:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c000/0xc5f5d7a016e07ffe lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016ad expref: 32 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.226985:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c2596be000) 00010000:00010000:2.0:1788269968.226988:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269968.226991:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c000, rc 0) 00000100:00100000:2.0:1788269968.227349:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31170:x1875136253092864:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2574us (2916us total) trans 25769803805 rc 0/0 00000100:00100000:2.0:1788269968.227358:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:1.0:1788269968.233983:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.236754:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253092992 00000100:00100000:2.0:1788269968.236769:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253092992 00000100:00100000:2.0:1788269968.236907:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:2.0:1788269968.236919:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31170:x1875136253092992:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269968.236941:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269968.236960:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0800c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016b4 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237020:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237034:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237073:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237092:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237100:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237117:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237171:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e08021 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237180:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e08021 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237201:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e08021 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269968.237223:0:40075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e08021 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237235:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237241:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237247:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237254:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.237267:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237275:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237287:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:2.0:1788269968.237290:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269968.237294:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237300:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237311:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237317:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237323:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237328:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.237331:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237337:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237343:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff98c2596bec00) 00010000:00010000:2.0:1788269968.237345:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269968.237348:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237357:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0801a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237384:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0800c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016b4 expref: 13 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237397:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e08021 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016b4 expref: 12 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.237405:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2596bed00) 00010000:00010000:2.0:1788269968.237407:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269968.237410:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030000, rc 0) 00000100:00100000:2.0:1788269968.238946:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31170:x1875136253092992:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2023us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.238957:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:1.0:1788269968.256128:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.256167:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.256359:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253093248 00000100:00100000:2.0:1788269968.256369:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253093248 00000100:00100000:2.0:1788269968.256452:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788269968.256463:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2402:x1875136253093248:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269968.256478:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269968.256502:0:43117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030000/0xc5f5d7a016e08021 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016b4 expref: 12 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.256520:0:43117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2596bed00) 00010000:00010000:2.0:1788269968.256524:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269968.256572:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:2402:x1875136253093248:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 111us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.256581:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788269968.258217:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253093120 00000100:00100000:3.0:1788269968.258230:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253093120 00000100:00100000:3.0:1788269968.258385:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:3.0:1788269968.258395:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31170:x1875136253093120:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269968.258413:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269968.258430:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08028 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016bb expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.258619:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee800/0xc5f5d7a016e0802f lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.258637:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee800/0xc5f5d7a016e0802f lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.258647:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee800/0xc5f5d7a016e0802f lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269968.258687:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788269968.258691:0:41798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788269968.258725:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08028 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016bb expref: 34 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.258754:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee800/0xc5f5d7a016e0802f lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016bb expref: 33 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.258768:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:3.0:1788269968.258771:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788269968.258775:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee800, rc 0) 00000100:00100000:3.0:1788269968.258876:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31170:x1875136253093120:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 483us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269968.258893:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:1.0:1788269968.272035:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.272192:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253093504 00000100:00100000:2.0:1788269968.272202:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253093504 00000100:00100000:2.0:1788269968.272249:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:2.0:1788269968.272270:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31170:x1875136253093504:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269968.272322:0:42351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269968.272348:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c000/0xc5f5d7a016e07ffe lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016ad expref: 33 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272365:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c2596be000) 00010000:00010000:2.0:1788269968.272374:0:42351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269968.272394:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272408:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272418:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272431:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272546:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272554:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272599:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272605:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 2/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272612:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272617:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.272622:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272630:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 4/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272639:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269968.272642:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269968.272645:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272652:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08036 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272660:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272665:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 2/0,0 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272670:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 3/0,0 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272676:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.272679:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 3/0,0 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272684:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 4/0,0 mode: PW/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272689:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x85e455e1 (ffff98c2596bec00) 00010000:00010000:2.0:1788269968.272691:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269968.272693:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 2/0,0 mode: --/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.272699:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e0803d lrc: 0/0,0 mode: --/PW res: [0x240002b10:0x1:0x0].0x85e455e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.272781:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31170:x1875136253093504:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 522us (754us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269968.272788:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:1.0:1788269968.286004:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.291967:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253093632 00000100:00100000:2.0:1788269968.291997:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253093632 00000100:00100000:0.0:1788269968.292395:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:0.0:1788269968.292426:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31170:x1875136253093632:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269968.292583:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.292606:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e08044 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016c2 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.292642:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.292655:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.292665:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.292827:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e08044 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 34 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.292846:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 33 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.292854:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788269968.292857:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788269968.292861:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1a00, rc 0) 00000100:00100000:0.0:1788269968.292946:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31170:x1875136253093632:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 522us (6952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.292953:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:1.0:1788269968.304559:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.304695:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253093888 00000100:00100000:3.0:1788269968.304706:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253093888 00000100:00100000:3.0:1788269968.304766:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:3.0:1788269968.304777:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31170:x1875136253093888:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788269968.304860:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.304876:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.304899:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269968.305079:0:41798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].2, 88 off8344 00000004:00080000:3.0:1788269968.305090:0:41798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 760012049711ns, next at 761012046883ns, rc = 0 00000004:00010000:3.0:1788269968.305383:0:41798:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f7c3528 reply state 00000000a1a6294e transno 25769803806 ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.305396:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.305404:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:3.0:1788269968.305407:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788269968.305411:0:41798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269968.305610:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+35:31170:x1875136253093888:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 834us (1061us total) trans 25769803806 rc 0/0 00000100:00100000:3.0:1788269968.305617:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:2.0:1788269968.307758:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.307850:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253094016 00000100:00100000:0.0:1788269968.307858:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253094016 00000100:00100000:0.0:1788269968.307922:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:0.0:1788269968.307933:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+35:31170:x1875136253094016:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269968.307954:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.307974:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016c9 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.308023:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 36 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.308036:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 36 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.308077:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788269968.308080:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269968.308083:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1c00, rc 0) 00000100:00100000:0.0:1788269968.308430:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:31170:x1875136253094016:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 499us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.308448:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:0.0:1788269968.326354:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.326549:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253094144 00000100:00100000:1.0:1788269968.326558:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253094144 00000100:00100000:1.0:1788269968.326629:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788269968.326640:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2400:x1875136253094144:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788269968.326857:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2400:x1875136253094144:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 218us (511us total) trans 25769803782 rc 0/0 00000100:00100000:1.0:1788269968.326865:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00080000:2.0:1788269968.326947:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269968.340641:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.340772:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253094400 00000100:00100000:3.0:1788269968.340782:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253094400 00000100:00100000:3.0:1788269968.340842:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788269968.340853:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:31170:x1875136253094400:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788269968.341118:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:31170:x1875136253094400:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 267us (806us total) trans 25769803807 rc 0/0 00000100:00100000:3.0:1788269968.341127:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788269968.348597:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.348675:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253094656 00000100:00100000:1.0:1788269968.348686:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253094656 00000100:00100000:1.0:1788269968.348745:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788269968.348756:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:31170:x1875136253094656:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788269968.348862:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:31170:x1875136253094656:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 108us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.348870:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:0.0:1788269968.355869:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.356099:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253094784 00000100:00100000:2.0:1788269968.356109:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253094784 00000100:00100000:2.0:1788269968.356170:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:2.0:1788269968.356192:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:31170:x1875136253094784:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269968.356214:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269968.356243:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08060 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016d0 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.356332:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08067 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.356347:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08067 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.356358:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08067 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269968.356614:0:42351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269968.356635:0:42351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08067 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.356662:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08060 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d0 expref: 39 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.356681:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08067 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d0 expref: 38 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.356690:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:2.0:1788269968.356693:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788269968.356696:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030c00, rc 0) 00000100:00100000:2.0:1788269968.356756:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:31170:x1875136253094784:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 576us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.356763:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:0.0:1788269968.366773:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.366876:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253094912 00000100:00100000:1.0:1788269968.366899:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253094912 00000100:00100000:1.0:1788269968.366950:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788269968.366960:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253094912:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269968.366987:0:41579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.367008:0:41579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016d7 expref: -99 pid: 41579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269968.367031:0:41579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d590, blocks: 0x0 00010000:00010000:1.0:1788269968.367083:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=760s v=(0 0) 00010000:00010000:1.0:1788269968.367088:0:41579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269968.367097:0:41579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 7 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.367117:0:41579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 7 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.367130:0:41579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192e00, rc 0) 00000100:00100000:1.0:1788269968.367180:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253094912:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 222us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.367187:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788269968.370787:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.370888:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253095168 00000100:00100000:2.0:1788269968.370905:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253095168 00000100:00100000:2.0:1788269968.370967:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788269968.370978:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:31170:x1875136253095168:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269968.371108:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:31170:x1875136253095168:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.371115:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788269968.375670:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.375987:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253095296 00000100:00100000:0.0:1788269968.375996:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253095296 00000100:00100000:0.0:1788269968.376085:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788269968.376096:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:31170:x1875136253095296:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269968.376115:0:41580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.376132:0:41580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016de expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.376162:0:41580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 8 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.376173:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269968.376177:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269968.376193:0:41580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 8 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.376226:0:41580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 8 pid: 41579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.376240:0:41580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 8 pid: 41579 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.376255:0:41580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:41580:1875136262569728:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788269968.376324:0:41580:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269968.382717:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.384085:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253095424 00000100:00100000:3.0:1788269968.384096:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253095424 00010000:00010000:3.0:1788269968.384138:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 9 pid: 41579 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.384172:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788269968.384182:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2400:x1875136253095424:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269968.384196:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269968.384228:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 9 pid: 41579 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.384244:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 9 pid: 41579 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.384268:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269968.384273:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269968.384281:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 9 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.384291:0:40061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 9 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.384329:0:40061:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 9 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.384343:0:40061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:40061:1875136262569856:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788269968.384771:0:40061:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269968.388488:0:40061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:40061:1875136262569856:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788269968.388513:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269968.388566:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2400:x1875136253095424:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 4385us (5858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269968.388577:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00010000:00010000:1.0:1788269968.391469:0:41580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0806e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d7 expref: 8 pid: 41579 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.391494:0:41580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:41580:1875136262569728:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269968.391521:0:41580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.391537:0:41580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:2.0:1788269968.392130:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:31170:x1875136253095296:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 16033us (16466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.392140:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788269968.405510:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.405608:0:41585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253095552 00000100:00100000:1.0:1788269968.405618:0:41585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253095552 00002000:00100000:1.0:1788269968.405662:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa2:0x0] (0->1023) req@ffff98c26b602680 x1875136253095552/t0(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 1512/0 e 0 to 0 dl 1788269979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269968.405673:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b602680 with x1875136253095552 ext(0->1023) 00002000:00010000:1.0:1788269968.405680:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26b602680 00000100:00100000:1.0:1788269968.405712:0:41585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788269968.405721:0:41585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2400:x1875136253095552:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788269968.407389:0:41585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2400:x1875136253095552:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 1662us (1881us total) trans 25769803783 rc 0/0 00000100:00100000:1.0:1788269968.407401:0:41585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00002000:00100000:1.0:1788269968.407413:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa2:0x0] (0->1023) req@ffff98c26b602680 x1875136253095552/t25769803783(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 1512/448 e 0 to 0 dl 1788269979 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269968.407433:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b602680 with x1875136253095552 ext(0->1023) 00002000:00010000:1.0:1788269968.407439:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26b602680 00000100:00100000:0.0:1788269968.415245:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.415372:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253095680 00000100:00100000:3.0:1788269968.415382:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253095680 00000100:00100000:3.0:1788269968.415446:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:3.0:1788269968.415456:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:31170:x1875136253095680:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788269968.422211:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803807 is committed 00000004:00080000:0.0:1788269968.422388:0:40807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:0.0:1788269968.422437:0:40807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000020:00080000:0.0:1788269968.422459:0:40807:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c242b4f0c0 refcount 2 committed 0 result 0 batchid 21474836516 00000020:00080000:0.0:1788269968.422464:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14340fe00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c242b4fe40 00000020:00080000:0.0:1788269968.422468:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14340fa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14297ac00 00000001:00080000:0.0:1788269968.422489:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803783 is committed 00000020:00080000:0.0:1788269968.422494:0:40807:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c2759f5780 refcount 2 committed 0 result 0 batchid 21474836515 00000020:00080000:0.0:1788269968.422497:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c144963300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c2759f5300 00000020:00080000:0.0:1788269968.422501:0:40807:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200002b13:0x1:0x0].1 00000020:00080000:0.0:1788269968.422503:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c144963400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1410b3c00 00000020:00080000:0.0:1788269968.422506:0:40807:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240002b11:0x1:0x0].1 00000020:00080000:1.0:1788269968.422644:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21474836516 committed batchid 17179869188 00000020:00080000:1.0:1788269968.422714:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869188 00000100:00100000:1.0:1788269968.422723:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269968.422742:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262569984:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1788269968.422804:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269968.423034:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.423067:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 2/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.423075:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.423082:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269968.423086:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.423094:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 4/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.423108:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c2596be500) 00010000:00010000:3.0:1788269968.423111:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269968.423116:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 2/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.423122:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e07e6f lrc: 0/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.423155:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262569984 00000100:00100000:3.0:1788269968.423164:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262569984 00000100:00100000:1.0:1788269968.423346:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269968.423356:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262570112:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1788269968.423384:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269968.423408:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262570112 00000100:00100000:1.0:1788269968.423413:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262570112 00000100:00100000:1.0:1788269968.423450:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269968.423459:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262570112:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1788269968.423549:0:41579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1788269968.423553:0:41579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788269968 00002000:00010000:1.0:1788269968.423555:0:41579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788269968.423557:0:41579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb ctime from disk: 1788269968 -> 1788269968 00002000:00010000:1.0:1788269968.423559:0:41579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788269968.423595:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262570112:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (209us total) trans 25769803784 rc 0/0 00000100:00100000:1.0:1788269968.423602:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:1.0:1788269968.423640:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27d7f3480/2, rc 0, transno 25769803784 00000100:00100000:1.0:1788269968.423645:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262570112:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1788269968.423747:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:31170:x1875136253095680:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 8292us (8510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.423755:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00080000:0.0:1788269968.425330:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269968.425429:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269968.425441:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262569984:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1788269968.425465:0:42623:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:162 count 1 00002000:00010000:3.0:1788269968.425490:0:42623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 1024, mtime: 0x6a96d58e, atime: 0x0, ctime: 0x6a96d58e, blocks: 0x8 00010000:00010000:3.0:1788269968.425498:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425514:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1788269968.425519:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269968.425525:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425541:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425551:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425559:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425577:0:42623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269968.425759:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3607:x1875136262569984:12345-0@lo:6:osp-syn-0-1.0 Request processed in 320us (2954us total) trans 25769803790 rc 0/0 00000100:00100000:3.0:1788269968.425769:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1788269968.425789:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269968.425795:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425804:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269968.425808:0:40064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425817:0:40064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425834:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425841:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f1752cf/0xc5f5d7a016e0807c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.425857:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269968.425859:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269968.425860:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788269968.429059:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c265e72d80/2, rc 0, transno 25769803790 00000100:00100000:3.0:1788269968.429073:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262569984:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1788269968.430597:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430622:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 2/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430629:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430635:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.430640:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430647:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 4/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430664:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269968.430668:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269968.430672:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 2/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430683:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e07e14 lrc: 0/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430704:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430711:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 2/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430717:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430721:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.430724:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430730:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 4/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430738:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:2.0:1788269968.430741:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269968.430744:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 2/0,0 mode: --/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.430749:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef800/0xc5f5d7a016e08052 lrc: 0/0,0 mode: --/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.431971:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.432364:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253095808 00000100:00100000:2.0:1788269968.432373:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253095808 00000100:00100000:2.0:1788269968.432465:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:2.0:1788269968.432474:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+9:2401:x1875136253095808:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788269968.434160:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803784 is committed 00000001:00080000:1.0:1788269968.434171:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803783 is committed 00000100:00100000:2.0:1788269968.434326:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253095808:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1850us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.434336:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788269968.445868:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.446012:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253096064 00000100:00100000:2.0:1788269968.446021:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253096064 00000100:00100000:2.0:1788269968.446105:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:2.0:1788269968.446115:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31170:x1875136253096064:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269968.446168:0:42351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269968.446192:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08067 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016d0 expref: 11 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.446212:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:2.0:1788269968.446228:0:42351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269968.446256:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.446269:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.446279:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269968.446394:0:42351:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094b52c1a reply state 00000000430506aa transno 25769803808 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.446406:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.446412:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:2.0:1788269968.446416:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788269968.446418:0:42351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269968.446512:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31170:x1875136253096064:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 397us (652us total) trans 25769803808 rc 0/0 00000100:00100000:2.0:1788269968.446519:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:0.0:1788269968.449231:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.449352:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253096192 00000100:00100000:1.0:1788269968.449361:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253096192 00000100:00100000:1.0:1788269968.449415:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788269968.449426:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2401:x1875136253096192:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788269968.449567:0:42634:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:1.0:1788269968.449571:0:42634:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb mtime from disk: 1788269968 -> 1788269966 00002000:00010000:1.0:1788269968.449574:0:42634:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1788269967 00002000:00010000:1.0:1788269968.449577:0:42634:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb ctime from disk: 1788269968 -> 1788269967 00002000:00010000:1.0:1788269968.449579:0:42634:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xa2:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788269968.449635:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253096192:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 210us (421us total) trans 25769803785 rc 0/0 00000100:00100000:1.0:1788269968.449643:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788269968.455575:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.455664:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253096448 00000100:00100000:0.0:1788269968.455674:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253096448 00000100:00100000:0.0:1788269968.455735:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788269968.455746:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31170:x1875136253096448:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788269968.455811:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.455840:0:40074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 12 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.455851:0:40074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 4/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.455914:0:40074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 12 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.455929:0:40074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 12 pid: 40075 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.455942:0:40074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:40074:1875136262570240:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788269968.456022:0:40074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269968.459645:0:40074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:40074:1875136262570240:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788269968.459674:0:40074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.461305:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.466129:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253096576 00000100:00100000:2.0:1788269968.466144:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253096576 00010000:00010000:2.0:1788269968.466191:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 13 pid: 40075 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.466248:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788269968.466259:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2403:x1875136253096576:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269968.466275:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269968.466282:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 13 pid: 40075 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.466296:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 13 pid: 40075 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.466318:0:43117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0804b lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c2 expref: 13 pid: 40075 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.466335:0:43117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:2.0:1788269968.466340:0:43117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.466349:0:43117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.466361:0:43117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 4/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.466383:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269968.466462:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2403:x1875136253096576:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 204us (5163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.466470:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00010000:00010000:0.0:1788269968.467750:0:40074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467765:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467803:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467811:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 2/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467818:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467824:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269968.467828:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 3/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467836:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 4/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467850:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788269968.467853:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788269968.467856:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 2/0,0 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.467862:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0808a lrc: 0/0,0 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.467958:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31170:x1875136253096448:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 12211us (12391us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788269968.467966:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788269968.469818:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.470073:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253096704 00000100:00100000:0.0:1788269968.470082:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253096704 00000100:00100000:0.0:1788269968.470126:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:0.0:1788269968.470135:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2403:x1875136253096704:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788269968.470174:0:41578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.470193:0:41578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.470202:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269968.470206:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269968.470211:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.470254:0:41578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.470269:0:41578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 7 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.470286:0:41578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:41578:1875136262570368:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788269968.470362:0:41578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269968.472528:0:41578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:41578:1875136262570368:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788269968.472556:0:41578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.478331:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.479081:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253096832 00000100:00100000:0.0:1788269968.479094:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253096832 00010000:00010000:0.0:1788269968.479134:0:40060:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.479224:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788269968.479234:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2401:x1875136253096832:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269968.479250:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269968.479270:0:40060:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.479285:0:40060:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.479306:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059344293/0xc5f5d7a016e08075 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016de expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.479322:0:40060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269968.479326:0:40060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269968.479332:0:40060:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.479347:0:40060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.479373:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269968.479513:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253096832:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 278us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.479521:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00010000:00010000:1.0:1788269968.479692:0:41578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479702:0:41578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479720:0:41578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479729:0:41578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479736:0:41578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479742:0:41578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269968.479748:0:41578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479757:0:41578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479769:0:41578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.479776:0:41578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a0cacb/0xc5f5d7a016e08091 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.479820:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2403:x1875136253096704:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 9685us (10009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.479828:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:2.0:1788269968.486723:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.486793:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097088 00000100:00100000:1.0:1788269968.486804:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097088 00000100:00100000:1.0:1788269968.486857:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788269968.486866:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31170:x1875136253097088:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788269968.486953:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 3/0,1 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.486970:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.486982:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.487200:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: --/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.487211:0:41798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.487220:0:41798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 4/0,1 mode: --/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.487263:0:41798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 12 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.487277:0:41798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 12 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.487291:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:41798:1875136262570496:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269968.487365:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2486619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269968.489480:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.489510:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097216 00000100:00100000:3.0:1788269968.489518:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097216 00010000:00010000:3.0:1788269968.489551:0:43117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 5/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 13 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.489584:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788269968.489592:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2401:x1875136253097216:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269968.489604:0:43117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269968.489611:0:43117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 5/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 13 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.489624:0:43117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 13 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.489647:0:43117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:3.0:1788269968.489652:0:43117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: --/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.489661:0:43117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.489668:0:43117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 4/0,1 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.489685:0:43117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269968.489724:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2401:x1875136253097216:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269968.489732:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00010000:00010000:1.0:1788269968.490723:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08059 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016c9 expref: 12 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.490742:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:41798:1875136262570496:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269968.490763:0:41798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.490772:0:41798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.490778:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269968.490869:0:41798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803809 00000001:00080000:1.0:1788269968.490982:0:41798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803810 00000100:00100000:1.0:1788269968.491078:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262570624:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788269968.491123:0:41798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269968.491147:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dd90780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269968.491168:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262570624 00000100:00100000:1.0:1788269968.491173:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262570624 00000100:00100000:1.0:1788269968.491204:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788269968.491211:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:41798:x1875136262570624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788269968.491534:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:41798:x1875136262570624:12345-0@lo:1000:mdt00_003.0 Request processed in 323us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.491542:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788269968.494357:0:41798:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803784 gen 2 00000004:00080000:3.0:1788269968.494368:0:41798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27d7f3480, transno 25769803784 00000100:00100000:3.0:1788269968.494514:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262570624:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788269968.494669:0:41798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803811 00000100:00100000:3.0:1788269968.494739:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262570752:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788269968.494793:0:41798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269968.494823:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269968.495995:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262570752 00000100:00100000:0.0:1788269968.496004:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262570752 00000100:00100000:0.0:1788269968.496089:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269968.496099:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:41798:x1875136262570752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788269968.496245:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:41798:x1875136262570752:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (1451us total) trans 25769803786 rc 0/0 00000100:00100000:0.0:1788269968.496253:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788269968.496514:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:41798:1875136262570752:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788269968.496565:0:41798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803812 00000001:00080000:3.0:1788269968.496625:0:41798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803813 00010000:00010000:3.0:1788269968.496647:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496658:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 2/0,0 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496665:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,0 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496672:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269968.496676:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 3/0,0 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496684:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 4/0,0 mode: EX/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496700:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:3.0:1788269968.496703:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269968.496708:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 2/0,0 mode: --/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496715:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0809f lrc: 0/0,0 mode: --/EX res: [0x240002b10:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496752:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496759:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 2/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496765:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496771:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269968.496773:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496779:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 4/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496787:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788269968.496789:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269968.496795:0:41798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 16 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496806:0:41798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 2/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 16 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496815:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 16 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.496845:0:41798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 16 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.496864:0:41798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:41798:1875136262570880:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788269968.497663:0:41798:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2812163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269968.516488:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.516520:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097344 00000100:00100000:2.0:1788269968.516529:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097344 00000100:00100000:2.0:1788269968.516573:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788269968.516584:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+17:31168:x1875136253097344:12345-192.168.201.42@tcp:49:lfs.0 00000100:00100000:2.0:1788269968.516695:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+17:31168:x1875136253097344:12345-192.168.201.42@tcp:49:lfs.0 Request processed in 113us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.516702:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788269968.517250:0:41798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:41798:1875136262570880:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788269968.517275:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 2/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517285:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e07fb8 lrc: 0/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517318:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517332:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517344:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517354:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517361:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 2/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517368:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517374:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269968.517378:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517385:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 4/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517396:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788269968.517399:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269968.517402:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 2/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517408:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e080a6 lrc: 0/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517417:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517423:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 2/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517429:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517434:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269968.517437:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517443:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 4/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517451:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788269968.517453:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269968.517456:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 2/0,0 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.517466:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08098 lrc: 0/0,0 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.517585:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+16:31170:x1875136253097088:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 30719us (30871us total) trans 25769803814 rc 0/0 00000100:00100000:3.0:1788269968.517593:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000020:00080000:3.0:1788269968.517597:0:41798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1788269968.518257:0:40828:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269968.518263:0:40828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269968.518278:0:40828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 2 count 2 00000040:00080000:2.0:1788269968.518283:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788269968.520380:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.521024:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097600 00000100:00100000:3.0:1788269968.521034:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097600 00000100:00100000:2.0:1788269968.521204:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788269968.521270:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+16:31170:x1875136253097600:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788269968.521631:0:40078:0:(mdd_object.c:4014:mdd_close()) Object [0x240002b10:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788269968.521660:0:40078:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803815 00010000:00010000:2.0:1788269968.521692:0:40078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.521708:0:40078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.521719:0:40078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.521727:0:40078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 4/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.521734:0:40078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 4/0,1 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.521741:0:40078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 3/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.521811:0:40078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788269968.521900:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:31170:x1875136253097600:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 686us (1527us total) trans 25769803816 rc 0/0 00000100:00100000:2.0:1788269968.521908:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000020:00080000:2.0:1788269968.521911:0:40078:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788269968.523529:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.523624:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097728 00000100:00100000:1.0:1788269968.523632:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097728 00000100:00100000:1.0:1788269968.523688:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:1.0:1788269968.523698:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:31168:x1875136253097728:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269968.523712:0:41580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.523729:0:41580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016e5 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269968.523756:0:41580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa2:0x0] initial LVB size: 1024, mtime: 0x6a96d58e, atime: 0x6a96d58f, ctime: 0x6a96d58f, blocks: 0x8 00010000:00010000:1.0:1788269968.523776:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=760s v=(0 0) 00010000:00010000:1.0:1788269968.523780:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269968.523789:0:41580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.523809:0:41580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.523822:0:41580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192200, rc 0) 00000100:00100000:1.0:1788269968.523864:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:31168:x1875136253097728:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 168us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.523870:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00010000:00010000:0.0:1788269968.524001:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269968.524008:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 2/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.524015:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788269968.524019:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 2/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.524028:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 3/0,0 mode: PW/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.524063:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788269968.524067:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788269968.524072:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 1/0,0 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.524079:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e080ad lrc: 0/0,0 mode: --/PW res: [0x240002b10:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 40078 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.524410:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269968.524413:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269968.524415:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269968.527013:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.527401:0:41584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097856 00000100:00100000:0.0:1788269968.527412:0:41584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097856 00002000:00100000:0.0:1788269968.527508:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xa2:0x0] (0->4095) req@ffff98c26b600e00 x1875136253097856/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 488/0 e 0 to 0 dl 1788269979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269968.527519:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b600e00 with x1875136253097856 ext(0->4095) 00002000:00010000:0.0:1788269968.527525:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26b600e00 00000100:00100000:0.0:1788269968.527581:0:41584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788269968.527592:0:41584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253097856:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788269968.527744:0:41584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2401:x1875136253097856:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 154us (739us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788269968.527752:0:41584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00002000:00100000:0.0:1788269968.527759:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xa2:0x0] (0->4095) req@ffff98c26b600e00 x1875136253097856/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 488/4536 e 0 to 0 dl 1788269979 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269968.527767:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b600e00 with x1875136253097856 ext(0->4095) 00002000:00010000:0.0:1788269968.527770:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26b600e00 00000100:00100000:2.0:1788269968.531035:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.531388:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253097984 00000100:00100000:3.0:1788269968.531397:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253097984 00000100:00100000:3.0:1788269968.531585:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788269968.531596:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+7:2402:x1875136253097984:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:3.0:1788269968.531635:0:42623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.531653:0:42623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.531661:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269968.531666:0:42623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269968.531671:0:42623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.531703:0:42623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 7 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.531724:0:42623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 7 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.531739:0:42623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:42623:1875136262571008:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788269968.531814:0:42623:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216840 going to sleep for 11 seconds 00000100:00100000:2.0:1788269968.534719:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.534808:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253098112 00000100:00100000:0.0:1788269968.534817:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253098112 00010000:00010000:0.0:1788269968.534854:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.534902:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788269968.534913:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2400:x1875136253098112:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269968.534927:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269968.534946:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.534959:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 8 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.534982:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269968.534987:0:40061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269968.534994:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.535005:0:40061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.535024:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269968.535090:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2400:x1875136253098112:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 179us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.535097:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00010000:00010000:3.0:1788269968.535180:0:42623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e080b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016e5 expref: 7 pid: 41580 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.535195:0:42623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:42623:1875136262571008:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788269968.535212:0:42623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535234:0:42623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535242:0:42623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535260:0:42623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535268:0:42623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535282:0:42623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535290:0:42623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788269968.535294:0:42623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535303:0:42623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535316:0:42623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.535323:0:42623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f1752cf/0xc5f5d7a016e080bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 42623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269968.535364:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253097984:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 3771us (4340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269968.535373:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:2.0:1788269968.537524:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.537616:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253098368 00000100:00100000:3.0:1788269968.537623:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253098368 00000100:00100000:2.0:1788269968.537764:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788269968.537774:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+18:31168:x1875136253098368:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:2.0:1788269968.537833:0:40077:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x240002b12:0x1:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07faa lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101698 expref: 18 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269968.538002:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803817 00000001:00080000:2.0:1788269968.538605:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803818 00010000:00010000:2.0:1788269968.538640:0:40077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.538653:0:40077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 2/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 21 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.538662:0:40077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 4/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.538693:0:40077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 21 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.538707:0:40077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 4/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 21 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.538720:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:40077:1875136262571136:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269968.538833:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269968.541984:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.542084:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:40077:1875136262571136:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269968.542114:0:40077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.542289:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253098496 00000100:00100000:0.0:1788269968.542297:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253098496 00010000:00010000:0.0:1788269968.542329:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 4/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 22 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.542361:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788269968.542370:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+22:2400:x1875136253098496:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269968.542386:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269968.542393:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 4/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 22 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.542405:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 22 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.542443:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5cc00/0xc5f5d7a016e07fbf lrc: 0/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610169f expref: 22 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.542458:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788269968.542463:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.542472:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.542479:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 4/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.542505:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269968.542544:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+21:2400:x1875136253098496:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 175us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.542561:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00010000:00010000:2.0:1788269968.542651:0:40077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.542659:0:40077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269968.542749:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803819 00000001:00080000:2.0:1788269968.542847:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803820 00000001:00080000:2.0:1788269968.542896:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803821 00000100:00100000:2.0:1788269968.542965:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262571264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269968.543004:0:40077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269968.543034:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1435cd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269968.543926:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262571264 00000100:00100000:0.0:1788269968.543933:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262571264 00000100:00100000:0.0:1788269968.543979:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788269968.543988:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:40077:x1875136262571264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788269968.544081:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:40077:x1875136262571264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.544089:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788269968.544539:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262571264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788269968.544656:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803822 00000100:00100000:2.0:1788269968.544721:0:40077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262571392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269968.544752:0:40077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269968.544778:0:40077:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269968.545020:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262571392 00000100:00100000:3.0:1788269968.545025:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262571392 00000100:00100000:3.0:1788269968.545085:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788269968.545094:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:40077:x1875136262571392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788269968.545199:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:40077:x1875136262571392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (446us total) trans 25769803787 rc 0/0 00000100:00100000:3.0:1788269968.545206:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788269968.546104:0:40077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:40077:1875136262571392:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1788269968.546136:0:40077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.546146:0:40077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 2/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.546154:0:40077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.546160:0:40077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269968.546164:0:40077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.546172:0:40077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 4/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.546193:0:40077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269968.546195:0:40077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788269968.546201:0:40077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 2/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.546207:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080c2 lrc: 0/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269968.546457:0:40077:0:(mdd_object.c:4014:mdd_close()) Object [0x240002b10:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788269968.546521:0:40077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].3, 64 off8408 00000001:00080000:2.0:1788269968.546531:0:40077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803823 00010000:00010000:2.0:1788269968.546560:0:40077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788269968.546563:0:40077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788269968.546570:0:40077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0400/0xc5f5d7a016e07faa lrc: 0/0,0 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101698 expref: 25 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.546670:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+24:31168:x1875136253098368:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 8896us (9151us total) trans 25769803824 rc 0/0 00000100:00100000:2.0:1788269968.546678:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000020:00080000:2.0:1788269968.546683:0:40077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1788269968.549715:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.549788:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253098624 00000100:00100000:0.0:1788269968.549798:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253098624 00000100:00100000:0.0:1788269968.549870:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788269968.549892:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+24:31168:x1875136253098624:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269968.549915:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.549935:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e080c9 lrc: 2/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016ec expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.549989:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e080c9 lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016ec expref: 25 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.550004:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e080c9 lrc: 3/0,0 mode: CR/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016ec expref: 25 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.550021:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:0.0:1788269968.550025:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269968.550028:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:0.0:1788269968.550112:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:31168:x1875136253098624:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 222us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.550119:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:3.0:1788269968.556471:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.556549:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253098880 00000100:00100000:0.0:1788269968.556558:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253098880 00000100:00100000:0.0:1788269968.556612:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788269968.556623:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+25:31168:x1875136253098880:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788269968.556839:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:31168:x1875136253098880:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 217us (378us total) trans 25769803825 rc 0/0 00000100:00100000:0.0:1788269968.556848:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:3.0:1788269968.627034:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.627364:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253099136 00000100:00100000:0.0:1788269968.627374:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253099136 00000100:00100000:0.0:1788269968.627443:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:0.0:1788269968.627454:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+26:31180:x1875136253099136:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269968.627477:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.627500:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e080d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016f3 expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269968.627592:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788269968.627682:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e080d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016f3 expref: 28 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.627697:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c142858300) 00010000:00010000:0.0:1788269968.627700:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269968.627705:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1600/0xc5f5d7a016e080d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016f3 expref: 28 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.627721:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1600, rc 0) 00000100:00100000:0.0:1788269968.627777:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31180:x1875136253099136:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 325us (753us total) trans 25769803826 rc 301/301 00000100:00100000:0.0:1788269968.627785:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788269968.630507:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.630581:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253099264 00000100:00100000:0.0:1788269968.630590:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253099264 00000100:00100000:0.0:1788269968.630644:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:0.0:1788269968.630653:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31180:x1875136253099264:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788269968.630719:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630734:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630744:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630760:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630767:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630773:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630841:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630850:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630857:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269968.630914:0:41798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630927:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630938:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630945:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630951:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269968.630955:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630962:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630973:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:0.0:1788269968.630977:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269968.630981:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630987:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e080de lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.630999:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631005:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631011:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631016:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269968.631020:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631026:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631032:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:0.0:1788269968.631034:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269968.631067:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631074:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0200/0xc5f5d7a016e080e5 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631088:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631094:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631099:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631104:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269968.631107:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631113:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631121:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:0.0:1788269968.631123:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269968.631126:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 2/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.631132:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e080ec lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.631196:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31180:x1875136253099264:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 544us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.631204:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788269968.633588:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.633658:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253099520 00000100:00100000:0.0:1788269968.633667:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253099520 00000100:00100000:0.0:1788269968.633715:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788269968.633724:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+27:31180:x1875136253099520:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788269968.633921:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+28:31180:x1875136253099520:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 197us (341us total) trans 25769803827 rc 0/0 00000100:00100000:0.0:1788269968.633928:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788269968.701191:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.701305:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253099648 00000100:00100000:2.0:1788269968.701315:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253099648 00000100:00100000:2.0:1788269968.701372:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:2.0:1788269968.701383:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+28:31186:x1875136253099648:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269968.701406:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269968.701437:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561016fa expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.701503:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e080fa lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.701516:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e080fa lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.701528:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e080fa lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269968.701568:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788269968.701571:0:40075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269968.701587:0:40075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e080fa lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.701612:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e080f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016fa expref: 30 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.701633:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e080fa lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016fa expref: 29 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.701643:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269968.701646:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269968.701649:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030c00, rc 0) 00000100:00100000:2.0:1788269968.701707:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31186:x1875136253099648:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 326us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269968.701714:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:3.0:1788269968.705297:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.705390:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253099776 00000100:00100000:1.0:1788269968.705399:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253099776 00000100:00100000:1.0:1788269968.705463:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:1.0:1788269968.705472:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+29:31186:x1875136253099776:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269968.705488:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.705506:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192400/0xc5f5d7a016e08101 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101701 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705558:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705569:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705579:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705594:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705600:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705605:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705668:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705676:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705682:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269968.705715:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00000004:00200000:1.0:1788269968.705720:0:42351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269968.705735:0:42351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705746:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705752:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705758:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705768:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705774:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.705778:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705785:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705796:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269968.705799:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.705803:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705809:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08108 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705821:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705826:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705832:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705837:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.705840:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705849:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705854:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c143876c00) 00010000:00010000:1.0:1788269968.705856:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.705858:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705863:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e0810f lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705904:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192400/0xc5f5d7a016e08101 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 31 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705915:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 30 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.705922:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:1.0:1788269968.705924:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269968.705926:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192200, rc 0) 00000100:00100000:1.0:1788269968.706164:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31186:x1875136253099776:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 692us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.706171:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788269968.715758:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.715831:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253100032 00000100:00100000:2.0:1788269968.715840:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253100032 00000100:00100000:2.0:1788269968.715911:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788269968.715921:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+30:31186:x1875136253100032:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269968.715941:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269968.715959:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e0811d lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101708 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.716107:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,1 mode: --/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.716124:0:40076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 31 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.716133:0:40076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 4/0,1 mode: --/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.716166:0:40076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 31 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269968.716180:0:40076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 31 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.716193:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:40076:1875136262571520:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269968.716280:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2751de600 going to sleep for 11 seconds 00000100:00100000:3.0:1788269968.720181:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.720307:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:40076:1875136262571520:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269968.720330:0:40076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,1 mode: --/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.720436:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253100160 00000100:00100000:0.0:1788269968.720445:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253100160 00010000:00010000:0.0:1788269968.720478:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 32 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.720515:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788269968.720524:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:2401:x1875136253100160:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269968.720537:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269968.720544:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 32 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.720557:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 32 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.720579:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e08116 lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101701 expref: 32 pid: 42351 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.720595:0:40061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:0.0:1788269968.720600:0:40061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,1 mode: --/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.720609:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,1 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.720616:0:40061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 4/0,1 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.720644:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269968.720687:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:2401:x1875136253100160:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 163us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.720695:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00010000:00010000:1.0:1788269968.720824:0:40076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,1 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.720832:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,1 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269968.720853:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00010000:00010000:1.0:1788269968.720977:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e0811d lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 32 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.720993:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 31 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.721001:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:1.0:1788269968.721003:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269968.721006:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030800, rc 0) 00000100:00100000:1.0:1788269968.721062:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31186:x1875136253100032:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 5142us (5313us total) trans 25769803828 rc 0/0 00000100:00100000:1.0:1788269968.721070:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:3.0:1788269968.827837:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.827943:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253100416 00000100:00100000:0.0:1788269968.827953:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253100416 00000100:00100000:0.0:1788269968.828008:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:0.0:1788269968.828018:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+31:31196:x1875136253100416:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269968.828068:0:40074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.828092:0:40074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610170f expref: -99 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269968.828190:0:40074:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788269968.828280:0:40074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08132 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610170f expref: 33 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.828294:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c142858b00) 00010000:00010000:0.0:1788269968.828297:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269968.828301:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610170f expref: 33 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.828317:0:40074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1200, rc 0) 00000100:00100000:0.0:1788269968.828377:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31196:x1875136253100416:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 359us (549us total) trans 25769803829 rc 301/301 00000100:00100000:0.0:1788269968.828383:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:0.0:1788269968.830566:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.830659:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253100544 00000100:00100000:1.0:1788269968.830667:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253100544 00000100:00100000:1.0:1788269968.830718:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788269968.830727:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31196:x1875136253100544:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788269968.830788:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830804:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830814:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830828:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830836:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830842:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830919:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830929:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830936:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269968.830978:0:42351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830988:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.830995:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831001:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831007:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.831011:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831017:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831029:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269968.831032:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.831036:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831083:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08140 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831095:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831101:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831106:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831111:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.831114:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831120:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831128:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c143876c00) 00010000:00010000:1.0:1788269968.831130:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.831133:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831138:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e08147 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831155:0:42351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831161:0:42351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 2/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831166:0:42351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831171:0:42351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.831173:0:42351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831178:0:42351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 4/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831184:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:1.0:1788269968.831187:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.831189:0:42351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 2/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.831194:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e0814e lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.831257:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31196:x1875136253100544:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 531us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.831264:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788269968.833830:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.833905:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253100800 00000100:00100000:0.0:1788269968.833914:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253100800 00000100:00100000:0.0:1788269968.833967:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788269968.833977:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+32:31196:x1875136253100800:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788269968.834394:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31196:x1875136253100800:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 417us (571us total) trans 25769803830 rc 0/0 00000100:00100000:0.0:1788269968.834402:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788269968.865472:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.865571:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253100928 00000100:00100000:1.0:1788269968.865584:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253100928 00000100:00100000:1.0:1788269968.865644:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788269968.865655:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31197:x1875136253100928:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788269968.865679:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.865700:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08155 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101716 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865762:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865776:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865787:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865800:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865807:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865814:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865891:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865902:0:40076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 2/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 34 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865910:0:40076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 4/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865943:0:40076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 34 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.865957:0:40076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 4/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 34 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269968.865971:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:40076:1875136262571648:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788269968.866091:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248919480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269968.883721:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.883843:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:40076:1875136262571648:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788269968.883898:0:40076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269968.884145:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253101184 00000100:00100000:2.0:1788269968.884153:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253101184 00000100:00100000:2.0:1788269968.884208:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788269968.884225:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+35:30469:x1875136253101184:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788269968.884524:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:30469:x1875136253101184:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 299us (811us total) trans 25769803831 rc 0/0 00000100:00100000:2.0:1788269968.884532:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:3.0:1788269968.886684:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.886759:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253101312 00000100:00100000:0.0:1788269968.886769:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253101312 00010000:00010000:0.0:1788269968.886804:0:40062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 4/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 36 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269968.886848:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788269968.886858:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:2400:x1875136253101312:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269968.886885:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269968.886891:0:40062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 4/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 36 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.886905:0:40062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 3/0,0 mode: CW/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 36 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.886927:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e08124 lrc: 0/0,0 mode: --/CW res: [0x240002b12:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101708 expref: 36 pid: 40076 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.886944:0:40062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:0.0:1788269968.886948:0:40062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.886958:0:40062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.886965:0:40062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 4/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.886989:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269968.887129:0:40076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887137:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269968.887180:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b12:0x1:0x0]: returning size 1024 00000004:00200000:1.0:1788269968.887185:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269968.887238:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887250:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/1,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887260:0:40076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 4/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887270:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 4/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887276:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887283:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887289:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.887293:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887301:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 5/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887310:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269968.887313:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.887317:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 3/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887322:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192800/0xc5f5d7a016e0815c lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887332:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887338:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887343:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887348:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.887350:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887356:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887363:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c143876c00) 00010000:00010000:1.0:1788269968.887365:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269968.887368:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887374:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192c00/0xc5f5d7a016e08163 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887409:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193000/0xc5f5d7a016e08155 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101716 expref: 36 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887438:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 3/0,0 mode: PR/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101716 expref: 35 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.887446:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:1.0:1788269968.887448:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269968.887451:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193200, rc 0) 00000100:00100000:0.0:1788269968.887649:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+35:2400:x1875136253101312:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 791us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269968.887657:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:1.0:1788269968.887926:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+34:31197:x1875136253100928:12345-192.168.201.42@tcp:101:rm.0 Request processed in 22272us (22464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.887933:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:3.0:1788269968.891020:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.891199:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253101568 00000100:00100000:0.0:1788269968.891208:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253101568 00000100:00100000:0.0:1788269968.891353:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788269968.891363:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+34:31197:x1875136253101568:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:0.0:1788269968.891614:0:41798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788269968.891641:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193200/0xc5f5d7a016e0816a lrc: 0/0,0 mode: --/PR res: [0x240002b12:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101716 expref: 34 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891664:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e080c9 lrc: 0/0,0 mode: --/CR res: [0x240002b12:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016ec expref: 33 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891675:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858800) 00010000:00010000:0.0:1788269968.891690:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e080fa lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016fa expref: 32 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891700:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:0.0:1788269968.891704:0:41798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269968.891724:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891736:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891747:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891760:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891767:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891773:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891844:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 3/0,1 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891853:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.891860:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892396:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 3/0,1 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892406:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892414:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 3/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892434:0:41798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 4/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892440:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 4/0,1 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892447:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892469:0:41798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269968.892489:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 3/0,1 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892496:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 2/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892503:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892508:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269968.892511:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 3/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892519:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 4/0,0 mode: EX/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892527:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858300) 00010000:00010000:0.0:1788269968.892530:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788269968.892533:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 2/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892539:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e0817f lrc: 0/0,0 mode: --/EX res: [0x240002b12:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892553:0:41798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892559:0:41798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 2/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892566:0:41798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892571:0:41798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269968.892574:0:41798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892584:0:41798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 4/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892591:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:0.0:1788269968.892593:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269968.892596:0:41798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892601:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1200/0xc5f5d7a016e08171 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269968.892610:0:41798:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067ef6c35 reply state 00000000e6614b17 transno 25769803832 ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892620:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.892627:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:0.0:1788269968.892629:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788269968.892631:0:41798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269968.892814:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:31197:x1875136253101568:12345-192.168.201.42@tcp:36:rm.0 Request processed in 1451us (1801us total) trans 25769803832 rc 0/0 00000100:00100000:0.0:1788269968.892822:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00010000:00010000:1.0:1788269968.892937:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269968.892944:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 2/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.892949:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269968.892952:0:40063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 2/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.892958:0:40063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 3/0,0 mode: PW/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.892967:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b12:0x1:0x0].0x0 (ffff98c142858300) 00010000:00010000:1.0:1788269968.892969:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788269968.892972:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 1/0,0 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.892978:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1800/0xc5f5d7a016e08186 lrc: 0/0,0 mode: --/PW res: [0x240002b12:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.892990:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269968.892992:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269968.892994:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269968.900534:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.900653:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253101824 00000100:00100000:3.0:1788269968.900673:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253101824 00000100:00100000:3.0:1788269968.900764:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:3.0:1788269968.900775:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+33:30944:x1875136253101824:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788269968.900798:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269968.900815:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e0818d lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610171d expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.900935:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.900950:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.900962:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.900972:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,1 mode: --/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.900978:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.900985:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269968.901326:0:40075:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa3:0x0], index 0: 0 00010000:00010000:3.0:1788269968.901674:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef000/0xc5f5d7a016e081a2 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901684:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef000/0xc5f5d7a016e081a2 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901693:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef000/0xc5f5d7a016e081a2 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901724:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901731:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 2/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901737:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901743:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788269968.901748:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901754:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 4/0,0 mode: CW/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901766:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:3.0:1788269968.901770:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269968.901774:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 2/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901780:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e08194 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269968.901793:0:40075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a784b13 reply state 00000000652f3d47 transno 25769803833 ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,1 mode: PW/PW res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901804:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901810:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:3.0:1788269968.901813:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788269968.901816:0:40075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788269968.901840:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e0818d lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610171d expref: 36 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901853:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef000/0xc5f5d7a016e081a2 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610171d expref: 35 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269968.901860:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c1429f7a00) 00010000:00010000:3.0:1788269968.901863:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269968.901866:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ef000, rc 0) 00000100:00100000:3.0:1788269968.902300:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:30944:x1875136253101824:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1524us (1772us total) trans 25769803833 rc 0/0 00000100:00100000:3.0:1788269968.902309:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:3.0:1788269968.905170:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.905350:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253101952 00000100:00100000:1.0:1788269968.905361:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253101952 00000100:00100000:1.0:1788269968.905435:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788269968.905446:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:30944:x1875136253101952:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788269968.905462:0:41578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.905482:0:41578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e1bc8fc/0xc5f5d7a016e081b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101724 expref: -99 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269968.905505:0:41578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788269968.905524:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=760s v=(0 0) 00010000:00010000:1.0:1788269968.905529:0:41578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269968.905538:0:41578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e1bc8fc/0xc5f5d7a016e081b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101724 expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.905554:0:41578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e1bc8fc/0xc5f5d7a016e081b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101724 expref: 6 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.905566:0:41578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192c00, rc 0) 00000100:00100000:1.0:1788269968.905622:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:30944:x1875136253101952:12345-192.168.201.42@tcp:101:bash.0 Request processed in 179us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.905629:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00080000:0.0:1788269968.907457:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269968.907608:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269968.907717:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253102208 00000100:00100000:2.0:1788269968.907725:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253102208 00000100:00100000:2.0:1788269968.907819:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788269968.907829:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+36:30944:x1875136253102208:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:2.0:1788269968.908151:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:30944:x1875136253102208:12345-192.168.201.42@tcp:35:bash.0 Request processed in 323us (547us total) trans 25769803834 rc 0/0 00000100:00100000:2.0:1788269968.908160:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788269968.946544:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.946645:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253102336 00000100:00100000:1.0:1788269968.946655:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253102336 00000100:00100000:1.0:1788269968.946716:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:1.0:1788269968.946726:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+37:31203:x1875136253102336:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269968.946749:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.946773:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193e00/0xc5f5d7a016e081b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610172b expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.946837:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e081be lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.946850:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e081be lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.946860:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e081be lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269968.946920:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788269968.946924:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788269968.946942:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e081be lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.946967:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193e00/0xc5f5d7a016e081b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610172b expref: 39 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.946994:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e081be lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610172b expref: 38 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.947002:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269968.947005:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269968.947009:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192a00, rc 0) 00000100:00100000:1.0:1788269968.947120:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:31203:x1875136253102336:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 395us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269968.947128:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:1.0:1788269968.953696:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269968.953795:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253102592 00000100:00100000:0.0:1788269968.953804:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253102592 00000100:00100000:0.0:1788269968.953865:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:0.0:1788269968.953889:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+38:31203:x1875136253102592:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788269968.953910:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269968.953930:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e081c5 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101732 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.954030:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e081cc lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.954082:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e081cc lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.954094:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e081cc lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269968.954107:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x5:0x0]: returning size 11 00010000:00010000:0.0:1788269968.954206:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1e00/0xc5f5d7a016e081c5 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101732 expref: 41 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.954235:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e081cc lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101732 expref: 40 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269968.954243:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c1429f7a00) 00010000:00010000:0.0:1788269968.954246:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788269968.954250:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:0.0:1788269968.954306:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+40:31203:x1875136253102592:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 420us (619us total) trans 25769803835 rc 0/0 00000100:00100000:0.0:1788269968.954313:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:0.0:1788269968.956721:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.956792:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253102848 00000100:00100000:1.0:1788269968.956801:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253102848 00000100:00100000:1.0:1788269968.956854:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788269968.956864:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+40:31203:x1875136253102848:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788269968.956897:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269968.956901:0:40075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1788269968.956923:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e081cc lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101732 expref: 40 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.956947:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef000/0xc5f5d7a016e081a2 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610171d expref: 39 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.956958:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c1429f7a00) 00010000:00010000:1.0:1788269968.956967:0:40075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269968.956980:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193e00/0xc5f5d7a016e081da lrc: 2/0,0 mode: --/EX res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101739 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957015:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957026:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957035:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957076:0:40075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957083:0:40075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957090:0:40075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957096:0:40075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269968.957101:0:40075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957113:0:40075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957121:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269968.957123:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269968.957127:0:40075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957133:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e081e1 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957155:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e081e8 lrc: 3/0,1 mode: --/EX res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957162:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e081e8 lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957169:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e081e8 lrc: 3/0,1 mode: EX/EX res: [0x240002b10:0x5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957329:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e081e8 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101739 expref: 41 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957338:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269968.957340:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788269968.957347:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193e00/0xc5f5d7a016e081da lrc: 0/0,0 mode: --/EX res: [0x240002b10:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101739 expref: 41 pid: 40075 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957360:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e081e8 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101739 expref: 40 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269968.957394:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269968.957397:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788269968.957399:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192e00, rc 0) 00000100:00100000:1.0:1788269968.957459:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+40:31203:x1875136253102848:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 596us (747us total) trans 25769803836 rc 0/0 00000100:00100000:1.0:1788269968.957466:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:2.0:1788269968.960363:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269968.960542:0:41585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253102976 00000100:00100000:1.0:1788269968.960551:0:41585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253102976 00002000:00100000:1.0:1788269968.960595:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa3:0x0] (0->10) req@ffff98c26b602a00 x1875136253102976/t0(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 504/0 e 0 to 0 dl 1788269979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269968.960607:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b602a00 with x1875136253102976 ext(0->10) 00002000:00010000:1.0:1788269968.960612:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c26b602a00 00000100:00100000:1.0:1788269968.960677:0:41585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788269968.960686:0:41585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253102976:12345-192.168.201.42@tcp:4:bash.0 00000100:00100000:1.0:1788269968.961838:0:41585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2402:x1875136253102976:12345-192.168.201.42@tcp:4:bash.0 Request processed in 1149us (1480us total) trans 25769803791 rc 0/0 00000100:00100000:1.0:1788269968.961848:0:41585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00002000:00100000:1.0:1788269968.961856:0:41585:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa3:0x0] (0->10) req@ffff98c26b602a00 x1875136253102976/t25769803791(0) o4->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 504/448 e 0 to 0 dl 1788269979 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269968.961865:0:41585:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b602a00 with x1875136253102976 ext(0->10) 00002000:00010000:1.0:1788269968.964920:0:41585:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c26b602a00 00000100:00100000:0.0:1788269968.966104:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.966202:0:41584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253103104 00000100:00100000:3.0:1788269968.966222:0:41584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253103104 00002000:00100000:3.0:1788269968.966265:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff98c25ef76300 x1875136253103104/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 488/0 e 0 to 0 dl 1788269979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788269968.966276:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef76300 with x1875136253103104 ext(0->4095) 00002000:00010000:3.0:1788269968.966280:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c25ef76300 00000100:00100000:3.0:1788269968.966340:0:41584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788269968.966351:0:41584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2401:x1875136253103104:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:3.0:1788269968.966516:0:41584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+8:2401:x1875136253103104:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 166us (416us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788269968.966523:0:41584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00002000:00100000:3.0:1788269968.966529:0:41584:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff98c25ef76300 x1875136253103104/t0(0) o3->41dd69ed-5790-4cb1-adef-18c6baaffed2@192.168.201.42@tcp:384/0 lens 488/4536 e 0 to 0 dl 1788269979 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788269968.966538:0:41584:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef76300 with x1875136253103104 ext(0->4095) 00002000:00010000:3.0:1788269968.966541:0:41584:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c25ef76300 00000100:00100000:0.0:1788269968.970571:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269968.971115:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253103360 00000100:00100000:3.0:1788269968.971124:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253103360 00000100:00100000:3.0:1788269968.971177:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269968.971187:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+40:31203:x1875136253103360:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269968.971459:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+41:31203:x1875136253103360:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 273us (898us total) trans 25769803837 rc 0/0 00000100:00100000:3.0:1788269968.971466:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000001:00080000:3.0:1788269968.972718:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803791 is committed 00000001:00080000:3.0:1788269968.972732:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803790 is committed 00000001:00080000:3.0:1788269968.972741:0:41574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803788 is committed 00000100:00100000:0.0:1788269969.058247:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269969.058339:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253103616 00000100:00100000:2.0:1788269969.058349:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253103616 00000100:00100000:2.0:1788269969.058416:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:2.0:1788269969.058426:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+41:31213:x1875136253103616:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269969.058448:0:42351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269969.058469:0:42351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e081ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101740 expref: -99 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.058560:0:42351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e081f6 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.058575:0:42351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e081f6 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.058586:0:42351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e081f6 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269969.058596:0:42351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788269969.058679:0:42351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e081ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101740 expref: 44 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.058701:0:42351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e081f6 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101740 expref: 43 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.058709:0:42351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269969.058712:0:42351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269969.058715:0:42351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031a00, rc 0) 00000100:00100000:2.0:1788269969.058771:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+43:31213:x1875136253103616:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 347us (534us total) trans 25769803838 rc 0/0 00000100:00100000:2.0:1788269969.058778:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00080000:0.0:1788269969.058863:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269969.061793:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269969.062121:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253103744 00000100:00100000:1.0:1788269969.062130:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253103744 00000100:00100000:1.0:1788269969.062181:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:1.0:1788269969.062192:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+43:31213:x1875136253103744:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788269969.062265:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062280:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062292:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062302:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062321:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062328:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062396:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062404:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062410:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269969.062452:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062464:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062471:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062479:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062486:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269969.062490:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062496:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062508:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269969.062511:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269969.062516:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062521:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08204 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062536:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062542:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062548:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062553:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269969.062556:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062562:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062569:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:1.0:1788269969.062572:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269969.062575:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062581:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0820b lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062590:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062595:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062601:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062605:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269969.062608:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062613:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062620:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269969.062622:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269969.062626:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.062631:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08212 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269969.062702:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+43:31213:x1875136253103744:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 512us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269969.062710:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00010000:00010000:0.0:1788269969.092372:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269969.092515:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788269969.092817:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262571776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788269969.092954:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269969.095059:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262571776 00000100:00100000:2.0:1788269969.095073:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262571776 00000100:00100000:2.0:1788269969.095133:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788269969.095142:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262571776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788269969.095174:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446150144 avail 1299910656 00000100:00100000:2.0:1788269969.095252:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262571776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269969.095259:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788269969.095430:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262571776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269969.130174:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269969.130370:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253103872 00000100:00100000:2.0:1788269969.130382:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253103872 00000100:00100000:2.0:1788269969.130453:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:2.0:1788269969.130464:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+43:31219:x1875136253103872:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269969.130481:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269969.130499:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08219 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101747 expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130557:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130571:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130582:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130595:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130602:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130609:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130682:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130690:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130697:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269969.130734:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x5:0x0]: returning size 11 00000004:00200000:2.0:1788269969.130739:0:40076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788269969.130757:0:40076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130768:0:40076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130776:0:40076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 4/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130782:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 4/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130788:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130793:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130799:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269969.130803:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130810:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 5/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130820:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:2.0:1788269969.130824:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269969.130829:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 3/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130839:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e08220 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130852:0:40076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.130858:0:40076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131089:0:40076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131097:0:40076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788269969.131100:0:40076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131106:0:40076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131115:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:2.0:1788269969.131118:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269969.131121:0:40076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131127:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e08227 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131151:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e08219 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 45 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131170:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 44 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.131177:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:2.0:1788269969.131180:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269969.131182:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030800, rc 0) 00000100:00100000:2.0:1788269969.131252:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+44:31219:x1875136253103872:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 789us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269969.131259:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:0.0:1788269969.134760:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269969.134841:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253104128 00000100:00100000:3.0:1788269969.134849:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253104128 00000100:00100000:3.0:1788269969.134918:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:3.0:1788269969.134927:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+44:31219:x1875136253104128:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269969.134944:0:41798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269969.134960:0:41798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08235 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610174e expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.135088:0:41798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0823c lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 41798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.135101:0:41798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0823c lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.135111:0:41798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0823c lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269969.135122:0:41798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x5:0x0]: returning size 11 00010000:00010000:3.0:1788269969.135217:0:41798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08235 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610174e expref: 47 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.135234:0:41798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0823c lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610174e expref: 46 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.135244:0:41798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:3.0:1788269969.135246:0:41798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269969.135250:0:41798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee000, rc 0) 00000100:00100000:3.0:1788269969.135295:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+46:31219:x1875136253104128:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 369us (542us total) trans 25769803839 rc 0/0 00000100:00100000:3.0:1788269969.135303:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:0.0:1788269969.137669:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269969.137738:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253104384 00000100:00100000:3.0:1788269969.137746:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253104384 00000100:00100000:3.0:1788269969.137792:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788269969.137802:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+46:31219:x1875136253104384:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269969.137985:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+47:31219:x1875136253104384:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 183us (321us total) trans 25769803840 rc 0/0 00000100:00100000:3.0:1788269969.137992:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788269969.141376:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269969.141621:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253104512 00000100:00100000:3.0:1788269969.141630:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253104512 00000100:00100000:3.0:1788269969.141685:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788269969.141695:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+47:2402:x1875136253104512:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269969.141709:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269969.141731:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0823c lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610174e expref: 47 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.141748:0:40061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:3.0:1788269969.141753:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269969.141800:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+46:2402:x1875136253104512:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 106us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269969.141808:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788269969.267529:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269969.267604:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253104768 00000100:00100000:3.0:1788269969.267615:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253104768 00000100:00100000:3.0:1788269969.267669:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788269969.267679:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+46:31235:x1875136253104768:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788269969.267700:0:40075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269969.267718:0:40075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0824a lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101755 expref: -99 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.267834:0:40075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08251 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.267847:0:40075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08251 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.267857:0:40075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08251 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269969.267882:0:40075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x5:0x0]: returning size 11 00010000:00010000:3.0:1788269969.267971:0:40075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee000/0xc5f5d7a016e0824a lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101755 expref: 49 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.267987:0:40075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08251 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101755 expref: 48 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269969.267996:0:40075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:3.0:1788269969.267999:0:40075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269969.268002:0:40075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ef600, rc 0) 00000100:00100000:3.0:1788269969.268101:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+48:31235:x1875136253104768:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 423us (580us total) trans 25769803841 rc 0/0 00000100:00100000:3.0:1788269969.268108:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:0.0:1788269969.273229:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269969.273272:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269969.273339:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105024 00000100:00100000:3.0:1788269969.273349:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105024 00000100:00100000:3.0:1788269969.273401:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788269969.273410:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+48:31235:x1875136253105024:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788269969.273633:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:31235:x1875136253105024:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 223us (359us total) trans 25769803842 rc 0/0 00000100:00100000:3.0:1788269969.273640:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788269969.273941:0:40060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105152 00000100:00100000:1.0:1788269969.273947:0:40060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105152 00000100:00100000:1.0:1788269969.273989:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788269969.273996:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:2401:x1875136253105152:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269969.274023:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269969.274077:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e08251 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101755 expref: 49 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.274093:0:40060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269969.274098:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269969.274126:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+48:2401:x1875136253105152:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 131us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269969.274133:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788269969.401895:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269969.402021:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105408 00000100:00100000:2.0:1788269969.402030:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105408 00000100:00100000:2.0:1788269969.402111:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:2.0:1788269969.402121:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+48:31251:x1875136253105408:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788269969.402152:0:40076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269969.402172:0:40076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e0825f lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610175c expref: -99 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.402276:0:40076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.402290:0:40076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 49 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.402299:0:40076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 4/0,1 mode: --/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.402334:0:40076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 49 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269969.402348:0:40076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 49 pid: 40076 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269969.402363:0:40076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:40076:1875136262571904:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788269969.402444:0:40076:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24887df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269969.404696:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269969.404806:0:40076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:40076:1875136262571904:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788269969.404829:0:40076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269969.404981:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105536 00000100:00100000:0.0:1788269969.404989:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105536 00010000:00010000:0.0:1788269969.405020:0:40061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 50 pid: 40076 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269969.405083:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:0.0:1788269969.405091:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+50:2400:x1875136253105536:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269969.405103:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269969.405109:0:40061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 50 pid: 40076 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269969.405121:0:40061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 50 pid: 40076 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269969.405154:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030800/0xc5f5d7a016e0822e lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101747 expref: 50 pid: 40076 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269969.405175:0:40061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:0.0:1788269969.405180:0:40061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,1 mode: --/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269969.405188:0:40061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269969.405195:0:40061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 4/0,1 mode: CW/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269969.405221:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269969.405344:0:40076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.405352:0:40076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,1 mode: CW/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 40076 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269969.405367:0:40076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002b10:0x5:0x0]: returning size 11 00010000:00010000:1.0:1788269969.405469:0:40076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e0825f lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610175c expref: 51 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.405482:0:40076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 3/0,0 mode: CW/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610175c expref: 50 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.405489:0:40076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269969.405492:0:40076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269969.405494:0:40076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031400, rc 0) 00000100:00100000:0.0:1788269969.405531:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+50:2400:x1875136253105536:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 441us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269969.405537:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788269969.406075:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:31251:x1875136253105408:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 3918us (4151us total) trans 25769803843 rc 0/0 00000100:00100000:1.0:1788269969.406083:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:0.0:1788269969.487991:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269969.488225:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105664 00000100:00100000:1.0:1788269969.488236:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105664 00000100:00100000:1.0:1788269969.488325:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788269969.488335:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:31261:x1875136253105664:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788269969.488415:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 3/1,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488439:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488452:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488464:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488478:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488486:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488548:0:40074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/1,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 40074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488556:0:40074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488563:0:40074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269969.488616:0:40074:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488627:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 3/1,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488634:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 2/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488640:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488647:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269969.488651:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 3/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488658:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 4/0,0 mode: CR/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488671:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269969.488674:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269969.488678:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 2/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488685:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193600/0xc5f5d7a016e08274 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488699:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488705:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488712:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488717:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269969.488720:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488725:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488732:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:1.0:1788269969.488734:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269969.488737:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488743:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193c00/0xc5f5d7a016e0827b lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488751:0:40074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/1,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488766:0:40074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 2/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488773:0:40074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488779:0:40074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788269969.488782:0:40074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 3/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488788:0:40074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 4/0,0 mode: PR/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488793:0:40074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269969.488795:0:40074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269969.488798:0:40074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269969.488804:0:40074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144193800/0xc5f5d7a016e08282 lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 40074 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269969.488930:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:31261:x1875136253105664:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 595us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269969.488938:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:0.0:1788269969.604449:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269969.604486:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262572032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788269969.604565:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269969.604839:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572032 00000100:00100000:1.0:1788269969.604852:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572032 00000100:00100000:1.0:1788269969.604921:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269969.604939:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262572032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269969.604965:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59199168 pending 0 free 3923501056 avail 3691892736 00000100:00100000:1.0:1788269969.605028:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262572032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269969.605066:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788269969.605153:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 25769803790 gen 2 00000004:00080000:2.0:1788269969.605162:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803789 committed transno 25769803790 00000004:00080000:2.0:1788269969.605179:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c265e72d80, transno 25769803790 00000100:00100000:2.0:1788269969.605213:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262572032:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788269970.116832:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269970.565453:0:40828:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788269970.565463:0:40828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269970.565482:0:40828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 2 count 2 00000040:00080000:0.0:1788269970.565491:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788269970.958556:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958605:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958640:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958672:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958695:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958715:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958735:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958760:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269970.958785:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106560 00000100:00100000:2.0:1788269970.958785:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106048 00000100:00100000:3.0:1788269970.958793:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106560 00000100:00100000:2.0:1788269970.958793:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106048 00000100:00100000:1.0:1788269970.958886:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105792 00000100:00100000:1.0:1788269970.958890:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105792 00000100:00100000:1.0:1788269970.958939:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:1.0:1788269970.958949:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253105792:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269970.959014:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253105792:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 66us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269970.959022:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:1.0:1788269970.959107:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106304 00000100:00100000:1.0:1788269970.959111:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106304 00000100:00100000:1.0:1788269970.959145:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106176 00000100:00100000:1.0:1788269970.959149:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106176 00000100:00100000:1.0:1788269970.959167:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106688 00000100:00100000:1.0:1788269970.959170:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106688 00000100:00100000:1.0:1788269970.959186:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788269970.959193:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253106304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269970.959337:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253105920 00000100:00100000:3.0:1788269970.959341:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253105920 00000100:00100000:3.0:1788269970.959358:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106432 00000100:00100000:3.0:1788269970.959361:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106432 00000100:00100000:3.0:1788269970.959377:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788269970.959415:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253106304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 221us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269970.959422:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788269970.959436:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788269970.959442:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253106176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269970.959469:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253106176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269970.959476:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788269970.959488:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788269970.959494:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253106688:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269970.959517:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253106688:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269970.959523:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788269970.959544:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788269970.959551:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:2402:x1875136253105920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269970.959578:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:2402:x1875136253105920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269970.959584:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788269970.959599:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:1.0:1788269970.959605:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253106432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788269970.959629:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253106432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269970.959635:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00080000:1.0:1788269970.959658:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269970.959662:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269970.963740:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269970.963780:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106816 00000100:00100000:0.0:1788269970.963789:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106816 00000100:00100000:0.0:1788269970.963911:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:0.0:1788269970.963922:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2399:x1875136253106816:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:0.0:1788269970.963952:0:42623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07a08 00000100:00080000:0.0:1788269970.963967:0:42623:0:(import.c:65:import_set_state_nolock()) ffff98c1437d9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788269970.964010:0:42623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803787 00000100:00100000:0.0:1788269970.965056:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1437b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+2:2399:x1875136253106816:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 1114us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269970.965065:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00010000:00010000:0.0:1788269970.965116:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269970.967759:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253106560:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:1.0:1788269970.967883:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269970.967888:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269970.970726:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:0.0:1788269970.970758:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:2402:x1875136253106048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269970.970844:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:2402:x1875136253106048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 83us (12229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269970.970852:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:2.0:1788269970.971364:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253106560:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 11978us (12689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269970.971372:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00010000:00010000:0.0:1788269971.144729:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788269972.165131:0:40819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 763872088802ns, next at 764872085933ns, rc = 0 00000100:00100000:3.0:1788269972.165181:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269972.165201:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262572160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788269972.165272:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.165423:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269972.165443:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572160 00000100:00100000:0.0:1788269972.165444:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262572416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788269972.165453:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572160 00000100:00100000:0.0:1788269972.165479:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.165514:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262572288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269972.165517:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269972.165531:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3607:x1875136262572160:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788269972.165542:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788269972.165559:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923484672 avail 3691962368 00000100:00100000:0.0:1788269972.165566:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572416 00000100:00100000:0.0:1788269972.165570:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572416 00000100:00100000:0.0:1788269972.165600:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788269972.165608:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262572416:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788269972.165620:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3607:x1875136262572160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269972.165630:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00000024:0.0:1788269972.165631:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446285312 avail 1300045824 00000100:00100000:1.0:1788269972.165649:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572288 00000100:00100000:1.0:1788269972.165653:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572288 00000100:00100000:0.0:1788269972.165674:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262572416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269972.165677:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269972.165688:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262572288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269972.165692:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00002000:00000024:1.0:1788269972.165703:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1788269972.165740:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262572288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.165741:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262572416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788269972.165753:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269972.165765:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262572288:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788269972.165773:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269972.165804:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262572160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788269972.165964:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269972.165975:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262572544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269972.166004:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269972.166102:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572544 00010000:00010000:1.0:1788269972.166105:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269972.166108:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572544 00000100:00080000:1.0:1788269972.166130:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269972.166146:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269972.166151:0:41581:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788269972.166157:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262572544:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269972.166162:0:41581:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788269972.166178:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59199168 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1788269972.166214:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262572544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269972.166221:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269972.166253:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262572544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269972.166536:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262572928:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166562:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.166582:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262573440:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166602:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.166617:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788269972.166622:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262572800:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166640:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.166653:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262573312:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.166693:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572928 00000100:00100000:0.0:1788269972.166698:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572928 00000100:00100000:0.0:1788269972.166723:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788269972.166730:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262572928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166764:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262572928:12345-0@lo:400:kworker.0 Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.166770:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788269972.166788:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573440 00000100:00100000:0.0:1788269972.166791:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573440 00000100:00100000:0.0:1788269972.166830:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572800 00000100:00100000:0.0:1788269972.166834:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572800 00000100:00100000:0.0:1788269972.166864:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573312 00000100:00100000:0.0:1788269972.166867:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573312 00000100:00100000:0.0:1788269972.166882:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788269972.166888:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262573440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166918:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262573440:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.166924:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788269972.166936:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788269972.166942:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262572800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166982:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262572800:12345-0@lo:400:kworker.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269972.166990:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262573056:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.166990:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788269972.167004:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788269972.167012:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262573312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269972.167029:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.167073:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262573312:12345-0@lo:400:kworker.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.167079:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788269972.167086:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262573568:0@lo:400:kworker.0 00000100:00080000:0.0:1788269972.167100:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269972.167105:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269972.167115:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.167118:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573056 00000100:00100000:0.0:1788269972.167123:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573056 00000100:00100000:1.0:1788269972.167139:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788269972.167148:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262572672:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.167159:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269972.167167:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262573056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269972.167191:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.167218:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262573056:12345-0@lo:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269972.167225:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262573184:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.167227:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788269972.167250:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269972.167258:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269972.167277:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262573696:0@lo:400:kworker.0 00000100:00100000:1.0:1788269972.167303:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269972.167753:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573568 00000100:00100000:0.0:1788269972.167758:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573568 00000100:00100000:0.0:1788269972.167798:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573184 00000100:00100000:0.0:1788269972.167802:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573184 00000100:00100000:0.0:1788269972.167822:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788269972.167829:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262573568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.167863:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262573568:12345-0@lo:400:kworker.0 Request processed in 35us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.167869:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788269972.167882:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269972.167887:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262573184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.167909:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262573184:12345-0@lo:400:kworker.0 Request processed in 22us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.167914:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269972.167993:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262572800:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.168006:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262573312:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.168015:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262572928:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.168023:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262573440:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.168098:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262572672 00000100:00100000:0.0:1788269972.168101:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262572672 00000100:00100000:0.0:1788269972.168127:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788269972.168133:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262572672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.168162:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e129e33-0062-408b-ba53-2e2ae2985734+24:3607:x1875136262572672:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.168168:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788269972.168241:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269972.174093:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262573056:0@lo:400:kworker.0 00000100:00100000:1.0:1788269972.174117:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262573568:0@lo:400:kworker.0 00000100:00100000:1.0:1788269972.174148:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262572672:0@lo:400:kworker.0 00000100:00100000:1.0:1788269972.174160:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262573184:0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.177686:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573696 00000100:00100000:0.0:1788269972.177701:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573696 00000100:00100000:0.0:1788269972.177790:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788269972.177802:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262573696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269972.177909:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262573696:12345-0@lo:400:kworker.0 Request processed in 109us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269972.177916:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788269972.177991:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269972.178018:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262573696:0@lo:400:kworker.0 00000100:00100000:0.0:1788269973.041707:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269973.043114:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253106944 00000100:00100000:2.0:1788269973.043127:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253106944 00000100:00100000:2.0:1788269973.043213:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:2.0:1788269973.043226:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31114:x1875136253106944:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788269973.043345:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31114:x1875136253106944:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 123us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269973.043351:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00080000:3.0:1788269973.043595:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269973.045537:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269973.045607:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107072 00000100:00100000:0.0:1788269973.045616:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107072 00000100:00100000:0.0:1788269973.045686:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:0.0:1788269973.045707:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:31114:x1875136253107072:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788269973.045820:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+49:31114:x1875136253107072:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269973.045829:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00080000:3.0:1788269973.045979:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788269973.047194:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269973.047383:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107328 00000100:00100000:3.0:1788269973.047391:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107328 00000100:00100000:3.0:1788269973.047441:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788269973.047450:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2751fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:31114:x1875136253107328:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788269973.047649:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2751fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:31114:x1875136253107328:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 200us (459us total) trans 25769803830 rc 0/0 00000100:00100000:3.0:1788269973.047656:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00010000:00010000:0.0:1788269973.189782:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269973.636272:0:40112:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788269973.636280:0:40112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269973.636300:0:40112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788269973.636307:0:40112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:02000400:1.0:1788269974.095771:0:43498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 09:39:33 (1788269973) 00000100:00100000:3.0:1788269974.216692:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269974.216717:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262573824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269974.216790:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269974.216925:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573824 00000100:00100000:2.0:1788269974.216933:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573824 00000100:00100000:2.0:1788269974.216986:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788269974.216997:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262573824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788269974.217030:0:40079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446150144 avail 1299910656 00000100:00100000:2.0:1788269974.217104:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262573824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269974.217111:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788269974.218339:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262573824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788269974.219882:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788269974.221603:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000020:00000080:3.0:1788269974.221611:0:42392:0:(genops.c:885:class_export_put()) final put ffff98c1437de800/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00080000:3.0:1788269974.221698:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803787 is committed 00000001:00080000:3.0:1788269974.221708:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803785 is committed 00000020:00000080:2.0:1788269974.221916:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1437de800/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 for lustre-OST0001 00000020:00000080:2.0:1788269974.221968:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1437d9800 for lustre-OST0001 00000004:00080000:0.0:1788269974.225028:0:40807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000001:00080000:0.0:1788269974.225071:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803843 is committed 00000020:00080000:0.0:1788269974.225105:0:40807:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c1435cd9c0 refcount 2 committed 0 result 0 batchid 21474836518 00000020:00080000:0.0:1788269974.225111:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c243e07d00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c1435cd900 00000020:00080000:0.0:1788269974.225114:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c243e07e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14524ba00 00000020:00080000:0.0:1788269974.225152:0:40807:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c281216540 refcount 2 committed 0 result 0 batchid 21474836517 00000020:00080000:0.0:1788269974.225156:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c2766a0000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c281216000 00000020:00080000:0.0:1788269974.225160:0:40807:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c2766a0b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c142893e00 00000020:00080000:0.0:1788269974.225169:0:40807:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 21474836516 batchid updated 00010000:00010000:0.0:1788269974.225284:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225295:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 2/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225301:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225307:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269974.225311:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225318:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 4/0,0 mode: TXN/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225334:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x3:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788269974.225336:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269974.225340:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 2/0,0 mode: --/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225346:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e08083 lrc: 0/0,0 mode: --/TXN res: [0x240002b10:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42351 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225369:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225374:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 2/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225384:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225389:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269974.225392:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225398:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 4/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225407:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:0.0:1788269974.225409:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269974.225412:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 2/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225418:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f1000/0xc5f5d7a016e08178 lrc: 0/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 41798 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225429:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,1 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225436:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 2/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225443:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225449:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788269974.225452:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 3/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225463:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 4/0,0 mode: TXN/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225472:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x9cd2ad07 (ffff98c142858b00) 00010000:00010000:0.0:1788269974.225475:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269974.225478:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 2/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788269974.225481:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21474836518 committed batchid 21474836516 00010000:00010000:0.0:1788269974.225484:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e0819b lrc: 0/0,0 mode: --/TXN res: [0x240002b10:0x1:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 40075 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269974.225513:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262573952:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1788269974.225584:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269974.225620:0:40831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72680 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:40831:1875136262574080:0@lo:1000:dist_txn-1.0 00000100:00100000:1.0:1788269974.225661:0:40831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269974.225691:0:40831:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142428240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269974.225715:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574080 00000100:00100000:1.0:1788269974.225722:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574080 00000100:00100000:1.0:1788269974.225785:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788269974.225797:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:40831:x1875136262574080:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:0.0:1788269974.225867:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262573952 00000100:00100000:0.0:1788269974.225873:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262573952 00000100:00100000:1.0:1788269974.225886:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:40831:x1875136262574080:12345-0@lo:1000:dist_txn-1.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269974.225892:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788269974.225923:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788269974.225930:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262573952:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1788269974.225948:0:41580:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:162 count 1 00000100:00080000:3.0:1788269974.225966:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788269974.225971:0:41580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa2:0x0] initial LVB size: 1024, mtime: 0x6a96d58e, atime: 0x6a96d58f, ctime: 0x6a96d58f, blocks: 0x8 00010000:00010000:0.0:1788269974.225978:0:41580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.225989:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=765s v=(0 0) 00010000:00010000:0.0:1788269974.225992:0:41580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269974.225997:0:41580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.226009:0:41580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.226018:0:41580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269974.226022:0:41580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269974.226097:0:40831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72680 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:40831:1875136262574080:0@lo:1000:dist_txn-1.0 00000004:00080000:2.0:1788269974.226133:0:40831:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c1424283c0 with version 4 00000020:00080000:2.0:1788269974.226141:0:40831:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836515 cancel update log [0x200002b13:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1788269974.226191:0:40831:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836515 cancel update log [0x240002b11:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1788269974.226206:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836516 00010000:00010000:0.0:1788269974.226465:0:41580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788269974.226614:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262573952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 684us (1029us total) trans 25769803788 rc 0/0 00000100:00100000:0.0:1788269974.226621:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:0.0:1788269974.226647:0:40812:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c1436fcd80 version 4 rpc_version 4 00000020:00100000:0.0:1788269974.226674:0:40812:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788269974.226681:0:40812:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c27a650000 x1875136262574336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269974.226697:0:40812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a650000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262574336:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788269974.226724:0:40812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269974.226745:0:40812:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269974.226759:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574336 00000100:00100000:3.0:1788269974.226765:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574336 00000100:00100000:2.0:1788269974.226800:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803787 gen 2 00000004:00080000:2.0:1788269974.226806:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803786 committed transno 25769803787 00010000:00010000:1.0:1788269974.226810:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269974.226818:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269974.226828:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803787 committed transno 25769803787 00010000:00010000:1.0:1788269974.226837:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788269974.226842:0:42615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269974.226849:0:3610:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c14262c700 x1875136262573952/t25769803788(25769803788) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788269990 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788269974.226853:0:42615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269974.226870:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14262c700/2, rc 0, transno 25769803788 00000100:00100000:2.0:1788269974.226877:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262573952:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788269974.226879:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269974.226889:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000108824d4/0xc5f5d7a016e08289 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 41580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269974.226906:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269974.226908:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269974.226910:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269974.226918:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788269974.226928:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:40812:x1875136262574336:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788269974.227099:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:40812:x1875136262574336:12345-0@lo:1000:osp_up0-1.0 Request processed in 173us (373us total) trans 25769803831 rc 0/0 00000100:00100000:3.0:1788269974.227109:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788269974.227876:0:40812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a650000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:40812:1875136262574336:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788269974.725140:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262574464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269974.725220:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269974.725253:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574464 00000100:00100000:3.0:1788269974.725263:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574464 00000100:00080000:1.0:1788269974.725305:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269974.725328:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269974.725338:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262574464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788269974.725367:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59199168 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788269974.725414:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262574464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269974.725542:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262574464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269974.729936:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000001:02000400:1.0:1788269975.043556:0:43547:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_3b Need 3 or more clients, have 1 00010000:00010000:0.0:1788269975.236536:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269976.066999:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067116:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067147:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067169:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067187:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067202:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067218:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067241:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269976.067266:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107968 00000100:00100000:0.0:1788269976.067275:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107968 00000100:00100000:3.0:1788269976.067396:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107712 00000100:00100000:3.0:1788269976.067402:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107712 00000100:00100000:0.0:1788269976.067451:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107840 00000100:00100000:3.0:1788269976.067455:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253108224 00000100:00100000:0.0:1788269976.067457:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107840 00000100:00100000:3.0:1788269976.067461:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253108224 00000100:00100000:0.0:1788269976.067484:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253108352 00000100:00100000:3.0:1788269976.067488:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107584 00000100:00100000:0.0:1788269976.067489:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253108352 00000100:00100000:3.0:1788269976.067493:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107584 00000100:00100000:0.0:1788269976.067516:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788269976.067520:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253108096 00000100:00100000:3.0:1788269976.067525:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253108096 00000100:00100000:0.0:1788269976.067530:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253107968:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269976.067549:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:3.0:1788269976.067559:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:2402:x1875136253107712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269976.067600:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2402:x1875136253107968:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 73us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269976.067603:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:2402:x1875136253107712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269976.067617:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:3.0:1788269976.067633:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:3.0:1788269976.067640:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253108224:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269976.067664:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253108224:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269976.067669:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:3.0:1788269976.067681:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788269976.067687:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788269976.067692:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2402:x1875136253107584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269976.067711:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788269976.067720:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253107840:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788269976.067727:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2402:x1875136253107584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269976.067734:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788269976.067763:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2402:x1875136253107840:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269976.067769:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:0.0:1788269976.067775:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788269976.067781:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253108096:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269976.067793:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788269976.067802:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253108352:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269976.067831:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2402:x1875136253108352:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269976.067837:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00080000:0.0:1788269976.067887:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269976.067891:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269976.067893:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788269976.067896:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269976.068199:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253107456 00000100:00100000:1.0:1788269976.068205:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253107456 00000100:00100000:3.0:1788269976.068409:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2402:x1875136253108096:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269976.068419:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:3.0:1788269976.068423:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:0.0:1788269976.068431:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253107456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788269976.068477:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253107456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 49us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269976.068484:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000001:02000400:2.0:1788269976.132497:0:43595:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 4: Auto cache test for mmap =========== 09:39:35 (1788269975) 00010000:00010000:0.0:1788269976.262289:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269977.284412:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262574592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269977.284485:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.284563:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574592 00000100:00100000:0.0:1788269977.284572:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574592 00000100:00100000:0.0:1788269977.284619:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788269977.284629:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262574592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788269977.284662:0:40815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446285312 avail 1300045824 00000100:00100000:0.0:1788269977.284706:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262574592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.284714:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788269977.284775:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262574592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788269977.285434:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262574720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269977.285465:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285487:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262575232:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285508:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285522:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262575744:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285539:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285552:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262576256:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285570:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285586:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788269977.285592:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262574848:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285619:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285641:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262575360:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285662:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285678:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285699:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285736:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262575104:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285759:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285776:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262575616:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285795:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285809:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262576128:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285828:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285844:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788269977.285848:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262574976:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285867:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285880:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262575488:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285899:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285914:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262576000:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.285933:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269977.285954:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575232 00000100:00100000:0.0:1788269977.285960:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575232 00000100:00100000:0.0:1788269977.285985:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575744 00000100:00100000:0.0:1788269977.285987:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575744 00000100:00100000:0.0:1788269977.285999:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576256 00000100:00100000:0.0:1788269977.286001:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576256 00000100:00100000:0.0:1788269977.286019:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575872 00000100:00100000:0.0:1788269977.286022:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575872 00000100:00100000:0.0:1788269977.286034:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576128 00000100:00100000:2.0:1788269977.287108:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575104 00000100:00100000:2.0:1788269977.287116:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575104 00000100:00100000:2.0:1788269977.287155:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575616 00000100:00100000:0.0:1788269977.287373:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576128 00000100:00100000:0.0:1788269977.287419:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576000 00000100:00100000:0.0:1788269977.287423:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576000 00000100:00100000:0.0:1788269977.287444:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269977.287452:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262575232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287523:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262575232:12345-0@lo:400:kworker.0 Request processed in 71us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287530:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269977.287546:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788269977.287552:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262575744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287580:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262575744:12345-0@lo:400:kworker.0 Request processed in 28us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287586:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788269977.287597:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269977.287602:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262576256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287627:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262576256:12345-0@lo:400:kworker.0 Request processed in 25us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287633:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269977.287644:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269977.287650:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262575872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287675:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262575872:12345-0@lo:400:kworker.0 Request processed in 26us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287684:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269977.287696:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788269977.287701:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262576128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287759:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262576128:12345-0@lo:400:kworker.0 Request processed in 58us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287765:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788269977.287778:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269977.287783:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262576000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287809:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262576000:12345-0@lo:400:kworker.0 Request processed in 27us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287815:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269977.287838:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574976 00000100:00100000:0.0:1788269977.287841:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574976 00000100:00100000:0.0:1788269977.287859:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575488 00000100:00100000:0.0:1788269977.287862:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575488 00000100:00100000:0.0:1788269977.287876:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269977.287882:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262575104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287916:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262575104:12345-0@lo:400:kworker.0 Request processed in 29us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287923:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269977.287935:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269977.287941:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262574976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.287965:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262574976:12345-0@lo:400:kworker.0 Request processed in 25us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.287970:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269977.287979:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269977.287984:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262575488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.288002:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262575488:12345-0@lo:400:kworker.0 Request processed in 19us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269977.288008:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788269977.288023:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269977.288026:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269977.288028:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269977.288030:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269977.288087:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.288097:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262575232:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.288105:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262575744:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.288114:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262576256:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.288144:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262574976:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.288153:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262575488:0@lo:400:kworker.0 00000100:00100000:2.0:1788269977.288242:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575616 00000100:00100000:2.0:1788269977.288270:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269977.288276:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262575616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269977.288305:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262575616:12345-0@lo:400:kworker.0 Request processed in 30us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269977.288311:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269977.288333:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262575360 00000100:00100000:2.0:1788269977.288336:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262575360 00000100:00100000:2.0:1788269977.288361:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788269977.288367:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262575360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269977.288400:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262575360:12345-0@lo:400:kworker.0 Request processed in 34us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269977.288406:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788269977.288421:0:40069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574848 00000100:00100000:2.0:1788269977.288424:0:40069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574848 00000100:00100000:2.0:1788269977.288442:0:40069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788269977.288447:0:40069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3609:x1875136262574848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269977.288469:0:40069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3609:x1875136262574848:12345-0@lo:400:kworker.0 Request processed in 23us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269977.288475:0:40069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00010000:1.0:1788269977.288620:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269977.288630:0:43413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262574720 00000100:00100000:1.0:1788269977.288634:0:43413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262574720 00000100:00100000:1.0:1788269977.288656:0:43413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269977.288662:0:43413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262574720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269977.288680:0:43413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1788269977.288713:0:43413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262574720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269977.288718:0:43413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788269977.288805:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269977.290259:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262576000:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.290281:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262575104:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.290292:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262575616:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.290303:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262576128:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.290350:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262574848:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.290360:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262575360:0@lo:400:kworker.0 00000100:00100000:0.0:1788269977.290376:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262574720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269977.290518:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262576384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788269977.290560:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269977.290594:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576384 00000100:00100000:2.0:1788269977.290599:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576384 00000100:00100000:2.0:1788269977.290628:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269977.290635:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262576384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788269977.290649:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788269977.290679:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262576384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269977.290685:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269977.290711:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262576384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788269977.290921:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269977.290929:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262576512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269977.290954:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269977.290977:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576512 00000100:00100000:3.0:1788269977.290980:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576512 00000100:00100000:3.0:1788269977.290998:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788269977.291004:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262576512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269977.291021:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59199168 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788269977.291060:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262576512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269977.291066:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788269977.291088:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262576512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269978.025367:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269978.025436:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253108608 00000100:00100000:3.0:1788269978.025446:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253108608 00000100:00100000:3.0:1788269978.025520:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788269978.025534:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:32194:x1875136253108608:12345-192.168.201.42@tcp:35:umount.0 00000100:00080000:1.0:1788269978.025587:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269978.025856:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:32194:x1875136253108608:12345-192.168.201.42@tcp:35:umount.0 Request processed in 325us (497us total) trans 25769803832 rc 0/0 00000100:00100000:3.0:1788269978.025864:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788269978.028196:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.028280:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253108864 00000100:00100000:0.0:1788269978.028287:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253108864 00000100:00100000:0.0:1788269978.028358:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788269978.028367:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+10:32194:x1875136253108864:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:0.0:1788269978.028555:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:32194:x1875136253108864:12345-192.168.201.42@tcp:35:umount.0 Request processed in 189us (365us total) trans 25769803844 rc 0/0 00000100:00100000:0.0:1788269978.028560:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00080000:1.0:1788269978.028607:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269978.032408:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269978.032580:0:40078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253109120 00000100:00100000:3.0:1788269978.032590:0:40078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253109120 00000100:00100000:3.0:1788269978.032673:0:40078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788269978.032683:0:40078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:32194:x1875136253109120:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:3.0:1788269978.032899:0:40078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:32194:x1875136253109120:12345-192.168.201.42@tcp:35:umount.0 Request processed in 217us (498us total) trans 25769803845 rc 0/0 00000100:00100000:3.0:1788269978.032907:0:40078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788269978.036117:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269978.036156:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.036510:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253109376 00000100:00100000:0.0:1788269978.036520:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253109376 00000100:00100000:0.0:1788269978.036581:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253109248 00000100:00100000:0.0:1788269978.036585:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253109248 00000100:00100000:0.0:1788269978.036620:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788269978.036631:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+14:2402:x1875136253109376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269978.036645:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269978.036663:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b676c00/0xc5f5d7a016e079a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610143e expref: 14 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269978.036676:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269978.036733:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+13:2402:x1875136253109376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 104us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269978.036740:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788269978.036757:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788269978.036763:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+12:2401:x1875136253109248:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269978.036771:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269978.036780:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b676800/0xc5f5d7a016e0799f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610140d expref: 12 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269978.036787:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269978.036804:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:2401:x1875136253109248:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 42us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269978.036811:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788269978.038652:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269978.038738:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.038795:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253109504 00000100:00100000:0.0:1788269978.038802:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253109504 00000100:00100000:0.0:1788269978.038879:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788269978.038889:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:2401:x1875136253109504:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269978.038902:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788269978.038909:0:41580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253109632 00000100:00100000:2.0:1788269978.038916:0:41580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253109632 00010000:00010000:0.0:1788269978.038920:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1410f0600/0xc5f5d7a016e07b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101556 expref: 11 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269978.038935:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269978.038974:0:41580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00080000:3.0:1788269978.038981:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269978.038981:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:2401:x1875136253109504:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269978.038987:0:41580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+5:2399:x1875136253109632:12345-192.168.201.42@tcp:9:umount.0 00000100:00100000:0.0:1788269978.038994:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000020:00000080:2.0:1788269978.039022:0:41580:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e079c2 00000100:00080000:2.0:1788269978.039032:0:41580:0:(import.c:65:import_set_state_nolock()) ffff98c1437dc000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788269978.039097:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788269978.039112:0:41580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803788 00000100:00100000:2.0:1788269978.039263:0:41580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41dd69ed-5790-4cb1-adef-18c6baaffed2+2:2399:x1875136253109632:12345-192.168.201.42@tcp:9:umount.0 Request processed in 279us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269978.039270:0:41580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788269978.043848:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269978.044506:0:42634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253109888 00000100:00100000:2.0:1788269978.044518:0:42634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253109888 00000100:00080000:3.0:1788269978.044581:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269978.044597:0:42634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788269978.044610:0:42634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+6:2399:x1875136253109888:12345-192.168.201.42@tcp:9:umount.0 00000020:00000080:2.0:1788269978.044642:0:42634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e079c9 00000020:00010000:2.0:1788269978.044659:0:42634:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c1435b1800: total 0 00000100:00080000:2.0:1788269978.044664:0:42634:0:(import.c:65:import_set_state_nolock()) ffff98c1435b6800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788269978.044700:0:40064:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c1435b1800: total 0 00010000:00010000:0.0:1788269978.044705:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788269978.044722:0:42634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803791 00010000:00010000:0.0:1788269978.044825:0:40064:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c1435b1800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788269978.044858:0:40064:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:0.0:1788269978.044863:0:40064:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb mtime from disk: 0 -> 1788269969 00002000:00010000:0.0:1788269978.044865:0:40064:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb ctime from disk: 0 -> 1788269969 00002000:00010000:0.0:1788269978.044868:0:40064:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788269978.044895:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e1bc8fc/0xc5f5d7a016e081b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101724 expref: 4 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269978.044904:0:42634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41dd69ed-5790-4cb1-adef-18c6baaffed2+4:2399:x1875136253109888:12345-192.168.201.42@tcp:9:umount.0 Request processed in 294us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269978.044916:0:42634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00010000:00010000:0.0:1788269978.044928:0:40064:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c1435b1800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788269978.044944:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269978.044948:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269978.044951:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269978.050355:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269978.050429:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253110784 00000100:00100000:2.0:1788269978.050440:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253110784 00000100:00100000:2.0:1788269978.050493:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:2.0:1788269978.050501:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+13:2399:x1875136253110784:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:2.0:1788269978.050530:0:40075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e079bb 00000020:00010000:2.0:1788269978.050543:0:40075:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c1435b0000: total 0 00000100:00080000:2.0:1788269978.050546:0:40075:0:(import.c:65:import_set_state_nolock()) ffff98c1435b1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269978.050570:0:40075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803832 00000100:00100000:2.0:1788269978.050743:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2399:x1875136253110784:12345-192.168.201.42@tcp:39:umount.0 Request processed in 241us (394us total) trans 25769803833 rc 0/0 00000100:00100000:2.0:1788269978.050751:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000020:00010000:1.0:1788269978.051086:0:42615:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c1435b0000: total 0 00010000:00010000:1.0:1788269978.051135:0:42615:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c1435b0000, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1788269978.051169:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:1.0:1788269978.051173:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269978.051181:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e07e92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101636 expref: 11 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.051196:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269978.051197:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788269978.051200:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e07d6c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015e2 expref: 10 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.051208:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c143878b00) 00010000:00010000:1.0:1788269978.051210:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269978.051212:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e07a55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014f4 expref: 9 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.051225:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269978.051227:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788269978.051229:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e07a9b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101502 expref: 8 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.051238:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2596bed00) 00010000:00010000:1.0:1788269978.051239:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269978.051241:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0800/0xc5f5d7a016e07eae lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610163d expref: 7 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.051248:0:42615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c250e61400) 00010000:00010000:1.0:1788269978.051250:0:42615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269978.051252:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e07a39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014ed expref: 6 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.051272:0:42615:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c1435b0000, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1788269978.051280:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.051281:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.051292:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788269978.052988:0:40055:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00000001:00080000:2.0:1788269978.053000:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803833 is committed 00000001:00080000:2.0:1788269978.053008:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803831 is committed 00000020:00000080:2.0:1788269978.053011:0:40055:0:(genops.c:885:class_export_put()) final put ffff98c1435b0000/41dd69ed-5790-4cb1-adef-18c6baaffed2 00000020:00000080:0.0:1788269978.053619:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b0000/41dd69ed-5790-4cb1-adef-18c6baaffed2 for lustre-MDT0000 00000020:00000080:0.0:1788269978.053798:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1435b1000 for lustre-MDT0000 00000100:00100000:1.0:1788269978.057440:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269978.057575:0:41798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253111168 00000100:00100000:2.0:1788269978.057585:0:41798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253111168 00000100:00100000:2.0:1788269978.057644:0:41798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:2.0:1788269978.057654:0:41798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+12:2399:x1875136253111168:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:2.0:1788269978.057683:0:41798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e079b4 00000020:00010000:2.0:1788269978.057699:0:41798:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c142bd3800: total 0 00000100:00080000:2.0:1788269978.057704:0:41798:0:(import.c:65:import_set_state_nolock()) ffff98c143557000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269978.057741:0:41798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803845 00000100:00100000:2.0:1788269978.057891:0:41798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41dd69ed-5790-4cb1-adef-18c6baaffed2+11:2399:x1875136253111168:12345-192.168.201.42@tcp:39:umount.0 Request processed in 237us (459us total) trans 25769803846 rc 0/0 00000100:00100000:2.0:1788269978.057898:0:41798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000020:00010000:1.0:1788269978.058198:0:40063:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c142bd3800: total 0 00010000:00010000:1.0:1788269978.058243:0:40063:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c142bd3800, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1788269978.058274:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269978.058277:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269978.058285:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031a00/0xc5f5d7a016e081f6 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101740 expref: 10 pid: 42351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.058308:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269978.058310:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269978.058314:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e08266 lrc: 0/0,0 mode: --/CW res: [0x240002b10:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610175c expref: 9 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.058324:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269978.058326:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788269978.058329:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ee800/0xc5f5d7a016e0802f lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561016bb expref: 8 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.058338:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x5:0x0].0x0 (ffff98c143876700) 00010000:00010000:1.0:1788269978.058340:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788269978.058343:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192e00/0xc5f5d7a016e081e8 lrc: 0/0,0 mode: --/CR res: [0x240002b10:0x5:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101739 expref: 7 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.058357:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269978.058359:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269978.058362:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e081be lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610172b expref: 6 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.058370:0:40063:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c142bd3800, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1788269978.058379:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.058381:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.058383:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269978.308247:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269978.815888:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.816246:0:40077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253111424 00000100:00100000:0.0:1788269978.816256:0:40077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253111424 00000100:00100000:0.0:1788269978.816344:0:40077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00080000:3.0:1788269978.816347:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269978.816356:0:40077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:32207:x1875136253111424:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:0.0:1788269978.816583:0:40077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+12:32207:x1875136253111424:12345-192.168.201.42@tcp:35:umount.0 Request processed in 230us (704us total) trans 25769803834 rc 0/0 00000100:00100000:0.0:1788269978.816590:0:40077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788269978.819482:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788269978.819527:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788269978.819620:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253111680 00000100:00100000:2.0:1788269978.819629:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253111680 00000100:00100000:2.0:1788269978.819732:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253111552 00000100:00100000:2.0:1788269978.819736:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253111552 00000100:00100000:3.0:1788269978.820083:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788269978.820092:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+11:2402:x1875136253111680:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269978.820106:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269978.820124:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e079e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561014ae expref: 11 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269978.820139:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269978.820193:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+10:2402:x1875136253111680:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 102us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269978.820199:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788269978.820214:0:40060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788269978.820219:0:40060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+9:2402:x1875136253111552:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269978.820224:0:40060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269978.820230:0:40060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c143b9f600/0xc5f5d7a016e079de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610147d expref: 9 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269978.820236:0:40060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269978.820250:0:40060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:2402:x1875136253111552:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 30us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269978.820256:0:40060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788269978.820343:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.820680:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253111808 00000100:00100000:0.0:1788269978.820685:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253111808 00000100:00100000:0.0:1788269978.820861:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:0.0:1788269978.820870:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+8:2401:x1875136253111808:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269978.820879:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269978.820889:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e07b51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610154f expref: 8 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269978.820898:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269978.820938:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+7:2401:x1875136253111808:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 69us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269978.820948:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788269978.825481:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269978.825558:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253112064 00000100:00100000:1.0:1788269978.825565:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253112064 00000100:00100000:1.0:1788269978.825641:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788269978.825649:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2399:x1875136253112064:12345-192.168.201.42@tcp:9:umount.0 00000020:00000080:1.0:1788269978.825678:0:41578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07a01 00000020:00010000:1.0:1788269978.825683:0:41578:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c27699f800: total 0 00000100:00080000:1.0:1788269978.825686:0:41578:0:(import.c:65:import_set_state_nolock()) ffff98c27699c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269978.825744:0:41578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803791 00000020:00010000:2.0:1788269978.825747:0:42615:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c27699f800: total 0 00010000:00010000:2.0:1788269978.825751:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269978.825795:0:42615:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c27699f800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788269978.825820:0:42615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 0 -> 14 00002000:00010000:2.0:1788269978.825824:0:42615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788269978.825846:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79f2bbf/0xc5f5d7a016e07dce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101605 expref: 4 pid: 41578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269978.825869:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+3:2399:x1875136253112064:12345-192.168.201.42@tcp:9:umount.0 Request processed in 220us (395us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269978.825870:0:42615:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c27699f800, canceled 1 locks, left on hash table 0. 00000100:00100000:1.0:1788269978.825877:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00010000:00010000:2.0:1788269978.825880:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269978.825882:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269978.825883:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269978.825915:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269978.832241:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.832722:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253112704 00000100:00100000:0.0:1788269978.832731:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253112704 00000100:00100000:0.0:1788269978.832791:0:40076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:0.0:1788269978.832813:0:40076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+12:2399:x1875136253112704:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:0.0:1788269978.832848:0:40076:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e079f3 00000020:00010000:0.0:1788269978.832855:0:40076:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c276998800: total 0 00000100:00080000:0.0:1788269978.832858:0:40076:0:(import.c:65:import_set_state_nolock()) ffff98c27699a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788269978.832912:0:40076:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803834 00000100:00100000:0.0:1788269978.833058:0:40076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+11:2399:x1875136253112704:12345-192.168.201.42@tcp:39:umount.0 Request processed in 234us (801us total) trans 25769803835 rc 0/0 00000100:00100000:0.0:1788269978.833066:0:40076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000020:00010000:1.0:1788269978.833517:0:40063:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c276998800: total 0 00010000:00010000:1.0:1788269978.833558:0:40063:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c276998800, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1788269978.833583:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269978.833586:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269978.833591:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e07dab lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015f7 expref: 10 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.833603:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269978.833605:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269978.833607:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e07c3f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101587 expref: 9 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.833615:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff98c1429f7600) 00010000:00010000:1.0:1788269978.833616:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788269978.833618:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e07c00 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101572 expref: 8 pid: 40074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.833629:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2596bef00) 00010000:00010000:1.0:1788269978.833631:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269978.833633:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e07e22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101613 expref: 7 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.833641:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff98c250e61200) 00010000:00010000:1.0:1788269978.833642:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269978.833644:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193a00/0xc5f5d7a016e07dc0 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561015fe expref: 6 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.833666:0:40063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2596bed00) 00010000:00010000:1.0:1788269978.833667:0:40063:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269978.833669:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e07e3e lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610161a expref: 5 pid: 40075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.833676:0:40063:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c276998800, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1788269978.833682:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.833684:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.833685:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269978.840351:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788269978.840496:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253112960 00000100:00100000:0.0:1788269978.840506:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253112960 00000100:00100000:0.0:1788269978.840624:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:0.0:1788269978.840636:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+6:2399:x1875136253112960:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:0.0:1788269978.840676:0:42351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e079fa 00000020:00010000:0.0:1788269978.840684:0:42351:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c276998000: total 0 00000100:00080000:0.0:1788269978.840689:0:42351:0:(import.c:65:import_set_state_nolock()) ffff98c27699d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788269978.840738:0:42351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803846 00000100:00100000:0.0:1788269978.840890:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c97af8c-d97a-48dd-9f8f-2f83c7b756c7+5:2399:x1875136253112960:12345-192.168.201.42@tcp:39:umount.0 Request processed in 257us (548us total) trans 25769803847 rc 0/0 00000100:00100000:0.0:1788269978.840899:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00000020:00010000:1.0:1788269978.840990:0:40064:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c276998000: total 0 00010000:00010000:1.0:1788269978.841065:0:40064:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c276998000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788269978.841097:0:40064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002b10:0x1:0x0].0x0 (ffff98c2587d1700) 00010000:00010000:1.0:1788269978.841101:0:40064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788269978.841109:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c1410f0000/0xc5f5d7a016e07e4c lrc: 0/0,0 mode: --/PR res: [0x240002b10:0x1:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101621 expref: 4 pid: 40076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269978.841131:0:40064:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c276998000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788269978.841142:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.841144:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269978.841146:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269978.841858:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788269978.890196:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788269978.890270:0:40070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113216 00000100:00100000:1.0:1788269978.890292:0:40070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113216 00000100:00100000:1.0:1788269978.890354:0:40070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:1.0:1788269978.890365:0:40070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+7:2399:x1875136253113216:12345-192.168.201.42@tcp:251:umount.0 00000020:00000080:1.0:1788269978.890408:0:40070:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07991 00000020:00010000:1.0:1788269978.890416:0:40070:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c245cfe000: total 0 00000100:00080000:1.0:1788269978.890421:0:40070:0:(import.c:65:import_set_state_nolock()) ffff98c142bd6000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788269978.890500:0:40070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:460bc5f4-1ddb-4a00-850f-bc38bcba8857+3:2399:x1875136253113216:12345-192.168.201.42@tcp:251:umount.0 Request processed in 136us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269978.890508:0:40070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000020:00010000:3.0:1788269978.890530:0:42615:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c245cfe000: total 0 00010000:00010000:3.0:1788269978.890533:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269978.890582:0:42615:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c245cfe000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788269978.890613:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c143b9f000/0xc5f5d7a016e07998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101406 expref: 2 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269978.890627:0:42615:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c245cfe000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788269978.890638:0:42615:0:(genops.c:885:class_export_put()) final put ffff98c245cfe000/460bc5f4-1ddb-4a00-850f-bc38bcba8857 00010000:00010000:3.0:1788269978.891858:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269978.891862:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269978.891864:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788269978.891972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cfe000/460bc5f4-1ddb-4a00-850f-bc38bcba8857 for MGS 00000020:00000080:1.0:1788269978.892012:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c142bd6000 for MGS 00000100:00100000:3.0:1788269979.332165:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262576640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788269979.332302:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269979.332658:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269979.334331:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576640 00000100:00100000:1.0:1788269979.334343:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576640 00000100:00100000:1.0:1788269979.334406:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788269979.334416:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262576640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788269979.334450:0:40080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446150144 avail 1299910656 00000100:00100000:1.0:1788269979.334525:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262576640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269979.334533:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788269979.334754:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803831 gen 2 00000004:00080000:0.0:1788269979.334759:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803831 committed transno 25769803831 00000100:00100000:0.0:1788269979.334789:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262576640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788269979.844414:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269979.844433:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262576768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788269979.844507:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269979.844579:0:43413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576768 00000100:00100000:1.0:1788269979.844600:0:43413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576768 00000100:00100000:1.0:1788269979.844659:0:43413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788269979.844669:0:43413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262576768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788269979.844716:0:43413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1788269979.844767:0:43413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262576768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269979.844775:0:43413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788269979.844799:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269979.844839:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262576768:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1788269979.869804:0:43789:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788269979.878196:0:43789:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788269979.878252:0:43789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.878267:0:43789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.878274:0:43789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.878281:0:43789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.878300:0:43789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788269979.878305:0:43789:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788269979.878332:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788269979.878337:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788269979.878343:0:43789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788269979.878366:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788269979.878419:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262576896:0@lo:39:umount.0 00000100:00100000:2.0:1788269979.878484:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269979.878517:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262576896 00000100:00100000:0.0:1788269979.878525:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262576896 00000100:00100000:0.0:1788269979.878574:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788269979.878585:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875136262576896:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788269979.878609:0:40074:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0746d 00000100:00080000:0.0:1788269979.878723:0:40074:0:(import.c:65:import_set_state_nolock()) ffff98c27b77a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788269979.878838:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3606:x1875136262576896:12345-0@lo:39:umount.0 Request processed in 254us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269979.878850:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000020:00000080:0.0:1788269979.878860:0:40074:0:(genops.c:885:class_export_put()) final put ffff98c27b778800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788269979.878882:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b778800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788269979.878910:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269979.878918:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.878927:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfa00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269979.878931:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788269979.878935:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b77a800 for lustre-MDT0000 00010000:00010000:3.0:1788269979.878941:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269979.878951:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269979.878957:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269979.878959:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:2.0:1788269979.878961:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2491eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788269979.878962:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788269979.878971:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262576896:0@lo:39:umount.0 00010000:00010000:3.0:1788269979.879009:0:42615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.879021:0:42615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788269979.879080:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788269979.879083:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788269979.879087:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788269979.879821:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269979.879984:0:43789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.879996:0:43789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880003:0:43789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880009:0:43789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880032:0:43789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269979.880055:0:43789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880063:0:43789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880069:0:43789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880076:0:43789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880090:0:43789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269979.880096:0:43789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880102:0:43789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880108:0:43789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880114:0:43789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880121:0:43789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788269979.880126:0:43789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880132:0:43789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880139:0:43789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880146:0:43789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269979.880153:0:43789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788269979.880155:0:43789:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788269979.880180:0:43789:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788269979.880183:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788269979.880187:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269979.880193:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:0.0:1788269979.880199:0:43789:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c14408d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788269979.880206:0:43789:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c143556000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788269979.880212:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:0.0:1788269979.880213:0:43789:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c27f700000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788269979.880221:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788269979.880222:0:43789:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c27f621800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 1) 0 0 0 0: 0000000000000000 25769803831 stale:0 00010000:00010000:1.0:1788269979.880237:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bee00 already unused, calling callback (ffffffffc149cc20) 00000020:00080000:0.0:1788269979.880238:0:43789:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98c276998800 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 192.168.201.42@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 25769803824 stale:0 10000000:00010000:1.0:1788269979.880244:0:40063:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788269979.880247:0:43789:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98c276b6b370) has exports, disconnecting them 00000020:00080000:0.0:1788269979.880255:0:43789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c14408d800), last request at 1788269977 00010000:00010000:1.0:1788269979.880257:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788269979.880261:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e076a4 10000000:00010000:1.0:1788269979.880268:0:40063:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269979.880275:0:40063:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269979.880277:0:40063:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000100:00080000:0.0:1788269979.880278:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c142bd1000 : changing import state from FULL to CLOSED 10000000:01000000:1.0:1788269979.880280:0:40063:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1788269979.880317:0:43789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c14408d800): rc 0 00000020:00000080:0.0:1788269979.880320:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c14408d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788269979.880329:0:43789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c143556000), last request at 1788269977 00000020:00000080:0.0:1788269979.880332:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07611 00000100:00080000:0.0:1788269979.880337:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c143551000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788269979.880345:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c14408d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788269979.880378:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c142bd1000 for lustre-MDT0000 00000020:00080000:0.0:1788269979.880389:0:43789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143556000): rc 0 00000020:00000080:0.0:1788269979.880392:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c143556000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788269979.880398:0:43789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c27f700000), last request at 1788269928 00000020:00000080:0.0:1788269979.880401:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0755b 00000100:00080000:0.0:1788269979.880405:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c27f702000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788269979.880412:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143556000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788269979.880432:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143551000 for lustre-MDT0000 00000020:00080000:0.0:1788269979.880443:0:43789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c27f700000): rc 0 00000020:00000080:0.0:1788269979.880445:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c27f700000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788269979.880454:0:43789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c27f621800), last request at 1788269928 00000020:00000080:0.0:1788269979.880458:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074f9 00000020:00010000:0.0:1788269979.880461:0:43789:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c27f621800: total 1 00010000:00010000:1.0:1788269979.880465:0:40063:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788269979.880465:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c27f622000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788269979.880475:0:40063:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788269979.880477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f700000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788269979.880499:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269979.880508:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0bee00/0xc5f5d7a016e0738d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07394 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788269979.880509:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27f702000 for lustre-MDT0000 00000001:00000004:0.0:1788269979.880524:0:43789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803835 00000020:00010000:1.0:1788269979.880525:0:40063:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c27f621800: total 0 00010000:00010000:1.0:1788269979.880566:0:40063:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c27f621800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788269979.880595:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e07e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07e5a expref: 6 pid: 40079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788269979.880598:0:43789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c27f621800): rc 0 00000004:00000080:0.0:1788269979.880605:0:43789:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad6581463ae0 00000100:00100000:2.0:1788269979.880737:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262577024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269979.880753:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880763:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfa00/0xc5f5d7a016e0743c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07443 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880775:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1788269979.880778:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269979.880781:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880789:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269979.880793:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880801:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269979.880807:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269979.880812:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269979.880815:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788269979.880818:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1788269979.880822:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577024 00000100:00100000:2.0:1788269979.880827:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577024 00010000:00010000:3.0:1788269979.880836:0:42615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880844:0:42615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269979.880852:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269979.880864:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788269979.880866:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf200/0xc5f5d7a016e076d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e076dc expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269979.880875:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+24:3610:x1875136262577024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269979.880878:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269979.880883:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269979.880888:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269979.880890:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269979.880894:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269979.880901:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418f400/0xc5f5d7a016e07443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0743c expref: 24 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880903:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269979.880916:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269979.880916:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1788269979.880934:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788269979.880936:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788269979.880939:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788269979.880944:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+23:3610:x1875136262577024:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269979.880951:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788269979.880953:0:40063:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c27f621800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788269979.880958:0:42615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880966:0:42615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269979.880976:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.880983:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e07bac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07bb3 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269979.880983:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262577024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269979.880999:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269979.881006:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262577408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269979.881007:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269979.881013:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.881020:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269979.881023:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.881030:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269979.881031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269979.881083:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577408 00000100:00100000:2.0:1788269979.881086:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577408 00000100:00100000:2.0:1788269979.881106:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788269979.881109:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788269979.881111:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+23:3610:x1875136262577408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269979.881114:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803780 gen 3 00010000:00010000:2.0:1788269979.881118:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269979.881126:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e07bb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07bac expref: 23 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269979.881133:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269979.881149:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+22:3610:x1875136262577408:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269979.881153:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788269979.882613:0:43789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788269979.882636:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1788269979.882938:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269979.882946:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269979.882949:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788269979.882951:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788269979.882976:0:42615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.882983:0:42615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269979.882994:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.883001:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf600/0xc5f5d7a016e0737f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07386 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.883015:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269979.883018:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269979.883021:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269979.883026:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262577664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269979.883081:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269979.883118:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262577408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269979.883146:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262577536:0@lo:39:umount.0 00000100:00080000:0.0:1788269979.883154:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788269979.883158:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 3 00000004:00080000:0.0:1788269979.883168:0:43789:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788269979.883291:0:43789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788269979.883302:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c275d9d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788269979.883310:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788269979.883311:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803781 gen 3 00000004:00080000:0.0:1788269979.883318:0:43789:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788269979.883423:0:43789:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788269979.883431:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c247f7c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788269979.883466:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98c276b6b370) has no exports 00000100:00100000:3.0:1788269979.883777:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577664 00000100:00100000:3.0:1788269979.883783:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577664 00000100:00100000:3.0:1788269979.883837:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269979.883846:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+22:3610:x1875136262577664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269979.883857:0:40061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269979.883870:0:40061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57800/0xc5f5d7a016e07386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0737f expref: 22 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.883881:0:40061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269979.883921:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e129e33-0062-408b-ba53-2e2ae2985734+21:3610:x1875136262577664:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269979.883928:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269979.884096:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262577152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269979.884136:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269979.884171:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269979.884178:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262577280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269979.884199:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269979.884222:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269979.884273:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577152 00000100:00100000:3.0:1788269979.884278:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577152 00000100:00100000:3.0:1788269979.884309:0:40062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577280 00000100:00100000:3.0:1788269979.884312:0:40062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577280 00000100:00100000:3.0:1788269979.884333:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269979.884340:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+22:3607:x1875136262577152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269979.884347:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269979.884357:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57c00/0xc5f5d7a016e07394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0738d expref: 22 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.884366:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269979.884395:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+21:3607:x1875136262577152:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269979.884402:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269979.884415:0:40062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269979.884421:0:40062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+20:3607:x1875136262577280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269979.884430:0:40062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269979.884440:0:40062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b677800/0xc5f5d7a016e076dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e076d5 expref: 20 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269979.884450:0:40062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269979.884471:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269979.884481:0:40062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e129e33-0062-408b-ba53-2e2ae2985734+19:3607:x1875136262577280:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269979.884488:0:40062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788269979.884504:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262577792:0@lo:9:umount.0 00000100:00100000:3.0:1788269979.884524:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262577280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269979.884535:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269979.884537:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e129e33-0062-408b-ba53-2e2ae2985734:3607:1875136262577152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269979.884564:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262577920:0@lo:9:umount.0 00000100:00100000:2.0:1788269979.884585:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269979.884962:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577792 00000100:00100000:3.0:1788269979.884966:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577792 00000100:00100000:3.0:1788269979.885008:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577920 00000100:00100000:3.0:1788269979.885011:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577920 00000100:00100000:3.0:1788269979.885030:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269979.885059:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875136262577792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269979.885081:0:41579:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e076e3 00000100:00080000:3.0:1788269979.885089:0:41579:0:(import.c:65:import_set_state_nolock()) ffff98c245cfe800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269979.885125:0:41579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803791 00000100:00100000:3.0:1788269979.885240:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3606:x1875136262577792:12345-0@lo:9:umount.0 Request processed in 204us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269979.885247:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269979.885259:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269979.885265:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875136262577920:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269979.885276:0:41579:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e076ea 00000100:00080000:3.0:1788269979.885281:0:41579:0:(import.c:65:import_set_state_nolock()) ffff98c245cfd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269979.885303:0:41579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803788 00000100:00100000:3.0:1788269979.885377:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3606:x1875136262577920:12345-0@lo:9:umount.0 Request processed in 112us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269979.885384:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1788269979.885401:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269979.885595:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269979.885797:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262577536 00000100:00100000:2.0:1788269979.885802:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262577536 00000100:00100000:2.0:1788269979.885832:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788269979.885839:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875136262577536:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788269979.885857:0:40815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07585 00000100:00080000:2.0:1788269979.885862:0:40815:0:(import.c:65:import_set_state_nolock()) ffff98c27b7a8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269979.885880:0:40815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803847 00000100:00100000:2.0:1788269979.886004:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3606:x1875136262577536:12345-0@lo:39:umount.0 Request processed in 164us (1532us total) trans 25769803848 rc 0/0 00000100:00100000:2.0:1788269979.886012:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:2.0:1788269979.886050:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269979.886075:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e129e33-0062-408b-ba53-2e2ae2985734:3610:1875136262577664:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788269979.886096:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788269979.886107:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788269979.886108:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269979.886111:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262577792:0@lo:9:umount.0 00000100:00080000:2.0:1788269979.886118:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c247f7c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788269979.886127:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788269979.886130:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269979.886132:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262577920:0@lo:9:umount.0 00000100:00080000:2.0:1788269979.886146:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143a5f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788269979.886150:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262577536:0@lo:39:umount.0 00000001:00100000:3.0:1788269979.887163:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269979.887169:0:42392:0:(genops.c:885:class_export_put()) final put ffff98c245cfa000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788269979.887228:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00000020:00000080:3.0:1788269979.887231:0:42392:0:(genops.c:885:class_export_put()) final put ffff98c1437df800/41dd69ed-5790-4cb1-adef-18c6baaffed2 00000020:00000080:2.0:1788269979.887249:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cfa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788269979.887286:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c245cfd800 for lustre-OST0001 00000001:00080000:3.0:1788269979.887349:0:42392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803788 is committed 00000001:00100000:3.0:1788269979.887875:0:40807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788269979.887881:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803848 is committed 00000020:00000080:3.0:1788269979.887884:0:40807:0:(genops.c:885:class_export_put()) final put ffff98c27b7ae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269979.887931:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1437df800/41dd69ed-5790-4cb1-adef-18c6baaffed2 for lustre-OST0001 00000020:00000080:2.0:1788269979.887955:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1437dc000 for lustre-OST0001 00000020:00000080:0.0:1788269979.888888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b7ae000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:3.0:1788269979.888906:0:40807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00080000:3.0:1788269979.888914:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803847 is committed 00000020:00000080:3.0:1788269979.888918:0:40807:0:(genops.c:885:class_export_put()) final put ffff98c276998000/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:3.0:1788269979.888926:0:40807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00000001:00080000:3.0:1788269979.888933:0:40807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803846 is committed 00000020:00000080:3.0:1788269979.888941:0:40807:0:(genops.c:885:class_export_put()) final put ffff98c142bd3800/41dd69ed-5790-4cb1-adef-18c6baaffed2 00000020:00080000:3.0:1788269979.888951:0:40807:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 21474836518 batchid updated 00000020:00000080:0.0:1788269979.888952:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b7a8000 for lustre-MDT0001 00000020:00000080:0.0:1788269979.888959:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c276998000/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 for lustre-MDT0001 00000020:00000080:0.0:1788269979.888987:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c142bd3800/41dd69ed-5790-4cb1-adef-18c6baaffed2 for lustre-MDT0001 00000020:00080000:2.0:1788269979.889008:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836518 00000020:00000080:0.0:1788269979.889014:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27699d800 for lustre-MDT0001 00000020:00000080:0.0:1788269979.889022:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143557000 for lustre-MDT0001 00000020:00080000:2.0:1788269979.889025:0:40831:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836518 00000100:00080000:0.0:1788269979.889071:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269979.889076:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269979.904128:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269979.904137:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269979.904140:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788269979.914787:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98c276b6b370) has no exports 00000020:00000080:1.0:1788269979.942233:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073da 00000020:00000080:1.0:1788269979.942248:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c275d98000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788269979.942310:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788269979.942383:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275d98000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788269979.942695:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269979.942703:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788269979.942707:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff98c2759d3370) has no exports 00000020:00000080:0.0:1788269979.944882:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073d3 00000020:00000080:0.0:1788269979.944893:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c27a609800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788269979.944941:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27a609800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788269979.944964:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269979.944975:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788269979.944978:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c27a60d000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788269979.944981:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27a60d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788269979.944989:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788269980.358768:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269980.804248:0:40828:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788269980.804257:0:40828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269980.804278:0:40828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 2 count 2 00000040:00080000:1.0:1788269980.804286:0:40828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788269981.380200:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269982.404245:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269982.404269:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262578048:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788269982.404292:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269982.404341:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269982.404408:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578048 00000100:00100000:2.0:1788269982.404416:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578048 00000100:00100000:2.0:1788269982.404476:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788269982.404483:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269982.404489:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262578048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788269982.404519:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788269982.404577:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262578048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269982.404584:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269982.404694:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803788 gen 2 00000004:00080000:0.0:1788269982.404701:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14262c700, transno 25769803788 00000100:00100000:0.0:1788269982.404723:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262578048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788269982.405221:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262578176:0@lo:400:kworker.0 00000100:00100000:0.0:1788269982.405260:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269982.405273:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262578560:0@lo:400:kworker.0 00000100:00100000:0.0:1788269982.405304:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262578688:0@lo:400:kworker.0 00000100:00100000:3.0:1788269982.405313:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269982.405339:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269982.405342:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262579072:0@lo:400:kworker.0 00000100:00100000:3.0:1788269982.405373:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269982.405420:0:40068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578176 00000100:00100000:1.0:1788269982.405426:0:40068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578176 00000100:00100000:2.0:1788269982.405463:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262578304:0@lo:400:kworker.0 00000100:00100000:1.0:1788269982.405468:0:40068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788269982.405478:0:40068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25e93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+19:3608:x1875136262578176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.405499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269982.405524:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262578816:0@lo:400:kworker.0 00000100:00100000:1.0:1788269982.405545:0:40068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25e93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e129e33-0062-408b-ba53-2e2ae2985734+19:3608:x1875136262578176:12345-0@lo:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269982.405554:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269982.405558:0:40068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788269982.405599:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262578176:0@lo:400:kworker.0 00000100:00100000:1.0:1788269982.405652:0:40079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578304 00000100:00100000:1.0:1788269982.405657:0:40079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578304 00000100:00100000:1.0:1788269982.405680:0:40079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788269982.405686:0:40079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3609:x1875136262578304:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788269982.405692:0:40079:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788269982.405721:0:40079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3609:x1875136262578304:12345-0@lo:400:kworker.0 Request processed in 34us (223us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788269982.405727:0:40079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788269982.406005:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578560 00000100:00100000:0.0:1788269982.406010:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578560 00000100:00100000:0.0:1788269982.406036:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578688 00000100:00100000:0.0:1788269982.406062:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578688 00000100:00100000:0.0:1788269982.406079:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579072 00000100:00100000:0.0:1788269982.406081:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579072 00000100:00100000:0.0:1788269982.406103:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788269982.406109:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262579072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269982.406148:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262579072:12345-0@lo:400:kworker.0 Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269982.406154:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788269982.406167:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788269982.406171:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3607:x1875136262578560:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788269982.406176:0:42351:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788269982.406199:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3607:x1875136262578560:12345-0@lo:400:kworker.0 Request processed in 26us (886us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788269982.406205:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788269982.406216:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788269982.406219:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3608:x1875136262578688:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788269982.406223:0:42351:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788269982.406250:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3608:x1875136262578688:12345-0@lo:400:kworker.0 Request processed in 29us (912us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788269982.406257:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788269982.406278:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788269982.406298:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788269982.406303:0:3607:0:(import.c:65:import_set_state_nolock()) ffff98c24b007800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788269982.406307:0:3607:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788269982.411924:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788269982.411933:0:3609:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788269982.411938:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788269982.411945:0:3609:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269982.411949:0:3609:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 719 00000100:00080000:2.0:1788269982.411957:0:3609:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98c2458b7000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788269982.411991:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27a620e00 x1875136262579200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269982.412015:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262578304:0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.412029:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788269982.412055:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262578432:0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.412109:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269982.412130:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262578944:0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.412157:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269982.412209:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578816 00000100:00100000:2.0:1788269982.412216:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578816 00000100:00100000:2.0:1788269982.412271:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578944 00000100:00100000:2.0:1788269982.412275:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578944 00000100:00100000:2.0:1788269982.412291:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788269982.412298:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262578816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.412348:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262578816:12345-0@lo:400:kworker.0 Request processed in 50us (6795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269982.412355:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788269982.412372:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788269982.412377:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3609:x1875136262578944:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788269982.412382:0:40074:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788269982.412407:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3609:x1875136262578944:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788269982.412412:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788269982.412431:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788269982.412448:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788269982.412450:0:3609:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788269982.412453:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788269982.412458:0:3609:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269982.412461:0:3609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 736 00000100:00080000:2.0:1788269982.412465:0:3609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c143555800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788269982.412478:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14409aa00 x1875136262579328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269982.412489:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262578944:0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.412503:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262578816:0@lo:400:kworker.0 00000100:00100000:2.0:1788269982.412521:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262579200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788269982.412548:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269982.412566:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262579328:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788269982.412584:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269982.412612:0:40080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579200 00000100:00100000:2.0:1788269982.412616:0:40080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579200 00000100:00100000:2.0:1788269982.412650:0:40080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788269982.412655:0:40080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1875136262579200:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788269982.412672:0:40080:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788269982.412846:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579328 00000100:00100000:3.0:1788269982.412851:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579328 00000100:00100000:3.0:1788269982.412877:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788269982.412882:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262579328:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788269982.412891:0:40075:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788269982.412939:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262579328:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 46us (343us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269982.412946:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788269982.412977:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269982.412981:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269982.412984:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262579328:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788269982.413034:0:41578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262578432 00000100:00100000:3.0:1788269982.413053:0:41578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262578432 00000100:00100000:3.0:1788269982.413100:0:41578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788269982.413109:0:41578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262578432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269982.413156:0:41578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262578432:12345-0@lo:400:kworker.0 Request processed in 50us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269982.413162:0:41578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788269982.413493:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269982.413520:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262578432:0@lo:400:kworker.0 00000100:00080000:3.0:1788269982.413561:0:3608:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269982.413565:0:3608:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788269982.413568:0:3608:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788269982.413572:0:3608:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269982.413576:0:3608:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 728 00000100:00080000:3.0:1788269982.413580:0:3608:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c143553800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269982.413598:0:3608:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c265e72300 x1875136262579456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269982.413614:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262578688:0@lo:400:kworker.0 00000100:00100000:3.0:1788269982.413642:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262579456:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788269982.413669:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269982.413697:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579456 00000100:00100000:3.0:1788269982.413701:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579456 00000100:00100000:3.0:1788269982.413726:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788269982.413730:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262579456:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788269982.413739:0:40075:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788269982.413776:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262579456:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (106us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269982.413783:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788269982.413807:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269982.413811:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269982.413814:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262579456:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788269982.422421:0:3607:0:(import.c:65:import_set_state_nolock()) ffff98c24b007800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269982.422432:0:3607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 719 00000100:00080000:0.0:1788269982.422441:0:3607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c24b007800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269982.422484:0:3607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1448f1880 x1875136262579584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269982.422660:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262579584:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788269982.422727:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269982.422792:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262578560:0@lo:400:kworker.0 00000100:00100000:1.0:1788269982.422818:0:40076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579584 00000100:00100000:0.0:1788269982.422824:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262579072:0@lo:400:kworker.0 00000100:00100000:1.0:1788269982.422826:0:40076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579584 00000100:00100000:0.0:1788269982.422870:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788269982.422878:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3606:x1875136262579584:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788269982.422895:0:42351:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788269982.422980:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3606:x1875136262579584:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 101us (252us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788269982.422987:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1788269982.423117:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c24b007800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269982.423122:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269982.423125:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262579584:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788269982.425589:0:40080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1875136262579200:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 12923us (13031us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788269982.425602:0:40080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788269982.426012:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269982.426018:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269982.426022:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262579200:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788269983.428341:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269984.452338:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788269984.453669:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269984.453676:0:41574:0:(genops.c:885:class_export_put()) final put ffff98c245cff800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788269984.453678:0:40055:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788269984.453684:0:40055:0:(genops.c:885:class_export_put()) final put ffff98c27f621800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788269984.453793:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000020:00000080:2.0:1788269984.453797:0:41574:0:(genops.c:885:class_export_put()) final put ffff98c27699f800/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:0.0:1788269984.453802:0:40055:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000001:00100000:2.0:1788269984.453803:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41dd69ed-5790-4cb1-adef-18c6baaffed2 00000020:00000080:2.0:1788269984.453805:0:41574:0:(genops.c:885:class_export_put()) final put ffff98c1435b1800/41dd69ed-5790-4cb1-adef-18c6baaffed2 00000001:00080000:0.0:1788269984.453809:0:40055:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803835 is committed 00000020:00000080:0.0:1788269984.453813:0:40055:0:(genops.c:885:class_export_put()) final put ffff98c276998800/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 00000020:00000080:1.0:1788269984.453844:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788269984.453890:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f621800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788269984.453921:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27699f800/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 for lustre-OST0000 00000020:00000080:1.0:1788269984.453946:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b1800/41dd69ed-5790-4cb1-adef-18c6baaffed2 for lustre-OST0000 00000020:00000080:1.0:1788269984.453964:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c276998800/0c97af8c-d97a-48dd-9f8f-2f83c7b756c7 for lustre-MDT0000 00000020:00000080:1.0:1788269984.453989:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c245cfe800 for lustre-OST0000 00000020:00000080:1.0:1788269984.453993:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27f622000 for lustre-MDT0000 00000020:00000080:1.0:1788269984.453996:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27699c000 for lustre-OST0000 00000020:00000080:1.0:1788269984.453999:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1435b6800 for lustre-OST0000 00000020:00000080:1.0:1788269984.454002:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27699a000 for lustre-MDT0000 00000100:00100000:3.0:1788269984.964210:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262579712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788269984.964288:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269984.964384:0:41581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579712 00000100:00100000:3.0:1788269984.964393:0:41581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579712 00000100:00100000:3.0:1788269984.964465:0:41581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788269984.964475:0:41581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262579712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788269984.964501:0:41581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923496960 avail 3691974656 00000100:00080000:2.0:1788269984.964514:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269984.964555:0:41581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262579712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269984.964563:0:41581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269984.964644:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262579712:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788269985.476531:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788269985.988158:0:43789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27a157ae0 - data ffff98c2723c3798/ffff98c144129800 00000020:01000000:1.0:1788269985.989400:0:43789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c1440edba0 - data ffff98c272099510/ffff98c277c20c00 00000001:00000004:1.0:1788269985.998377:0:43789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803835 00000100:00080000:0.0:1788269986.040604:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788269986.040614:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803780 gen 4 00000100:00100000:0.0:1788269986.040630:0:43789:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98c1448f2a00 x1875136262577536/t25769803848(25769803848) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788269989 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269986.040653:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788269986.045744:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788269986.045753:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 4 00000004:00080000:0.0:1788269986.045778:0:43789:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788269986.045781:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788269986.047012:0:40098:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788269986.047019:0:40098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 1 00000040:00080000:2.0:1788269986.047033:0:40098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:0.0:1788269986.047519:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788269986.047524:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803781 gen 4 00000004:00080000:0.0:1788269986.047545:0:43789:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788269986.047548:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788269986.048112:0:40100:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788269986.048117:0:40100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x22:0x0] index 2 count 1 00000040:00080000:2.0:1788269986.048125:0:40100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:0.0:1788269986.048927:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073a2 00000020:00000080:0.0:1788269986.048945:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c145156800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788269986.050511:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c145156800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788269986.051304:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073b7 00000020:00000080:3.0:1788269986.051312:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c275a8f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269986.051365:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788269986.051370:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269986.051377:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788269986.051381:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98c276b699b8) has no exports 00000004:01000000:3.0:1788269986.051692:0:43789:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788269986.051700:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07419 00000020:00000080:3.0:1788269986.051705:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c24af8f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269986.051797:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275a8f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788269986.052580:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788269986.052585:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269986.052591:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269986.052594:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98c1438ab370) has no exports 00000020:00000080:3.0:1788269986.052601:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07412 00000020:00000080:3.0:1788269986.052606:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c247f7b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269986.052627:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24af8f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788269986.053661:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c247f7b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788269986.054398:0:43789:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788269986.054404:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788269986.054408:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803781 gen 5 00000004:00080000:3.0:1788269986.054415:0:43789:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269986.054417:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269986.054460:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269986.054472:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c247f7c000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788269986.054674:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269986.054679:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c247f7e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269986.054683:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c247f7e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788269986.054689:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269986.054771:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07404 00000020:00000080:3.0:1788269986.054777:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c247f7a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269986.054791:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788269986.054794:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269986.054799:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269986.054802:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98c2759d19b8) has no exports 00000020:00000080:3.0:1788269986.054808:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073fd 00000020:00000080:3.0:1788269986.054811:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c275d9b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269986.054922:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c247f7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788269986.054930:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275d9b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788269986.055148:0:43789:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788269986.055151:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788269986.055154:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 5 00000004:00080000:3.0:1788269986.055157:0:43789:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269986.055159:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788269986.055264:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c275d9d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788269986.055426:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269986.055432:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269986.055435:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c143a59000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269986.055438:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143a59000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788269986.055441:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788269986.055832:0:43789:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788269986.055840:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073ef 00000020:00000080:3.0:1788269986.055845:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c143a58000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788269986.055894:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788269986.055898:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269986.055903:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788269986.055907:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff98c1438a99b8) has no exports 00000020:00000080:3.0:1788269986.055911:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073e8 00000020:00000080:3.0:1788269986.055915:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c143a5d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269986.056926:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143a58000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788269986.062748:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143a5d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788269986.062982:0:43789:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788269986.062988:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788269986.062992:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803780 gen 5 00000100:00100000:2.0:1788269986.062999:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788269986.063053:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269986.063063:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788269986.063091:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269986.063094:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788269986.063099:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c248241800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269986.063102:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c248241800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788269986.063107:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788269986.063200:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073be 00000020:00000080:2.0:1788269986.063207:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c275a8c000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788269986.063211:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788269986.063215:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269986.063219:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788269986.063222:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff98c276b68000) has no exports 00000020:00000080:2.0:1788269986.063254:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269986.063258:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788269986.063263:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e073c5 00000020:00000080:2.0:1788269986.063267:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c275a88000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788269986.063274:0:43789:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c145155800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788269986.063277:0:43789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c145155800 3 00000020:01000004:2.0:1788269986.063279:0:43789:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c145155800 from lustre-MDT0000 00000020:00000080:2.0:1788269986.063294:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269986.063297:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788269986.063299:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c248241000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788269986.063301:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c248241000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788269986.063307:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788269986.063334:0:43789:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788269986.063338:0:43789:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788269986.063340:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788269986.063343:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269986.063345:0:43789:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788269986.063351:0:43789:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff98c245898000 8e129e33-0062-408b-ba53-2e2ae2985734 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788269986.063356:0:43789:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff98c275d84d28) has exports, disconnecting them 00000020:00080000:2.0:1788269986.063361:0:43789:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98c245898000), last request at 1788269920 00000020:00000080:2.0:1788269986.063374:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0736a 00000020:00010000:2.0:1788269986.063377:0:43789:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c245898000: total 2 00000100:00080000:2.0:1788269986.063380:0:43789:0:(import.c:65:import_set_state_nolock()) ffff98c24589a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788269986.063393:0:43789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c245898000): rc 0 00000020:00080000:2.0:1788269986.063396:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff98c275d84d28) has no exports 00000100:00100000:2.0:1788269986.063462:0:40069:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98c245c4c200:40069] 1 exiting: rc = 0 00000020:00010000:2.0:1788269986.063546:0:42615:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c245898000: total 2 00010000:00010000:2.0:1788269986.063580:0:42615:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c245898000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788269986.063610:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418f800/0xc5f5d7a016e075cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e075c4 expref: 14 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063627:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c24a9ef400/0xc5f5d7a016e07ba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07b9e expref: 13 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063641:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c24a9efc00/0xc5f5d7a016e07b97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07b90 expref: 12 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063652:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0be600/0xc5f5d7a016e07489 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07482 expref: 11 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063665:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418ec00/0xc5f5d7a016e075f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e075ee expref: 10 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063675:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0be000/0xc5f5d7a016e07546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0753f expref: 9 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063858:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c14418ea00/0xc5f5d7a016e07497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07490 expref: 8 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063873:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0be400/0xc5f5d7a016e074a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0749e expref: 7 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063883:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b676000/0xc5f5d7a016e07378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07371 expref: 6 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063892:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27a0bfe00/0xc5f5d7a016e07665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0765e expref: 5 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063901:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e07b89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07b82 expref: 4 pid: 40068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063922:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c275b57000/0xc5f5d7a016e0768f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e07688 expref: 3 pid: 40069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063938:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27b677c00/0xc5f5d7a016e076ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e076c7 expref: 2 pid: 40070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269986.063948:0:42615:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c245898000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788269986.063963:0:42615:0:(genops.c:885:class_export_put()) final put ffff98c245898000/8e129e33-0062-408b-ba53-2e2ae2985734 00010000:00010000:2.0:1788269986.063968:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269986.063970:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269986.063972:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269986.064004:0:40070:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98c25e94ca00:40070] 2 exiting: rc = 0 00000020:00000080:0.0:1788269986.064172:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143a5f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788269986.064186:0:466:0:(genops.c:885:class_export_put()) final put ffff98c143a5e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269986.064188:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143a5e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788269986.064195:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788269986.064249:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275a8c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788269986.064253:0:466:0:(genops.c:885:class_export_put()) final put ffff98c275a8d800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788269986.064255:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275a8d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788269986.064260:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788269986.064285:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275a88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788269986.064290:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245898000/8e129e33-0062-408b-ba53-2e2ae2985734 for MGS 00000020:00000080:0.0:1788269986.064321:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24589a800 for MGS 00000100:00100000:1.0:1788269986.065946:0:40068:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98c25e94de00:40068] 0 exiting: rc = 1 00000100:00100000:2.0:1788269986.066056:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066065:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066074:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066080:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066085:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066091:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066097:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066104:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066109:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066115:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066120:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066126:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066132:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066138:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066143:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066148:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066153:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066158:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066163:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066168:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066173:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066179:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066185:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066191:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066196:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066202:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066208:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066213:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066218:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066225:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066231:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066236:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066243:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066249:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066254:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066259:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066265:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066270:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066285:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066291:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066296:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066302:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066306:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066311:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066316:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066321:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066327:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066332:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066337:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066343:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066347:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066352:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066357:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066363:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066368:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066373:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066378:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066383:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066388:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066395:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066401:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066406:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066411:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269986.066416:0:43789:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788269986.067873:0:43789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27b387cc0 - data ffff98c2721ec1b0/ffff98c271e1ec00 00000020:01000000:2.0:1788269986.067981:0:43789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c143af08a0 - data ffff98c272048510/ffff98c26abfc400 00000020:00000080:2.0:1788269986.068415:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0734e 00000020:00000080:2.0:1788269986.068424:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c145157000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788269986.068440:0:43789:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c145155800 from MGS, refs=2 00000020:01000004:2.0:1788269986.068443:0:43789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c145155800 2 00000020:01000004:2.0:1788269986.068446:0:43789:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c145155800 from MGS 00000020:00000080:2.0:1788269986.068466:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269986.068472:0:43789:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788269986.068474:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c145151800/MGS 00000020:00000080:2.0:1788269986.068477:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c145151800/MGS for MGS 00000020:01000000:2.0:1788269986.068483:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788269986.068543:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788269986.068548:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269986.068553:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788269986.068559:0:43789:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98c24af89800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788269986.068565:0:43789:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff98c2759d4d28) has exports, disconnecting them 00000020:00080000:2.0:1788269986.068579:0:43789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98c24af89800), last request at 1788269921 00000020:00000080:2.0:1788269986.068584:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07451 00000020:00080000:2.0:1788269986.068592:0:43789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c24af89800): rc 0 00000020:00000080:2.0:1788269986.068596:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c24af89800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788269986.069275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c145157000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788269986.069284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24af89800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788269986.073098:0:43789:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788269986.073110:0:43789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788269986.073115:0:43789:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788269986.073124:0:43789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788269986.073157:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c2491eb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788269986.073370:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269986.073449:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788269986.073456:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c24af8e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788269986.073462:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24af8e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788269986.073468:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788269986.073562:0:43789:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c145155800 1 00000020:00000080:0.0:1788269986.073576:0:43789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07340 00000020:00000080:0.0:1788269986.073581:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c145154800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788269986.073590:0:43789:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788269986.073601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c145154800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788269986.073610:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269986.073614:0:43789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788269986.073620:0:43789:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98c275d819b8) has no exports 00000020:00000080:0.0:1788269986.102754:0:43789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269986.102767:0:43789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788269986.102773:0:43789:0:(genops.c:885:class_export_put()) final put ffff98c145155000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269986.102777:0:43789:0:(genops.c:844:class_export_destroy()) destroying export ffff98c145155000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788269986.102788:0:43789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788269986.102899:0:43789:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c145150800 00000020:02000400:0.0:1788269986.102953:0:43789:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788269986.501072:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269987.524126:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269987.526356:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269987.526362:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788269987.526366:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269987.526375:0:466:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 774 00000100:00080000:0.0:1788269987.526380:0:466:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788269987.526387:0:466:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98c2458b7000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269987.526412:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1448f1f80 x1875136262579968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269987.526468:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269987.526472:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788269987.526473:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c24b007800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269987.526477:0:466:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 774 00000100:00080000:0.0:1788269987.526480:0:466:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788269987.526483:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262580352:0@lo:400:kworker.0 00000100:00080000:0.0:1788269987.526486:0:466:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c24b007800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269987.526504:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c1448f3100 x1875136262580480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269987.526514:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269987.526517:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788269987.526518:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269987.526522:0:466:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 774 00000100:00080000:0.0:1788269987.526525:0:466:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788269987.526528:0:466:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c143553800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269987.526552:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14262c700 x1875136262580608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269987.526569:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788269987.526572:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269987.526576:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788269987.526578:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269987.526582:0:466:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 774 00000100:00080000:0.0:1788269987.526585:0:466:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788269987.526589:0:466:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c143555800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269987.526602:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c276267800 x1875136262580864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269987.526621:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269987.526631:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262580224:0@lo:400:kworker.0 00000100:00100000:0.0:1788269987.526645:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262579840:0@lo:400:kworker.0 00000100:00100000:3.0:1788269987.526659:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269987.526693:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580352 00000100:00100000:3.0:1788269987.526702:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580352 00000100:00100000:3.0:1788269987.526751:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580224 00000100:00100000:3.0:1788269987.526755:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580224 00000100:00100000:3.0:1788269987.526784:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269987.526794:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262580352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269987.526847:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262580352:12345-0@lo:400:kworker.0 Request processed in 54us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269987.526855:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269987.526870:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788269987.526877:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262580224:12345-0@lo:400:kworker.0 00000400:00000100:0.0:1788269987.526944:0:3609:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136262579840 offset 0 length 224: 4 00000100:00100000:0.0:1788269987.526967:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262580736:0@lo:400:kworker.0 00000100:00100000:3.0:1788269987.527259:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262580224:12345-0@lo:400:kworker.0 Request processed in 382us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269987.527266:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788269987.527286:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269987.527289:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269987.527320:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262580224:0@lo:400:kworker.0 00000100:00100000:3.0:1788269987.527330:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262580352:0@lo:400:kworker.0 00000100:00100000:0.0:1788269987.527737:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269987.527762:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788269987.527767:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262580096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788269987.527788:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269987.527801:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262580992:0@lo:400:kworker.0 00000100:00100000:0.0:1788269987.527818:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269987.527879:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580736 00000100:00100000:3.0:1788269987.527896:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580736 00000100:00100000:3.0:1788269987.527937:0:40075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580992 00000100:00100000:3.0:1788269987.527941:0:40075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580992 00000100:00100000:0.0:1788269987.527949:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262579968:0@lo:38:kworker.0 00000100:00100000:3.0:1788269987.527971:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788269987.527980:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262580736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269987.528100:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269987.528356:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262580736:12345-0@lo:400:kworker.0 Request processed in 376us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269987.528363:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788269987.528381:0:40075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788269987.528388:0:40075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262580992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269987.528419:0:40075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262580992:12345-0@lo:400:kworker.0 Request processed in 32us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269987.528426:0:40075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788269987.528447:0:40071:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788269987.529526:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262580480:0@lo:38:kworker.0 00000100:00100000:0.0:1788269987.529577:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269987.529610:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262580608:0@lo:38:kworker.0 00000100:00100000:3.0:1788269987.529637:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580480 00000100:00100000:0.0:1788269987.529637:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269987.529645:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580480 00000100:00100000:3.0:1788269987.529671:0:42351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580608 00000100:00100000:3.0:1788269987.529674:0:42351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580608 00000100:00100000:3.0:1788269987.529689:0:42351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788269987.529695:0:42351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3606:x1875136262580480:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788269987.529714:0:42351:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788269987.529723:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262580864:0@lo:38:kworker.0 00000100:00100000:0.0:1788269987.529754:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269987.529790:0:41582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580096 00000100:00100000:0.0:1788269987.529795:0:41582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580096 00000100:00100000:0.0:1788269987.529938:0:41582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269987.529947:0:41582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262580096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788269987.529973:0:41582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1788269987.530107:0:41582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262580096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269987.530114:0:41582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269987.530203:0:40074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262580864 00000100:00100000:0.0:1788269987.530208:0:40074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262580864 00000100:00100000:0.0:1788269987.530523:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788269987.530530:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262580608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788269987.530552:0:40074:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788269987.530592:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262580608:12345-0@lo:38:kworker.0 Request processed in 60us (954us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788269987.530599:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788269987.530615:0:40074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788269987.530619:0:40074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262580864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788269987.530628:0:40074:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788269987.530651:0:40074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262580864:12345-0@lo:38:kworker.0 Request processed in 31us (897us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788269987.530656:0:40074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788269987.530688:0:40815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262579968 00000100:00100000:0.0:1788269987.530693:0:40815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262579968 00000100:00100000:0.0:1788269987.530714:0:40815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788269987.530719:0:40815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1875136262579968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788269987.530728:0:40815:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788269987.530754:0:40815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1875136262579968:12345-0@lo:38:kworker.0 Request processed in 33us (2653us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788269987.530760:0:40815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788269987.530891:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262580096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788269987.530914:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262580992:0@lo:400:kworker.0 00000100:00100000:0.0:1788269987.530928:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262580736:0@lo:400:kworker.0 00000100:00080000:0.0:1788269987.530970:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788269987.530975:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788269987.531065:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262579968:0@lo:38:kworker.0 00000100:00080000:0.0:1788269987.531079:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788269987.531082:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788269987.531085:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262580608:0@lo:38:kworker.0 00000100:00080000:0.0:1788269987.531093:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788269987.531095:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788269987.531098:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262580864:0@lo:38:kworker.0 00000100:00100000:3.0:1788269987.543238:0:42351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3606:x1875136262580480:12345-0@lo:38:kworker.0 Request processed in 13535us (13654us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269987.543252:0:42351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788269987.543389:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c24b007800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788269987.543396:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788269987.543400:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262580480:0@lo:38:kworker.0 00000020:01000004:1.0:1788269988.139375:0:43990:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788269988.155490:0:43990:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788269988.155543:0:43990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.155554:0:43990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.155563:0:43990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.155567:0:43990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.155608:0:43990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788269988.155612:0:43990:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788269988.155633:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269988.155637:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788269988.155642:0:43990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788269988.155648:0:43990:0:(import.c:65:import_set_state_nolock()) ffff98c24b007800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788269988.155652:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269988.155654:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269988.155657:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788269988.156568:0:43990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.156579:0:43990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.156586:0:43990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.156592:0:43990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.156732:0:43990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269988.156794:0:43990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.156803:0:43990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.156808:0:43990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.156814:0:43990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269988.156870:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788269988.156893:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269988.156900:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.156912:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269988.156916:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.156925:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269988.156932:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269988.156938:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269988.156940:0:40064:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788269988.156969:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.156976:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269988.157005:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.157012:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677400/0xc5f5d7a016e0749e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e074a5 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.157025:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269988.157028:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.157033:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788269988.157186:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.157199:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269988.157205:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269988.157211:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269988.157213:0:40064:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788269988.157225:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.157231:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269988.157237:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269988.157244:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269988.157246:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269988.157248:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269988.157265:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262581248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269988.157329:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269988.157376:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269988.157381:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262581120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269988.157405:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269988.157434:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262581248 00000100:00100000:3.0:1788269988.157441:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262581248 00000100:00100000:3.0:1788269988.157471:0:43117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262581120 00000100:00100000:3.0:1788269988.157474:0:43117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262581120 00000100:00100000:3.0:1788269988.157491:0:43117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269988.157498:0:43117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3608:x1875136262581248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788269988.157505:0:43117:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269988 with bad export cookie 14264544477344461674 00010000:00010000:0.0:1788269988.157753:0:43990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788269988.157760:0:43990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0bf400/0xc5f5d7a016e076c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e076ce expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.157765:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788269988.157776:0:43990:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788269988.157786:0:43990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157793:0:43990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157799:0:43990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157805:0:43990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157821:0:43990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269988.157826:0:43990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157834:0:43990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.157840:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269988.157841:0:43990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.157848:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157851:0:43990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.157864:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269988.157869:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.157874:0:43990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269988.157878:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269988.157880:0:43990:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788269988.157885:0:43990:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:00010000:1.0:1788269988.157891:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269988.157897:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788269988.157899:0:40064:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788269988.157902:0:40064:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000004:0.0:1788269988.157913:0:43990:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788269988.157919:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:1.0:1788269988.157922:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788269988.157925:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788269988.157932:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788269988.157933:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788269988.157941:0:43990:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff98c1435b5000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788269988.157947:0:43990:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff98c143792000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788269988.157950:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788269988.157952:0:43990:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff98c248a2b370) has exports, disconnecting them 00000020:00080000:0.0:1788269988.157959:0:43990:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98c1435b5000), last request at 1788269987 00000020:00000080:0.0:1788269988.157966:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e076b9 00010000:00010000:1.0:1788269988.157974:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9fc00/0xc5f5d7a016e07b9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07ba5 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788269988.157981:0:43990:0:(import.c:65:import_set_state_nolock()) ffff98c1435b0800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788269988.157985:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269988.157989:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.158000:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788269988.158003:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.158010:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269988.158016:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269988.158021:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:0.0:1788269988.158024:0:43990:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c1435b5000): rc 0 10000000:01000000:1.0:1788269988.158025:0:40064:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788269988.158030:0:40064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:0.0:1788269988.158030:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c1435b5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788269988.158067:0:43990:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98c143792000), last request at 1788269987 00010000:00010000:1.0:1788269988.158068:0:40064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788269988.158073:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0761f 00010000:00010000:1.0:1788269988.158078:0:40064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788269988.158082:0:43990:0:(import.c:65:import_set_state_nolock()) ffff98c143790000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788269988.158091:0:43990:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143792000): rc 0 00000020:00000080:0.0:1788269988.158093:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c143792000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1788269988.158095:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1788269988.158100:0:43990:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffad6581c97ae0 00010000:00010000:1.0:1788269988.158105:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677000/0xc5f5d7a016e07490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07497 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269988.158118:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269988.158120:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269988.158120:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788269988.158124:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269988.158137:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262581376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269988.158166:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269988.158168:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803831 gen 3 00000100:00100000:1.0:1788269988.158186:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269988.158192:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262581504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269988.158221:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269988.158241:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269988.158289:0:43990:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269988.158300:0:43990:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788269988.158336:0:43990:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788269988.158361:0:43990:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788269988.158367:0:43990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26ab5d000/0xc5f5d7a016e07e5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0xc5f5d7a016e07e61 expref: -99 pid: 41798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788269988.158993:0:43990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788269988.158999:0:43990:0:(import.c:65:import_set_state_nolock()) ffff98c2458b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1788269988.159068:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c1435b5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788269988.159111:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143792000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00010000:00010000:2.0:1788269988.159240:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269988.159254:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788269988.159258:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269988.159265:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269988.159271:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269988.159276:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788269988.159279:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788269988.159281:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788269988.159399:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262581376 00000100:00100000:2.0:1788269988.159406:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262581376 00000100:00100000:2.0:1788269988.159426:0:40061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262581504 00000100:00100000:2.0:1788269988.159428:0:40061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262581504 00000100:00100000:2.0:1788269988.159441:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269988.159448:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3608:x1875136262581120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788269988.159453:0:40061:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269988 with bad export cookie 14264544477344461674 00000100:00100000:2.0:1788269988.159506:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3608:x1875136262581120:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (2100us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788269988.159511:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269988.159523:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788269988.159525:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3609:x1875136262581376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788269988.159528:0:40061:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269988 with bad export cookie 14264544477344461674 00000100:00100000:2.0:1788269988.159567:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3609:x1875136262581376:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (1400us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788269988.159574:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788269988.159587:0:40061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788269988.159591:0:40061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3609:x1875136262581504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788269988.159594:0:40061:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269988 with bad export cookie 14264544477344461674 00000100:00100000:2.0:1788269988.159618:0:40061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3609:x1875136262581504:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1408us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788269988.159623:0:40061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788269988.159651:0:3608:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788269988.159655:0:3608:0:(import.c:65:import_set_state_nolock()) ffff98c248242000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788269988.159658:0:3608:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788269988.159673:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:0.0:1788269988.159757:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c1435b0800 for lustre-MDT0001 00000020:00000080:0.0:1788269988.159761:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143790000 for lustre-MDT0001 00000100:00100000:3.0:1788269988.163335:0:43117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3608:x1875136262581248:12345-0@lo:103:ldlm_bl.0 Request processed in 5831us (6001us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269988.163347:0:43117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788269988.165141:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788269988.165147:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 25769803790 gen 3 00000004:00080000:3.0:1788269988.165161:0:43990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788269988.165252:0:43990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788269988.165276:0:43990:0:(import.c:65:import_set_state_nolock()) ffff98c27c81c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788269988.165291:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788269988.165293:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803788 gen 3 00000004:00080000:3.0:1788269988.165301:0:43990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788269988.166510:0:43990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788269988.166530:0:43990:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788269988.166579:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98c248a2b370) has no exports 00000100:00080000:2.0:1788269988.172263:0:3608:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.142@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788269988.172269:0:3608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788269988.172278:0:3608:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c1448f2a00 x1875136262579840/t0(0) o400->MGC192.168.201.142@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788270003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269988.172292:0:3608:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c271ff9f80 x1875136262581248/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788270004 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269988.172301:0:3608:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c271ff8380 x1875136262581120/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788270004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269988.172310:0:3608:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c27fb70e00 x1875136262581376/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788270004 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269988.172317:0:3608:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c27fb72a00 x1875136262581504/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788270004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788269988.172330:0:3608:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788269988.172333:0:3608:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788269988.172334:0:3608:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788269988.172338:0:3608:0:(import.c:65:import_set_state_nolock()) ffff98c248242000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269988.172343:0:3608:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 712 00000100:00080000:2.0:1788269988.172352:0:3608:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff98c248242000 using connection 192.168.201.142@tcp/0@lo 00000100:00080000:1.0:1788269988.172352:0:3609:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98c248242000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788269988.172591:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262581376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269988.173207:0:42615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.173217:0:42615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269988.173244:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.173252:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677200/0xc5f5d7a016e0753f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e07546 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269988.173271:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269988.173273:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269988.173275:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269988.173292:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262581632:0@lo:9:umount.0 00000100:00100000:2.0:1788269988.173299:0:3608:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14409aa00 x1875136262582016/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269988.173317:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262581248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269988.173337:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:3608:1875136262581120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269988.173347:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269988.173375:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269988.173379:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262581760:0@lo:9:umount.0 00000100:00100000:2.0:1788269988.173381:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e129e33-0062-408b-ba53-2e2ae2985734:0:1875136262581888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269988.173402:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269988.173422:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e129e33-0062-408b-ba53-2e2ae2985734:3606:1875136262582016:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:3.0:1788269988.173425:0:42623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262581632 00000100:00100000:3.0:1788269988.173435:0:42623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262581632 00000400:00000100:0.0:1788269988.173439:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136262582016 offset 0 length 520: 4 00000100:00100000:0.0:1788269988.173473:0:41579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262581760 00000100:00100000:0.0:1788269988.173478:0:41579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262581760 00000100:00100000:3.0:1788269988.173488:0:42623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788269988.173500:0:42623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875136262581632:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788269988.173509:0:41579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788269988.173517:0:41579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875136262581760:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269988.173525:0:42623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07649 00000100:00080000:3.0:1788269988.173543:0:42623:0:(import.c:65:import_set_state_nolock()) ffff98c27b8e2800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788269988.173547:0:41579:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e076f1 00000100:00080000:0.0:1788269988.173556:0:41579:0:(import.c:65:import_set_state_nolock()) ffff98c14379c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269988.173599:0:42623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803791 00000001:00000004:0.0:1788269988.173600:0:41579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803788 00000100:00100000:3.0:1788269988.173747:0:42623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3606:x1875136262581632:12345-0@lo:9:umount.0 Request processed in 249us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269988.173756:0:42623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788269988.173770:0:41579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3606:x1875136262581760:12345-0@lo:9:umount.0 Request processed in 252us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269988.173777:0:41579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788269988.173813:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27c81c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788269988.173834:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788269988.173837:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788269988.173840:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262581632:0@lo:9:umount.0 00000100:00080000:0.0:1788269988.173850:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788269988.173858:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788269988.173861:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788269988.173863:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262581760:0@lo:9:umount.0 00010000:00010000:0.0:1788269988.173892:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269988.173901:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269988.174131:0:43990:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 0, last_idx 2 00000040:00080000:0.0:1788269988.174177:0:43990:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 1, last_idx 2 00000100:00100000:0.0:1788269988.174254:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262579840:0@lo:400:kworker.0 00000100:00100000:0.0:1788269988.174267:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e129e33-0062-408b-ba53-2e2ae2985734:3609:1875136262581504:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788269988.180261:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98c248a2b370) has no exports 00000020:01000000:1.0:1788269988.209829:0:43990:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27b3877e0 - data ffff98c2720490d8/ffff98c271e1d400 00000020:01000000:1.0:1788269988.209989:0:43990:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27b61f8a0 - data ffff98c1420120d8/ffff98c276e67000 00000001:00000004:1.0:1788269988.218855:0:43990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803848 00000100:00080000:1.0:1788269988.244799:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269988.244808:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803831 gen 4 00000100:00100000:1.0:1788269988.244816:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788269988.245984:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788269988.245991:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 25769803790 gen 4 00000004:00080000:2.0:1788269988.246011:0:43990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269988.246013:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788269988.246334:0:40816:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788269988.246339:0:40816:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 1 00000040:00080000:3.0:1788269988.246348:0:40816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:2.0:1788269988.246853:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788269988.246857:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803788 gen 4 00000004:00080000:2.0:1788269988.246878:0:43990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269988.246880:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788269988.247122:0:40818:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788269988.247126:0:40818:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1c:0x0] index 3 count 1 00000040:00080000:3.0:1788269988.247134:0:40818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:2.0:1788269988.248572:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074b3 00000020:00000080:2.0:1788269988.248584:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c2458b5000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788269988.249328:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2458b5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788269988.250443:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074c8 00000020:00000080:2.0:1788269988.250454:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27f700800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788269988.250498:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788269988.250504:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269988.250513:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788269988.250517:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff98c248a28000) has no exports 00000004:01000000:2.0:1788269988.250681:0:43990:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788269988.250689:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0751c 00000020:00000080:2.0:1788269988.250694:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27f626800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788269988.250775:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f700800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788269988.251106:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788269988.251111:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269988.251116:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788269988.251119:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff98c275d80000) has no exports 00000020:00000080:2.0:1788269988.251125:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07515 00000020:00000080:2.0:1788269988.251130:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27b5e7800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788269988.251159:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f626800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1788269988.251772:0:43990:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788269988.251778:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788269988.251782:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 25769803788 gen 5 00000004:00080000:2.0:1788269988.251787:0:43990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269988.251790:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269988.251815:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788269988.252188:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269988.252195:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788269988.252200:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07507 00000020:00000080:2.0:1788269988.252205:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27c81e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788269988.252223:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b5e2800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788269988.252229:0:466:0:(genops.c:885:class_export_put()) final put ffff98c27f624000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788269988.252231:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f624000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788269988.252236:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788269988.252661:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788269988.252666:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269988.252671:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788269988.252674:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff98c14378cd28) has no exports 00000020:00000080:2.0:1788269988.252679:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07500 00000020:00000080:2.0:1788269988.252682:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27c818800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788269988.252698:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27c81e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1788269988.253347:0:43990:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788269988.253351:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788269988.253354:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 25769803790 gen 5 00000004:00080000:2.0:1788269988.253359:0:43990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269988.253361:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269988.253431:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27c818800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788269988.253786:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269988.253793:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788269988.253805:0:43990:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788269988.253810:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074eb 00000020:00000080:2.0:1788269988.253815:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27b5e6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788269988.253819:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788269988.253823:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269988.253826:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788269988.253829:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff98c1437899b8) has no exports 00000020:00000080:2.0:1788269988.253833:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074e4 00000020:00000080:2.0:1788269988.253836:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c2458b7800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788269988.254642:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27c81c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788269988.254651:0:466:0:(genops.c:885:class_export_put()) final put ffff98c27b5e4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788269988.254653:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788269988.254658:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788269988.254729:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b5e6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788269988.254734:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2458b7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788269988.256121:0:43990:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788269988.256128:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269988.256132:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 25769803831 gen 5 00000100:00100000:3.0:1788269988.256139:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269988.256184:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.256193:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269988.256219:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.256223:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269988.256227:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27f702800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269988.256230:0:43990:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f702800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788269988.256237:0:43990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788269988.256379:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074cf 00000020:00000080:3.0:1788269988.256386:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27f703800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788269988.256391:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788269988.256395:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269988.256400:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788269988.256403:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98c248a299b8) has no exports 00000020:00000080:3.0:1788269988.256419:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.256422:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788269988.256426:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e074d6 00000020:00000080:3.0:1788269988.256429:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27f705800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788269988.256436:0:43990:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c27b77a000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788269988.256440:0:43990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27b77a000 2 00000020:01000004:3.0:1788269988.256444:0:43990:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c27b77a000 from lustre-MDT0001 00000020:00000080:3.0:1788269988.256463:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.256466:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788269988.256469:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c2458b3000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788269988.256471:0:43990:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2458b3000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788269988.256477:0:43990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788269988.256505:0:43990:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788269988.256509:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788269988.256513:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269988.256516:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788269988.256522:0:43990:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98c143a5c000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788269988.256527:0:43990:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff98c2491519b8) has exports, disconnecting them 00000020:00080000:3.0:1788269988.256558:0:43990:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98c143a5c000), last request at 1788269928 00000020:00000080:3.0:1788269988.256562:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07554 00000020:00080000:3.0:1788269988.256574:0:43990:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143a5c000): rc 0 00000020:00000080:3.0:1788269988.256579:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c143a5c000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788269988.257003:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c2458b7000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788269988.257011:0:466:0:(genops.c:885:class_export_put()) final put ffff98c27c819000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788269988.257013:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27c819000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788269988.257017:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788269988.257124:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f703800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788269988.257128:0:466:0:(genops.c:885:class_export_put()) final put ffff98c2458b1800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788269988.257130:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2458b1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788269988.257134:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788269988.257248:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f705800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788269988.257252:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143a5c000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788269988.273161:0:43990:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788269988.273170:0:43990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269988.273174:0:43990:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788269988.273180:0:43990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269988.273222:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24b007800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788269988.273350:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.273358:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788269988.273363:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c250df2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788269988.273366:0:43990:0:(genops.c:844:class_export_destroy()) destroying export ffff98c250df2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788269988.273374:0:43990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788269988.273444:0:43990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27b77a000 1 00000020:00000080:3.0:1788269988.273449:0:43990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0747b 00000020:00000080:3.0:1788269988.273454:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27f623000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788269988.273464:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788269988.273467:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269988.273471:0:43990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788269988.273474:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff98c248a2cd28) has no exports 00000020:00000080:1.0:1788269988.273486:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f623000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788269988.305019:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.305033:0:43990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788269988.305062:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c27b778000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788269988.305068:0:43990:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b778000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788269988.305080:0:43990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788269988.305189:0:43990:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c27b77b800 00000020:01000000:3.0:1788269988.305209:0:43990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788269988.305213:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269988.305217:0:43990:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788269988.305221:0:43990:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98c275d83370) has no exports 00000100:00100000:2.0:1788269988.305333:0:41798:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98c24a2e8e00:41798] 3 exiting: rc = 0 00000100:00100000:0.0:1788269988.305335:0:40074:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98c142a6cc00:40074] 0 exiting: rc = 1 00000100:00100000:1.0:1788269988.305361:0:40075:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98c26aa7b800:40075] 1 exiting: rc = 0 00000100:00100000:2.0:1788269988.305468:0:40076:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98c2537ab800:40076] 2 exiting: rc = 0 00000100:00100000:0.0:1788269988.305475:0:42351:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff98c24866c600:42351] 4 exiting: rc = 0 00000100:00100000:3.0:1788269988.305522:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305587:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305594:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305600:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305605:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305610:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305615:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305620:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305626:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305632:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305639:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305645:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305653:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305659:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305664:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305670:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305676:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305681:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305688:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305693:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305698:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305704:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305710:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305716:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305724:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305730:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305736:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305741:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305747:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305753:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305758:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305763:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305768:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305773:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305777:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305782:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305787:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305792:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305797:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305802:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305808:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305813:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305818:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305823:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305828:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305833:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305838:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305843:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305848:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305853:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305858:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305863:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305868:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305873:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305878:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305883:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305889:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305894:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305901:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305906:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305911:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305916:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305921:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.305927:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269988.310325:0:40078:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98c143acc000:40078] 1 exiting: rc = 0 00000100:00100000:0.0:1788269988.310331:0:40077:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98c275ad2e00:40077] 0 exiting: rc = 1 00000100:00100000:3.0:1788269988.310969:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.310978:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.310985:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.310991:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.310997:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311003:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311010:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311015:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311021:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311026:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311031:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311036:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311078:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311088:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311096:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311104:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311110:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311115:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311120:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311136:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311142:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311147:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311152:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311158:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311163:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311169:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311173:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311179:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311184:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311189:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311194:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311199:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311204:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311209:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311214:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311220:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311225:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311230:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311235:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311240:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311245:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311250:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311255:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311261:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311266:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311271:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311275:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311281:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311286:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311290:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311295:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311300:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311305:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311310:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311316:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311321:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311326:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311331:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311339:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311344:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311349:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311354:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311372:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.311377:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.311842:0:40080:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98c275ad3400:40080] 1 exiting: rc = 0 00000100:00100000:0.0:1788269988.311940:0:40815:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff98c2724d2000:40815] 2 exiting: rc = 0 00000100:00100000:1.0:1788269988.320195:0:40079:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98c275ad3600:40079] 0 exiting: rc = 1 00000100:00100000:3.0:1788269988.320367:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320377:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320383:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320410:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320417:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320423:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320428:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320436:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320444:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320450:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320456:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320461:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320466:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320471:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320478:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320502:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320509:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320514:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320520:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320524:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320547:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320556:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320563:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320572:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320580:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320591:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320601:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320632:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320643:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320652:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320663:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320674:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320683:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320688:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.320700:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323765:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323786:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323792:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323799:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323835:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323843:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323851:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323857:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323864:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323870:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323878:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323885:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323890:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323896:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323901:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323906:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.323925:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324233:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324239:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324245:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324251:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324256:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324261:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324267:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324272:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324278:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324283:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324289:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.324302:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269988.334914:0:40081:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98c275ad3200:40081] 0 exiting: rc = 1 00000100:00100000:1.0:1788269988.334915:0:40082:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98c275ad2000:40082] 1 exiting: rc = 0 00000100:00100000:2.0:1788269988.335261:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335267:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335271:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335274:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335278:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335281:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335285:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335288:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335292:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335295:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335298:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335301:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335304:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335306:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335309:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335312:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335315:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335318:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335322:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335324:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335328:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335331:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335334:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335337:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335340:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335343:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335346:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335349:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335351:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335355:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335357:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335360:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335362:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335365:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335368:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335371:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335374:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335377:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335379:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335382:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335385:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335387:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335390:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335393:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335395:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335398:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335400:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335403:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335406:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335408:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335411:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335414:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335416:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335419:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335422:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335424:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335427:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335430:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335432:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335435:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335438:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335441:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335443:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335446:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269988.335804:0:40084:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98c1429de200:40084] 1 exiting: rc = 0 00000100:00100000:3.0:1788269988.335811:0:40083:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98c28206c400:40083] 0 exiting: rc = 1 00000100:00100000:2.0:1788269988.335905:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335911:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335916:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335921:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335925:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335930:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335934:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335939:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335944:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335949:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335955:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335960:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335965:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335969:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335973:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335978:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335982:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335987:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335993:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.335998:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336002:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336008:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336012:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336017:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336022:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336028:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336033:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336066:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336074:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336081:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336089:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336099:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336107:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336115:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336124:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336134:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336142:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336150:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336155:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336159:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336169:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336174:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336180:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336190:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336199:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336204:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336209:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336216:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336221:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336230:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336235:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336240:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336244:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336248:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336253:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336257:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336261:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336266:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336271:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336276:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336280:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336285:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336289:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336294:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336642:0:42865:0:(service.c:3183:ptlrpc_main()) mdt_fld_0002: service thread [ffff98c1436adc00:42865] 2 exiting: rc = 0 00000100:00100000:1.0:1788269988.336793:0:40086:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98c143acd400:40086] 1 exiting: rc = 0 00000100:00100000:3.0:1788269988.336804:0:40085:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98c1429de400:40085] 0 exiting: rc = 1 00000100:00100000:2.0:1788269988.336867:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336873:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336878:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336883:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336889:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336894:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336899:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336903:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336909:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336913:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336918:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336923:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336928:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336932:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336936:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336940:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336944:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336948:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336952:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336957:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336962:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336968:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336972:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336976:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336981:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336987:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336993:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.336998:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337003:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337008:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337013:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337018:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337022:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337027:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337032:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337056:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337063:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337069:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337073:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337078:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337084:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337089:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337094:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337098:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337103:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337108:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337113:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337117:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337122:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337127:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337132:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337137:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337142:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337147:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337152:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337157:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337162:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337167:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337172:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337177:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337181:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337186:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337191:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269988.337195:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269988.337680:0:40087:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98c24b19f600:40087] 0 exiting: rc = 1 00000100:00100000:2.0:1788269988.337754:0:40088:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98c2491da600:40088] 1 exiting: rc = 0 00000100:00100000:3.0:1788269988.341282:0:40089:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98c2491da400:40089] 2 exiting: rc = 0 00000100:00100000:3.0:1788269988.341382:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341390:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341397:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341403:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341409:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341415:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341420:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341426:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341439:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341446:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341452:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341458:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341463:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341469:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341474:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341480:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341486:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341491:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341496:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341501:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341506:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341511:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341515:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341520:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341526:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341551:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341557:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341562:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341566:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341572:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341577:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341581:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341600:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341606:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341611:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341616:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341622:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341627:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341632:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341637:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341642:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341646:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341651:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341657:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341662:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341666:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341670:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341676:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341680:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341687:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341693:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341698:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341702:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341708:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341713:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341718:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341737:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341744:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341749:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341755:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341760:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341765:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341770:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269988.341776:0:43990:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788269988.345314:0:43990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269988.345327:0:43990:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788269988.345333:0:43990:0:(genops.c:885:class_export_put()) final put ffff98c250df3000/MDS_uuid 00000020:00000080:3.0:1788269988.345337:0:43990:0:(genops.c:844:class_export_destroy()) destroying export ffff98c250df3000/MDS_uuid for MDS 00000020:01000000:3.0:1788269988.345343:0:43990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788269988.345470:0:43990:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788269988.548192:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269989.572755:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788269990.409231:0:44191:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788269990.427814:0:44191:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788269990.427881:0:44191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269990.427896:0:44191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269990.427904:0:44191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269990.427913:0:44191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269990.427935:0:44191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788269990.427940:0:44191:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788269990.427977:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1788269990.427979:0:44191:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269990.427985:0:44191:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788269990.427986:0:40063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269990.427991:0:44191:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788269990.427998:0:40063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b676400 already unused, calling callback (ffffffffc149cc20) 00000100:00080000:1.0:1788269990.427999:0:44191:0:(import.c:65:import_set_state_nolock()) ffff98c143553800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:00010000:0.0:1788269990.428004:0:40063:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269990.428006:0:44191:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269990.428010:0:44191:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269990.428016:0:44191:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788269990.428017:0:40063:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269990.428032:0:40063:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269990.428068:0:40063:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269990.428071:0:40063:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788269990.428074:0:40063:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788269990.428088:0:40063:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:0.0:1788269990.428092:0:40063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269990.428098:0:40063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b676400/0xc5f5d7a016e075ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e075f5 expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269990.428109:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269990.428110:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269990.428112:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269990.428872:0:44191:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788269990.428876:0:44191:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788269990.428880:0:44191:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788269990.428900:0:44191:0:(import.c:65:import_set_state_nolock()) ffff98c143795000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788269990.429690:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1875136262582144:0@lo:39:umount.0 00000400:00000100:0.0:1788269990.429743:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262582144 offset 0 length 224: 4 00010000:00010000:0.0:1788269990.596361:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269991.620384:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269992.644232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269992.644247:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269992.644250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269992.644254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788269992.644259:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269992.644285:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 779 00000100:00080000:3.0:1788269992.644294:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788269992.644303:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c143555800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788269992.644365:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b603480 x1875136262582272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269992.644506:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262582272:0@lo:38:kworker.0 00000400:00000100:0.0:1788269992.644572:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262582272 offset 0 length 520: 4 00000100:00100000:3.0:1788269992.644666:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269992.644689:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262582400:0@lo:400:kworker.0 00000400:00000100:3.0:1788269992.644752:0:3607:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262582400 offset 0 length 224: 4 00010000:00010000:0.0:1788269992.651727:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269993.668513:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788269994.181861:0:42392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269994.181873:0:42392:0:(genops.c:885:class_export_put()) final put ffff98c245cfc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788269994.181986:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cfc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788269994.182074:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c14379c800 for lustre-OST0001 00000001:00100000:2.0:1788269994.182386:0:41574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788269994.182395:0:41574:0:(genops.c:885:class_export_put()) final put ffff98c27b8e4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788269994.182459:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b8e4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788269994.182497:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b8e2800 for lustre-OST0000 00010000:00010000:0.0:1788269994.692651:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269995.718638:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269996.740597:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269997.764139:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269997.764151:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269997.764154:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269997.764157:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269997.764300:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269997.764322:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262582528:0@lo:400:kworker.0 00000400:00000100:1.0:1788269997.764392:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262582528 offset 0 length 224: 4 00010000:00010000:1.0:1788269997.767727:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269998.789218:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269998.789448:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269988/real 1788269988] req@ffff98c14409aa00 x1875136262582016/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788269998 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269998.789477:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c14409aa00 x1875136262582016/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788269998 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788269998.789493:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c248242000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788269998.789512:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788269998.789515:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e129e33-0062-408b-ba53-2e2ae2985734:3606:1875136262582016:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788269998.789564:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269998.789567:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788269998.789569:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c248242000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269998.789573:0:466:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 779 00000100:00080000:0.0:1788269998.789578:0:466:0:(import.c:589:import_select_connection()) MGC192.168.201.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788269998.789583:0:466:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff98c248242000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788269998.789607:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c276266300 x1875136262582656/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269998.789630:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269998.789634:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269998.789711:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262582784:0@lo:400:kworker.0 00000400:00000100:1.0:1788269998.789753:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262582784 offset 0 length 224: 4 00000100:00100000:2.0:1788269998.789920:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e129e33-0062-408b-ba53-2e2ae2985734:3606:1875136262582656:0@lo:250:kworker.0 00000400:00000100:2.0:1788269998.789942:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136262582656 offset 0 length 520: 4 00010000:00010000:0.0:1788269999.814584:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270000.836359:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270000.836505:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269990/real 1788269990] req@ffff98c27fb73b80 x1875136262582144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788270000 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270000.836532:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27fb73b80 x1875136262582144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788270000 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788270000.836550:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143795000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788270000.836566:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1875136262582144:0@lo:39:umount.0 00000100:00080000:1.0:1788270000.836705:0:44191:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788270000.836710:0:44191:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788270000.836716:0:44191:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788270000.838605:0:44191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838624:0:44191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838630:0:44191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838634:0:44191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838655:0:44191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270000.838665:0:44191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838673:0:44191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838677:0:44191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838680:0:44191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270000.838695:0:44191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788270000.838698:0:44191:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788270000.838720:0:44191:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788270000.838724:0:44191:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788270000.838728:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788270000.838733:0:44191:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788270000.838738:0:44191:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff98c1438a8000) has no exports 00010000:00010000:3.0:1788270000.838751:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270000.838760:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788270000.838762:0:44191:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff98c1438a8000) has no exports 00010000:00010000:3.0:1788270000.838770:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788270000.838775:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838784:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788270000.838797:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270000.838802:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788270000.838805:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788270000.838807:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788270000.838820:0:42615:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:3.0:1788270000.838823:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838830:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0bfc00/0xc5f5d7a016e075c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e075cb expref: -99 pid: 41573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838843:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270000.838846:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838852:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788270000.838855:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838861:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788270000.838867:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270000.838876:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788270000.838878:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788270000.838880:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788270000.838884:0:42615:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:3.0:1788270000.838888:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838895:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9f200/0xc5f5d7a016e07b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07b97 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270000.838902:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270000.838904:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270000.838906:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270000.838910:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788270000.841033:0:44191:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27a1572a0 - data ffff98c2723c35e8/ffff98c14412a400 00000020:01000000:1.0:1788270000.841195:0:44191:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27a157120 - data ffff98c2434e7360/ffff98c1437ac000 00100000:10000000:1.0:1788270000.851884:0:44191:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788270000.857808:0:44191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e075d9 00000020:00000080:2.0:1788270000.857820:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c242d35800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788270000.857835:0:44191:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c143776800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788270000.857839:0:44191:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c143776800 2 00000020:01000004:2.0:1788270000.857843:0:44191:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c143776800 from lustre-OST0000 00000020:00000080:3.0:1788270000.857856:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c242d35800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788270000.857867:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788270000.857876:0:44191:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788270000.857879:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c275d9c800/lustre-OST0000_UUID 00000020:00000080:2.0:1788270000.857881:0:44191:0:(genops.c:844:class_export_destroy()) destroying export ffff98c275d9c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788270000.857888:0:44191:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788270000.857929:0:44191:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788270000.857933:0:44191:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788270000.857937:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788270000.857942:0:44191:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788270000.857948:0:44191:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98c143551800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788270000.857954:0:44191:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff98c249150000) has exports, disconnecting them 00000020:00080000:2.0:1788270000.857959:0:44191:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98c143551800), last request at 1788269936 00000020:00000080:2.0:1788270000.857963:0:44191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07603 00000020:00080000:2.0:1788270000.857974:0:44191:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143551800): rc 0 00000020:00000080:2.0:1788270000.857978:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c143551800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788270000.858005:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143551800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788270000.859099:0:44191:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788270000.859103:0:44191:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788270000.859106:0:44191:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788270000.859110:0:44191:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788270000.859138:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143553800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788270000.859406:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788270000.859420:0:44191:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788270000.859431:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c245cf8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788270000.859434:0:44191:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cf8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788270000.859440:0:44191:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788270000.859502:0:44191:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788270000.859507:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788270000.859513:0:44191:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788270000.859519:0:44191:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98c143790800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788270000.859530:0:44191:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff98c143788000) has exports, disconnecting them 00000020:00080000:3.0:1788270000.859535:0:44191:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98c143790800), last request at 1788269936 00000020:00000080:3.0:1788270000.859539:0:44191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07618 00000020:00080000:3.0:1788270000.859557:0:44191:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143790800): rc 0 00000020:00000080:3.0:1788270000.859561:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c143790800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788270000.859579:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143790800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788270000.860997:0:44191:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788270000.861002:0:44191:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788270000.861011:0:44191:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788270000.861018:0:44191:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788270000.861063:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143795000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788270000.861235:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788270000.861242:0:44191:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788270000.861246:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c143797000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788270000.861254:0:44191:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143797000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788270000.861262:0:44191:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788270000.861335:0:44191:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c143776800 1 00000020:00000080:2.0:1788270000.861340:0:44191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e075b6 00000020:00000080:2.0:1788270000.861343:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c14379a000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788270000.861351:0:44191:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788270000.861355:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788270000.861359:0:44191:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1788270000.861360:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c14379a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:2.0:1788270000.861363:0:44191:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff98c249153370) has no exports 00000020:00000080:3.0:1788270000.878600:0:44191:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788270000.878612:0:44191:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788270000.878618:0:44191:0:(genops.c:885:class_export_put()) final put ffff98c143772800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788270000.878622:0:44191:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143772800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788270000.878635:0:44191:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788270000.878761:0:44191:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c143771800 00000020:02000400:3.0:1788270000.878797:0:44191:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788270001.863177:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788270002.612605:0:44392:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788270002.618199:0:44392:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788270002.618297:0:44392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270002.618311:0:44392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270002.618318:0:44392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270002.618326:0:44392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270002.618361:0:44392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788270002.618367:0:44392:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788270002.618390:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788270002.618411:0:44392:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c26b603480 x1875136262582272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788270012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788270002.618419:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270002.618428:0:42615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270002.618434:0:44392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788270002.618439:0:42615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27b677a00 already unused, calling callback (ffffffffc149cc20) 00000100:00080000:3.0:1788270002.618442:0:44392:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1788270002.618445:0:42615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788270002.618449:0:44392:0:(import.c:65:import_set_state_nolock()) ffff98c143555800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788270002.618457:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788270002.618457:0:42615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270002.618464:0:44392:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c26b603480 x1875136262582272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788270012 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1788270002.618470:0:42615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270002.618478:0:44392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 10000000:01000000:0.0:1788270002.618481:0:42615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788270002.618485:0:44392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 10000000:01000000:0.0:1788270002.618485:0:42615:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788270002.618490:0:42615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788270002.618503:0:42615:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:0.0:1788270002.618507:0:42615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270002.618515:0:42615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677a00/0xc5f5d7a016e07688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e0768f expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270002.618525:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270002.618527:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270002.618529:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270002.618670:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262582272:0@lo:38:kworker.0 00000100:00080000:0.0:1788270002.619518:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788270002.619525:0:44392:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c26b601880 x1875136262582400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270002.619545:0:44392:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c26b600000 x1875136262582528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270002.619556:0:44392:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c276264380 x1875136262582784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270002.619563:0:44392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788270002.619566:0:44392:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788270002.619584:0:44392:0:(import.c:65:import_set_state_nolock()) ffff98c27b7ad800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788270002.619702:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262582912:0@lo:39:umount.0 00000400:00000100:2.0:1788270002.619748:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136262582912 offset 0 length 224: 4 00000100:00100000:3.0:1788270002.619777:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262582400:0@lo:400:kworker.0 00000100:00100000:1.0:1788270002.619834:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262582784:0@lo:400:kworker.0 00000100:00100000:1.0:1788270002.619839:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262582528:0@lo:400:kworker.0 00010000:00010000:0.0:1788270002.884496:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788270003.908137:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788270003.908159:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788270003.908239:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270004.934385:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270005.956771:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270006.980257:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270008.004240:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270009.029117:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788270009.029570:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788270009.029577:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e129e33-0062-408b-ba53-2e2ae2985734->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788270010.052329:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270011.076329:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270012.100241:0:40063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270012.868181:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270002/real 1788270002] req@ffff98c276265880 x1875136262582912/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788270012 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270012.868217:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c276265880 x1875136262582912/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788270012 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788270012.868235:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b7ad800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788270012.868255:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262582912:0@lo:39:umount.0 00000100:00080000:0.0:1788270012.868299:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788270012.868304:0:44392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788270012.868309:0:44392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788270012.869202:0:44392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869216:0:44392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869223:0:44392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869235:0:44392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869254:0:44392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270012.869260:0:44392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869265:0:44392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869269:0:44392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869272:0:44392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270012.869290:0:44392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788270012.869294:0:44392:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1788270012.869295:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270012.869304:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788270012.869312:0:44392:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:3.0:1788270012.869314:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c275b56c00 already unused, calling callback (ffffffffc149cc20) 00000020:01000000:0.0:1788270012.869317:0:44392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:00010000:3.0:1788270012.869320:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788270012.869321:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788270012.869326:0:44392:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788270012.869333:0:44392:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff98c249154d28) has no exports 00010000:00010000:3.0:1788270012.869334:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788270012.869343:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270012.869349:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788270012.869352:0:40064:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788270012.869355:0:40064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:0.0:1788270012.869355:0:44392:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff98c249154d28) has no exports 00010000:00010000:3.0:1788270012.869373:0:40064:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:3.0:1788270012.869376:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270012.869383:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c275b56c00/0xc5f5d7a016e0765e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07665 expref: -99 pid: 42391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270012.869397:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270012.869400:0:40064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270012.869406:0:40064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788270012.869408:0:40064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270012.869415:0:40064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788270012.869421:0:40064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270012.869427:0:40064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788270012.869429:0:40064:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788270012.869431:0:40064:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788270012.869451:0:40064:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:3.0:1788270012.869454:0:40064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270012.869460:0:40064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e07b82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07b89 expref: -99 pid: 40072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270012.869473:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270012.869475:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270012.869477:0:40064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270012.870346:0:42615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788270012.871291:0:44392:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27b61f900 - data ffff98c27237d000/ffff98c265e74400 00000020:01000000:0.0:1788270012.871400:0:44392:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27b387660 - data ffff98c2721aaca8/ffff98c271e1c000 00100000:10000000:0.0:1788270012.883642:0:44392:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788270012.892400:0:44392:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07673 00000020:00000080:1.0:1788270012.892412:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c143550000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788270012.892432:0:44392:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c24b03b000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788270012.892440:0:44392:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c24b03b000 2 00000020:01000004:1.0:1788270012.892444:0:44392:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98c24b03b000 from lustre-OST0001 00000020:00000080:2.0:1788270012.892466:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143550000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788270012.892476:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788270012.892485:0:44392:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788270012.892488:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c143553000/lustre-OST0001_UUID 00000020:00000080:1.0:1788270012.892491:0:44392:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143553000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788270012.892497:0:44392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788270012.892592:0:44392:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8e129e33-0062-408b-ba53-2e2ae2985734->MGS 00010000:00010000:1.0:1788270012.892608:0:44392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788270012.892619:0:44392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788270012.892625:0:44392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788270012.892627:0:44392:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788270012.892631:0:44392:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788270012.892643:0:44392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:1.0:1788270012.892647:0:44392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27b677e00/0xc5f5d7a016e07482 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07489 expref: -99 pid: 40806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270012.892661:0:44392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788270012.892668:0:44392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788270012.892673:0:44392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788270012.892675:0:44392:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788270012.892677:0:44392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788270012.892686:0:44392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c248242000 00010000:00010000:1.0:1788270012.892688:0:44392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c27a0be200/0xc5f5d7a016e07371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5f5d7a016e07378 expref: -99 pid: 40054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788270012.892703:0:44392:0:(import.c:65:import_set_state_nolock()) ffff98c248242000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788270012.892707:0:44392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788270012.892709:0:44392:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788270012.892711:0:44392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788270012.892714:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788270012.892725:0:44392:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c276266300 x1875136262582656/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788270013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788270012.892744:0:44392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788270012.892747:0:44392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1788270012.892832:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e129e33-0062-408b-ba53-2e2ae2985734:3606:1875136262582656:0@lo:250:kworker.0 10000000:01000000:1.0:1788270012.892850:0:44392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788270012.892856:0:44392:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0735c 00000020:00000080:1.0:1788270012.892861:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c250df4800/8e129e33-0062-408b-ba53-2e2ae2985734 00000020:01000000:1.0:1788270012.892905:0:44392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.142@tcp (flags='') 00000020:00000080:1.0:1788270012.892909:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788270012.892917:0:44392:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788270012.892921:0:44392:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98c276b6cd28) has no exports 00000020:00000080:2.0:1788270012.892956:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c250df4800/8e129e33-0062-408b-ba53-2e2ae2985734 for MGC192.168.201.142@tcp 10000000:01000000:3.0:1788270012.892960:0:40072:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788270012.892984:0:44392:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.142@tcp: client import never connected 00000100:00080000:1.0:1788270012.892986:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788270012.892988:0:44392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788270012.892990:0:44392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788270012.892992:0:44392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788270012.893026:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788270012.893030:0:44392:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.142@tcp (uuid 8e129e33-0062-408b-ba53-2e2ae2985734) 00000020:01000000:1.0:1788270012.893034:0:44392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788270012.893063:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788270012.893067:0:44392:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788270012.893072:0:44392:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98c143557800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788270012.893077:0:44392:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff98c143504d28) has exports, disconnecting them 00000020:00080000:1.0:1788270012.893081:0:44392:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98c143557800), last request at 1788269944 00000020:00000080:1.0:1788270012.893085:0:44392:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e0769d 00000020:00080000:1.0:1788270012.893096:0:44392:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c143557800): rc 0 00000020:00000080:1.0:1788270012.893110:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c143557800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788270012.893876:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c248242000 for MGC192.168.201.142@tcp 00000020:00000080:2.0:1788270012.893884:0:466:0:(genops.c:885:class_export_put()) final put ffff98c248243000/8e129e33-0062-408b-ba53-2e2ae2985734 00000020:00000080:2.0:1788270012.893886:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c248243000/8e129e33-0062-408b-ba53-2e2ae2985734 for MGC192.168.201.142@tcp 00000020:01000000:2.0:1788270012.893893:0:466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.142@tcp (8e129e33-0062-408b-ba53-2e2ae2985734) 00000020:00000080:2.0:1788270012.894425:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143557800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788270012.895072:0:44392:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788270012.895077:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788270012.895081:0:44392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788270012.895085:0:44392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788270012.895188:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c143555800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788270012.895313:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788270012.895320:0:44392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788270012.895323:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c142bd5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788270012.895326:0:44392:0:(genops.c:844:class_export_destroy()) destroying export ffff98c142bd5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788270012.895330:0:44392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788270012.895372:0:44392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788270012.895375:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788270012.895378:0:44392:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788270012.895384:0:44392:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98c245cfa800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788270012.895390:0:44392:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff98c1435019b8) has exports, disconnecting them 00000020:00080000:2.0:1788270012.895394:0:44392:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98c245cfa800), last request at 1788269944 00000020:00000080:2.0:1788270012.895397:0:44392:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e076b2 00000020:00080000:2.0:1788270012.895408:0:44392:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c245cfa800): rc 0 00000020:00000080:2.0:1788270012.895412:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c245cfa800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788270012.895447:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c245cfa800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788270012.896116:0:44392:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788270012.896120:0:44392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788270012.896123:0:44392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788270012.896126:0:44392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788270012.896139:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b7ad800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788270012.896254:0:40063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788270012.896396:0:40064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788270012.898093:0:42615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788270012.898221:0:40059:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98c248804000:40059] 1 exiting: rc = 0 00000100:00100000:1.0:1788270012.898277:0:40058:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98c248804a00:40058] 0 exiting: rc = 1 00000100:00100000:3.0:1788270012.898322:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898632:0:43117:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98c142756600:43117] 3 exiting: rc = 0 00000100:00100000:1.0:1788270012.898635:0:40060:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98c248805200:40060] 0 exiting: rc = 1 00000100:00100000:0.0:1788270012.898658:0:40061:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98c248805a00:40061] 1 exiting: rc = 0 00000100:00100000:1.0:1788270012.898704:0:40062:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98c248805e00:40062] 2 exiting: rc = 0 00000100:00100000:3.0:1788270012.898796:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898805:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898818:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898824:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898830:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898837:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898844:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898853:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898863:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898874:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898881:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898886:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898891:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898897:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898904:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898910:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898919:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898930:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898936:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898941:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898947:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898955:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898962:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898971:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898978:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898990:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.898996:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899003:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899010:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899018:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899026:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899034:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899072:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899078:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899087:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899094:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899194:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899207:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899213:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899218:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899225:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899234:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899242:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899254:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899260:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899273:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899279:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899287:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899295:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899303:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899313:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899325:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899332:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899337:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899344:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899353:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899360:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899370:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899380:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899388:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899394:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899401:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899408:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.899416:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788270012.900195:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788270012.900204:0:44392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788270012.900210:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c143554000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788270012.900215:0:44392:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143554000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788270012.900222:0:44392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788270012.900284:0:44392:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c24b03b000 1 00000020:00000080:3.0:1788270012.900290:0:44392:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e07657 00000020:00000080:3.0:1788270012.900302:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c142bd7800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788270012.900317:0:44392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788270012.900323:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788270012.900325:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c142bd7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788270012.900329:0:44392:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788270012.900334:0:44392:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff98c1438acd28) has no exports 00000020:00000080:3.0:1788270012.916467:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788270012.916478:0:44392:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788270012.916482:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c242d30000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788270012.916485:0:44392:0:(genops.c:844:class_export_destroy()) destroying export ffff98c242d30000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788270012.916489:0:44392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788270012.916844:0:44392:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98c242d34000 00000020:01000000:3.0:1788270012.916867:0:44392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788270012.916871:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788270012.916876:0:44392:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788270012.916880:0:44392:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff98c2759d0000) has no exports 00000020:00000080:3.0:1788270012.916915:0:44392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788270012.916919:0:44392:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788270012.916922:0:44392:0:(genops.c:885:class_export_put()) final put ffff98c143798000/OSS_uuid 00000020:00000080:3.0:1788270012.916924:0:44392:0:(genops.c:844:class_export_destroy()) destroying export ffff98c143798000/OSS_uuid for OSS 00000020:01000000:3.0:1788270012.916928:0:44392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788270012.916972:0:40071:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788270012.917022:0:41578:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98c276994c00:41578] 0 exiting: rc = 1 00000100:00100000:2.0:1788270012.917027:0:41580:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98c276e68600:41580] 2 exiting: rc = 0 00000100:00100000:0.0:1788270012.917177:0:41579:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98c276994000:41579] 1 exiting: rc = 0 00000100:00100000:1.0:1788270012.917185:0:42623:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98c14524bc00:42623] 3 exiting: rc = 0 00000100:00100000:0.0:1788270012.917260:0:42634:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff98c1436a9e00:42634] 4 exiting: rc = 0 00000100:00100000:3.0:1788270012.917323:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917332:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917339:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917344:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917350:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917355:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917360:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917365:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917370:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917375:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917381:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917385:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917391:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917396:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917401:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917406:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917411:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917416:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917422:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917426:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917431:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917436:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917440:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917445:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917450:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917455:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917460:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917464:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917469:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917473:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917478:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917483:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917488:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917492:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917497:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917502:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917507:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917512:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917517:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917522:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917527:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917531:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917536:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917541:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917545:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917549:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917554:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917559:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917564:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917568:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917573:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917578:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917583:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917587:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917592:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917597:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917602:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917606:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917611:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917615:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917620:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917624:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917629:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.917640:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788270012.918263:0:41582:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98c271eb3c00:41582] 1 exiting: rc = 0 00000100:00100000:1.0:1788270012.918318:0:43413:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98c27d7dbc00:43413] 2 exiting: rc = 0 00000100:00100000:2.0:1788270012.919224:0:41581:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98c276e68800:41581] 0 exiting: rc = 1 00000100:00100000:3.0:1788270012.919287:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919297:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919303:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919309:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919314:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919320:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919324:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919327:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919331:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919334:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919337:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919341:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919344:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919347:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919350:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919353:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919356:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919359:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919362:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919364:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919368:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919371:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919374:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919377:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919380:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919383:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919387:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919392:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919397:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919411:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919417:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919421:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919427:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919431:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919436:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919447:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919453:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919459:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919464:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919469:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919473:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919476:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919479:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919482:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919486:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919488:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919492:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919497:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919503:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919507:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919512:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919529:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919535:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919540:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919546:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919558:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919563:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919568:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919574:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919580:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919587:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919594:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919598:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.919601:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788270012.920549:0:41585:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98c143784400:41585] 2 exiting: rc = 0 00000100:00100000:2.0:1788270012.920567:0:41583:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98c271e6a600:41583] 0 exiting: rc = 1 00000100:00100000:0.0:1788270012.920791:0:41584:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98c247b74800:41584] 1 exiting: rc = 0 00000100:00100000:3.0:1788270012.920866:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920871:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920874:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920878:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920882:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920885:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920888:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920892:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920897:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920900:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920903:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920907:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920911:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920914:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920918:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920927:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920931:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920935:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920939:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920945:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920950:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920955:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920961:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920966:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920972:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920977:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920982:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920988:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.920994:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921000:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921006:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921012:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921018:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921024:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921029:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921035:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921072:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921079:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921087:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921120:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921128:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921138:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921148:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921154:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921161:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921167:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921174:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921181:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921186:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921191:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921197:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921202:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921217:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921223:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921232:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921238:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921244:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921249:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921255:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921261:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921267:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921273:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921278:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.921282:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788270012.924233:0:41586:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98c2769afe00:41586] 0 exiting: rc = 1 00000100:00100000:0.0:1788270012.924767:0:41587:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98c2769aee00:41587] 1 exiting: rc = 0 00000100:00100000:3.0:1788270012.924831:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924839:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924844:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924849:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924854:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924858:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924863:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924867:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924872:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924876:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924881:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924886:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924891:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924896:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924901:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924906:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924911:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924915:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924921:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924925:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924930:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924935:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924939:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924944:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924948:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924953:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924958:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924963:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924967:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924973:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924978:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924983:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924989:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924993:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.924998:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925003:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925008:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925013:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925017:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925022:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925027:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925032:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925064:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925074:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925081:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925086:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925091:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925132:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925139:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925143:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925148:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925153:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925158:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925164:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925169:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925174:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925179:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925183:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925189:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925194:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925199:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925204:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925209:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.925219:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788270012.925900:0:41589:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98c276996000:41589] 1 exiting: rc = 0 00000100:00100000:2.0:1788270012.925979:0:41588:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98c247b75400:41588] 0 exiting: rc = 1 00000100:00100000:3.0:1788270012.926530:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926543:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926550:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926557:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926562:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926569:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926575:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926581:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926588:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926594:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926600:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926605:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926628:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926635:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926641:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926647:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926654:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926660:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926666:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926726:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926735:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926741:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926747:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926753:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926780:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926788:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926794:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926800:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926806:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926812:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926819:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926822:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926826:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926831:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926834:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926839:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926852:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926857:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926860:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926864:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926867:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926871:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926875:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926878:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926882:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926886:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926890:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926894:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926906:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926910:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926914:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926919:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926923:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926928:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926932:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926936:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926940:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926944:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926949:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926953:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926966:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926970:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926975:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788270012.926979:0:44392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788270012.931428:0:44392:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788270022.263524:0:45156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788270027.129814:0:45755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788270027.129818:0:45755:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788270027.129820:0:45755:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788270027.129922:0:45755:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c265eb0800 00000020:01000004:1.0:1788270027.129934:0:45755:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788270027.129940:0:45755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788270027.129951:0:45755:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98c1438acd28) 00000020:00000080:1.0:1788270027.129961:0:45755:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788270027.166495:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788270027.169785:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.170800:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.171292:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.171531:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.172160:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.172432:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.172670:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.172916:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.173276:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.173538:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.173672:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.173808:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.174004:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.174213:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.174448:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.174646:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.174979:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.175239:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.175863:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.176062:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.176222:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.176368:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.176541:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.176735:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.176978:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.177292:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.177472:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.177655:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.177841:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.178093:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.178283:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.178476:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788270027.178662:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788270027.179686:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.181299:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788270027.181703:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788270027.182029:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788270027.182320:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.182766:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.183016:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788270027.183227:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.183382:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.183535:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.184054:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.184493:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788270027.184735:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788270027.185755:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.186188:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.186410:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.186810:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.187025:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788270027.187245:0:45755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788270027.188014:0:45755:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788270027.188313:0:45755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788270027.188322:0:45755:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788270027.188333:0:45755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e08297 00000020:01000004:2.0:1788270027.188339:0:45755:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788270027.188344:0:45755:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788270027.188348:0:45755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c265eb0800 from MGS 00000020:01000004:2.0:1788270027.188352:0:45755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788270027.188362:0:45755:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98c249154d28) 00000020:00000080:2.0:1788270027.188371:0:45755:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788270027.188429:0:45755:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c265eb0800 from MGS, refs=2 00080000:01000000:2.0:1788270027.188434:0:45755:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788270027.188439:0:45755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e082a5 00000100:00100000:2.0:1788270027.188530:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788270027.188651:0:45755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788270027.188657:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788270027.189213:0:45755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788270027.189218:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788270027.189766:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788270027.189964:0:45755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788270027.189969:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788270027.190729:0:45755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788270027.190736:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788270027.191123:0:45755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788270027.191128:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788270027.191626:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.191630:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.191631:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.192267:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.192270:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.192271:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270027.192690:0:45755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788270027.194534:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788270027.195708:0:45755:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788270027.196502:0:45767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788270027.196544:0:45755:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788270027.196573:0:45755:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788270027.196970:0:45755:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788270027.197235:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788270027.197338:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788270027.197342:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788270027.204295:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788270027.204305:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788270027.204538:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788270027.204542:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788270027.205435:0:45755:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788270027.205455:0:45755:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.142@tcp' 00000020:01000004:3.0:1788270027.205457:0:45755:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788270027.205486:0:45755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.142@tcp (typ=mgc) 00000020:00000080:3.0:1788270027.205498:0:45755:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.142@tcp (ffff98c14378b370) 00000020:00000080:3.0:1788270027.205511:0:45755:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788270027.205584:0:45755:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c265ec0800@MGC192.168.201.142@tcp: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788270027.205718:0:45755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.142@tcp-0 is initialized 00000040:01000000:3.0:1788270027.205723:0:45755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788270027.206002:0:45772:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788270027.206249:0:45773:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788270027.206311:0:45755:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.142@tcp (uuid 5051c9b2-4d56-4172-904c-6f13b6100451) 00000020:00000080:3.0:1788270027.206326:0:45755:0:(genops.c:1385:class_connect()) connect: client 5051c9b2-4d56-4172-904c-6f13b6100451, cookie 0xc5f5d7a016e082b3 00000100:00080000:3.0:1788270027.206335:0:45755:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788270027.206347:0:45755:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff98c265ec0800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788270027.206377:0:45755:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b602680 x1875136262583040/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788270027.206403:0:45755:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5051c9b2-4d56-4172-904c-6f13b6100451->MGS 00000020:01000004:3.0:1788270027.206421:0:45755:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788270027.206426:0:45755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788270027.206435:0:45755:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98c143788000) 00000020:00000080:3.0:1788270027.206444:0:45755:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788270027.206585:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5051c9b2-4d56-4172-904c-6f13b6100451:3606:1875136262583040:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788270027.206647:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.206753:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583040 00000100:00100000:0.0:1788270027.206761:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583040 00000100:00100000:0.0:1788270027.206795:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788270027.206802:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3606:x1875136262583040:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788270027.206822:0:45768:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5051c9b2-4d56-4172-904c-6f13b6100451@0@lo t0 exp 0000000000000000 cur 818 last 0 00000020:00000080:0.0:1788270027.206841:0:45768:0:(genops.c:1385:class_connect()) connect: client 5051c9b2-4d56-4172-904c-6f13b6100451, cookie 0xc5f5d7a016e082c1 00000100:00080000:0.0:1788270027.206959:0:45768:0:(import.c:65:import_set_state_nolock()) ffff98c248244800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788270027.207002:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+5:3606:x1875136262583040:12345-0@lo:250:mount.lustre.0 Request processed in 201us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270027.207008:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788270027.207059:0:3606:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788270027.207065:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1788270027.207070:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788270027.207073:0:3606:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788270027.207075:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c265ec0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788270027.207077:0:3606:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788270027.207081:0:3606:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788270027.207085:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5051c9b2-4d56-4172-904c-6f13b6100451:3606:1875136262583040:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788270027.218898:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788270027.219115:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788270027.219122:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788270027.220473:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788270027.220483:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788270027.222986:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788270027.222997:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788270027.223662:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788270027.223834:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788270027.223840:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788270027.224210:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788270027.224218:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788270027.248486:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788270027.248663:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788270027.248669:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788270027.249667:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788270027.249675:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788270027.250341:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788270027.250470:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788270027.250475:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788270027.250806:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788270027.250812:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788270027.251539:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788270027.251937:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788270027.251943:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788270027.252448:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788270027.252454:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788270027.253010:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788270027.253227:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788270027.253232:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788270027.253652:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788270027.253658:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788270027.272182:0:45755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788270027.272389:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788270027.272396:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788270027.273617:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788270027.273626:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788270027.274378:0:45755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788270027.274386:0:45755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788270027.275351:0:45755:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788270027.275379:0:45755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788270027.275386:0:45755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788270027.275484:0:45755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788270027.275516:0:45755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788270027.275520:0:45755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788270027.275522:0:45755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788270027.275523:0:45755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270027.275525:0:45755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270027.275526:0:45755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270027.275527:0:45755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270027.275529:0:45755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788270027.275530:0:45755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788270027.275532:0:45755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270027.275533:0:45755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788270027.275536:0:45755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788270027.275538:0:45755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788270027.275539:0:45755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788270027.275540:0:45755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270027.275541:0:45755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270027.275542:0:45755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270027.275543:0:45755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270027.275544:0:45755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788270027.275545:0:45755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788270027.275546:0:45755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270027.275547:0:45755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788270027.275572:0:45755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788270027.275589:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788270027.275658:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270027.275747:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.275795:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583168 00000100:00100000:2.0:1788270027.275803:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583168 00000100:00100000:2.0:1788270027.275932:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788270027.275943:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+5:45755:x1875136262583168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788270027.275987:0:45771:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788270027.275991:0:45771:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788270027.275994:0:45771:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788270027.276424:0:45792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788270027.276797:0:45771:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 26 20000000:01000000:0.0:1788270027.279958:0:45793:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788270027.279967:0:45793:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788270027.279970:0:45793:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788270027.279973:0:45793:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788270027.280384:0:45793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788270027.280612:0:45771:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788270027.280624:0:45771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788270027.282100:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+5:45755:x1875136262583168:12345-0@lo:253:mount.lustre.0 Request processed in 6153us (6436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.282113:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788270027.282252:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583168:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788270027.282266:0:45755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788270027.282269:0:45755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788270027.282271:0:45755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788270027.282272:0:45755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270027.282273:0:45755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270027.282275:0:45755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270027.282276:0:45755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270027.282277:0:45755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788270027.282279:0:45755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788270027.282280:0:45755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270027.282281:0:45755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788270027.282298:0:45755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c265eb0800 from lustre-MDT0000 10000000:01000000:1.0:1788270027.282326:0:45755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788270027.282329:0:45755:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788270027.282333:0:45755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c14378b370 10000000:01000000:1.0:1788270027.282337:0:45755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788270027.282345:0:45755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c14378b370 from 1 10000000:01000000:1.0:1788270027.282348:0:45755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788270027.282383:0:45755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.282394:0:45755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.282403:0:45755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270027.282421:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788270027.282455:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270027.282498:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270027.282556:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583296 00000100:00100000:3.0:1788270027.282563:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583296 00000100:00100000:3.0:1788270027.282608:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788270027.282618:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+5:45755:x1875136262583296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.282630:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270027.282645:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9ee000/0xc5f5d7a016e082cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e082c8 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.282666:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ee000/0xc5f5d7a016e082cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e082c8 expref: 6 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.282676:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9ee000/0xc5f5d7a016e082cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e082c8 expref: 6 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.282684:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee000, rc 0) 00000100:00100000:3.0:1788270027.282718:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+6:45755:x1875136262583296:12345-0@lo:101:mount.lustre.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270027.282724:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788270027.282759:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.282772:0:45755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.282784:0:45755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270027.282836:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270027.282875:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.282897:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.283000:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583424 00000100:00100000:2.0:1788270027.283004:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583424 00000100:00100000:2.0:1788270027.283036:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788270027.283064:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+6:45755:x1875136262583424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270027.283128:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+6:45755:x1875136262583424:12345-0@lo:501:mount.lustre.0 Request processed in 65us (252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270027.283134:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788270027.283230:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583424:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788270027.283255:0:45755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788270027.283268:0:45755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283276:0:45755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270027.283283:0:45755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c265eb0800 10000000:01000000:3.0:1788270027.283287:0:45755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788270027.283291:0:45755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98c265eb0800 10000000:01000000:3.0:1788270027.283294:0:45755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788270027.283296:0:45755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98c265eb0800 from 1 10000000:01000000:3.0:1788270027.283298:0:45755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788270027.283313:0:45755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283319:0:45755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283327:0:45755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270027.283339:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270027.283366:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.283384:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.283438:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583552 00000100:00100000:1.0:1788270027.283442:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583552 00000100:00100000:1.0:1788270027.283473:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788270027.283481:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+6:45755:x1875136262583552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788270027.283490:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270027.283500:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144193e00/0xc5f5d7a016e082dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e082d6 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.283514:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144193e00/0xc5f5d7a016e082dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e082d6 expref: 7 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.283521:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144193e00/0xc5f5d7a016e082dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e082d6 expref: 7 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.283527:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193e00, rc 0) 00000100:00100000:1.0:1788270027.283553:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+7:45755:x1875136262583552:12345-0@lo:101:mount.lustre.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.283559:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788270027.283624:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.283635:0:45755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082dd expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283643:0:45755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e082dd expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270027.283654:0:45755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788270027.283658:0:45755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082dd expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283665:0:45755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee600/0xc5f5d7a016e082d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082dd expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270027.283671:0:45755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788270027.283675:0:45755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788270027.283678:0:45755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98c265eb0800 10000000:01000000:3.0:1788270027.283681:0:45755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788270027.283684:0:45755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788270027.283686:0:45755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788270027.283699:0:45755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283706:0:45755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.283714:0:45755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270027.283726:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270027.283751:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.283773:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.283823:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583680 00000100:00100000:2.0:1788270027.283827:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583680 00000100:00100000:2.0:1788270027.283866:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788270027.283873:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+7:45755:x1875136262583680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788270027.283880:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270027.283889:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240031a00/0xc5f5d7a016e082eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e082e4 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.283902:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240031a00/0xc5f5d7a016e082eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e082e4 expref: 8 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.283910:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240031a00/0xc5f5d7a016e082eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e082e4 expref: 8 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.283916:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031a00, rc 0) 00000100:00100000:2.0:1788270027.283944:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+8:45755:x1875136262583680:12345-0@lo:101:mount.lustre.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.283951:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788270027.284140:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.284150:0:45755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082eb expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.284158:0:45755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e082eb expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270027.284201:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270027.284227:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.284254:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.284371:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583808 00000100:00100000:2.0:1788270027.284375:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583808 00000100:00100000:2.0:1788270027.284406:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788270027.284413:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+8:45755:x1875136262583808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270027.284536:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+9:45755:x1875136262583808:12345-0@lo:501:mount.lustre.0 Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.284543:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788270027.284644:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270027.284690:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270027.284729:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.284753:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c244ec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.284801:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262583936 00000100:00100000:1.0:1788270027.284805:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262583936 00000100:00100000:1.0:1788270027.284834:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788270027.284841:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+9:45755:x1875136262583936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788270027.285487:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+9:45755:x1875136262583936:12345-0@lo:503:mount.lustre.0 Request processed in 645us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.285494:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788270027.285691:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262583936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270027.286307:0:45794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45794:1875136262584064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788270027.286351:0:45794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.286422:0:45794:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246f3fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.286454:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262584064 00000100:00100000:1.0:1788270027.286460:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262584064 00000100:00100000:1.0:1788270027.286524:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788270027.286533:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+9:45794:x1875136262584064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788270027.287196:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+9:45794:x1875136262584064:12345-0@lo:502:llog_process_th.0 Request processed in 663us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.287208:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788270027.287334:0:45794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45794:1875136262584064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788270027.287359:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270027.287371:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270027.287374:0:45794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788270027.287378:0:45794:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788270027.287381:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788270027.287396:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98c143500000) 00000020:00000080:0.0:1788270027.287411:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788270027.287417:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788270027.287497:0:45794:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788270027.287504:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e082f9 00000020:00000080:0.0:1788270027.287704:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788270027.287710:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270027.287713:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270027.287715:0:45794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788270027.287717:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270027.287721:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270027.287723:0:45794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788270027.287726:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788270027.287733:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98c143503370) 00000020:00000080:0.0:1788270027.287742:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788270027.287746:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788270027.287748:0:45794:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788270027.287751:0:45794:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788270027.287756:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788270027.287799:0:45794:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c265eb0800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788270027.287811:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98c1435019b8) 00000020:00000080:0.0:1788270027.287819:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788270027.287949:0:45794:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788270027.287956:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e0830e 00000020:00000080:0.0:1788270027.288147:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788270027.288154:0:45794:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788270027.288159:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc5f5d7a016e08315 00080000:01000000:0.0:1788270027.288164:0:45794:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788270027.288167:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e0831c 00010000:00010000:3.0:1788270027.342556:0:45794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788270027.342988:0:45794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 25769803835 00000001:00080000:3.0:1788270027.343289:0:45794:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788270027.343694:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98c1437899b8) 00000020:00000080:3.0:1788270027.343711:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788270027.343782:0:45794:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788270027.343789:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e0832a 00000020:00000080:3.0:1788270027.344409:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788270027.354275:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc5f5d7a016e08331 00000020:00000080:2.0:1788270027.355062:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788270027.355632:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270027.355643:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.355646:0:45794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788270027.355651:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788270027.355654:0:45794:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788270027.355655:0:45794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788270027.355657:0:45794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788270027.355658:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788270027.355661:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.355662:0:45794:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788270027.355665:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270027.355670:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.355672:0:45794:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788270027.355676:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788270027.355722:0:45794:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788270027.355744:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270027.355747:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.355749:0:45794:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788270027.355751:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270027.355755:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.355756:0:45794:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788270027.355759:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788270027.355764:0:45794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:2.0:1788270027.355792:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788270027.355808:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98c249153370) 00000020:00000080:2.0:1788270027.355836:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788270027.355843:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788270027.355907:0:45794:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788270027.355913:0:45794:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788270027.355920:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e0833f 00010000:00080000:2.0:1788270027.355949:0:45794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c14408d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788270027.357582:0:45794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788270027.359502:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788270027.359515:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788270027.359550:0:45794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788270027.359569:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e08346 00000100:00080000:2.0:1788270027.359580:0:45794:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270027.359586:0:45794:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c14408d800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270027.359620:0:45794:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14409aa00 x1875136262584192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788270027.359652:0:45794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788270027.359771:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788270027.359936:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262584320:0@lo:400:kworker.0 00000020:00000080:2.0:1788270027.359975:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.359978:0:45794:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788270027.359982:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788270027.359985:0:45794:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788270027.359986:0:45794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788270027.359987:0:45794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788270027.359989:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788270027.359991:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.359992:0:45794:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788270027.359995:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788270027.359998:0:45794:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:3.0:1788270027.359999:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788270027.360001:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.360002:0:45794:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788270027.360005:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788270027.360009:0:45794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000100:00100000:2.0:1788270027.360025:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262584320 00000100:00100000:2.0:1788270027.360032:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262584320 00000100:00100000:2.0:1788270027.360098:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788270027.360107:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+9:3607:x1875136262584320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270027.360166:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+9:3607:x1875136262584320:12345-0@lo:400:kworker.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.360173:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788270027.360217:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262584320:0@lo:400:kworker.0 00000020:01000000:2.0:1788270027.360229:0:45794:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788270027.360232:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788270027.360244:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98c249150000) 00000020:00000080:2.0:1788270027.360255:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788270027.360261:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788270027.360300:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262584192:0@lo:38:llog_process_th.0 00000004:00080000:2.0:1788270027.360318:0:45794:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788270027.360323:0:45794:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788270027.360328:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e08354 00000100:00100000:0.0:1788270027.360332:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788270027.360366:0:45794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c275a8a800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.142@tcp at head 00000100:00100000:3.0:1788270027.360410:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262584192 00000100:00100000:3.0:1788270027.360415:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262584192 00000100:00100000:3.0:1788270027.360443:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788270027.360449:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875136262584192:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788270027.360463:0:45781:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788270027.360496:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875136262584192:12345-0@lo:38:llog_process_th.0 Request processed in 46us (162us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788270027.360502:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788270027.360531:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788270027.360535:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788270027.360538:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262584192:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788270027.360562:0:45794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788270027.361755:0:45794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788270027.361960:0:45794:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788270027.364940:0:45794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270027.365497:0:45794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:3.0:1788270027.371120:0:45794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].1, 64 off8256 00000040:00080000:2.0:1788270027.374003:0:45800:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788270027.374010:0:45800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788270027.378662:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788270027.378677:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788270027.378719:0:45794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788270027.378739:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e0835b 00000100:00080000:2.0:1788270027.378749:0:45794:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270027.378755:0:45794:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c275a8a800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270027.378792:0:45794:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c144099f80 x1875136262584448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788270027.378830:0:45794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788270027.378906:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270027.378911:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.378913:0:45794:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788270027.378916:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788270027.378919:0:45794:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788270027.378920:0:45794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788270027.378922:0:45794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788270027.378923:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788270027.378926:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.378927:0:45794:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788270027.378929:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788270027.378933:0:45794:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:3.0:1788270027.378936:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262584448:0@lo:8:llog_process_th.0 00000020:00000080:2.0:1788270027.378936:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.378938:0:45794:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788270027.378940:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788270027.378944:0:45794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:2.0:1788270027.378965:0:45794:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788270027.378967:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788270027.378977:0:45794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98c2491519b8) 00000020:00000080:2.0:1788270027.378988:0:45794:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000400:00000100:3.0:1788270027.378989:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262584448 offset 0 length 520: 4 00000020:00000080:2.0:1788270027.378992:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788270027.379114:0:45794:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788270027.379121:0:45794:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788270027.379137:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5f5d7a016e08369 00010000:00080000:2.0:1788270027.379166:0:45794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c275d9f000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788270027.379359:0:45794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788270027.379426:0:45794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788270027.379440:0:45794:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788270027.382690:0:45794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788270027.383312:0:45794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:2.0:1788270027.383567:0:45794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].1, 64 off8256 00000040:00080000:2.0:1788270027.384611:0:45802:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788270027.384617:0:45802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x28:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788270027.385610:0:45794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788270027.385622:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788270027.385658:0:45794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788270027.385676:0:45794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e08370 00000100:00080000:2.0:1788270027.385685:0:45794:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270027.385691:0:45794:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c275d9f000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270027.385725:0:45794:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14409aa00 x1875136262584576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788270027.385755:0:45794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788270027.385800:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270027.385804:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.385806:0:45794:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788270027.385808:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270027.385812:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.385813:0:45794:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788270027.385825:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788270027.385827:0:45794:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788270027.385830:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270027.385832:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.385833:0:45794:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788270027.385836:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270027.385838:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.385840:0:45794:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788270027.385843:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788270027.385886:0:45794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45794:1875136262584704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.385929:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262584576:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788270027.385955:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262584576 offset 0 length 520: 4 00000100:00100000:2.0:1788270027.385963:0:45794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270027.385987:0:45794:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270027.386079:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262584704 00000100:00100000:0.0:1788270027.386086:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262584704 00000100:00100000:0.0:1788270027.386122:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788270027.386131:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+9:45794:x1875136262584704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788270027.386249:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+9:45794:x1875136262584704:12345-0@lo:502:llog_process_th.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270027.386257:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788270027.386466:0:45794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45794:1875136262584704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788270027.386492:0:45794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270027.386496:0:45794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270027.386498:0:45794:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788270027.386502:0:45794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788270027.386740:0:45755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788270027.386763:0:45755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788270027.386781:0:45755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082eb expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.386792:0:45755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef800/0xc5f5d7a016e082e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082eb expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270027.386800:0:45755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c265eb0800 from 1 10000000:01000000:3.0:1788270027.386803:0:45755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788270027.386832:0:45755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.386839:0:45755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.386860:0:45755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270027.386876:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262584832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270027.386918:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.386944:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.386954:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262584832 00000100:00100000:2.0:1788270027.386959:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262584832 00000100:00100000:2.0:1788270027.386991:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788270027.386998:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+9:45755:x1875136262584832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788270027.387007:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270027.387020:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08377 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.387146:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 10 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.387157:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 10 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.387166:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030c00, rc 0) 00000100:00100000:2.0:1788270027.387203:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+10:45755:x1875136262584832:12345-0@lo:101:mount.lustre.0 Request processed in 205us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270027.387487:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262584832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.387500:0:45755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.387509:0:45755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270027.387782:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788270027.388095:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262584960:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788270027.388201:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270027.388240:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270027.388246:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262584960 00000100:00100000:0.0:1788270027.388252:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262584960 00000100:00100000:0.0:1788270027.388289:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788270027.388297:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+10:45755:x1875136262584960:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788270027.388313:0:45768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788270027.388319:0:45768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788270027.388394:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+10:45755:x1875136262584960:12345-0@lo:256:mount.lustre.0 Request processed in 97us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270027.388401:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788270027.388418:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262584960:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788270027.388975:0:45755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788270027.388996:0:45755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.389005:0:45755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788270027.389017:0:45755:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c265eb0800 from 1 10000000:01000000:2.0:1788270027.389019:0:45755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788270027.389081:0:45755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.389090:0:45755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.389098:0:45755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270027.389113:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788270027.389139:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270027.389167:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2491329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270027.389182:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585088 00000100:00100000:3.0:1788270027.389187:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585088 00000100:00100000:3.0:1788270027.389218:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788270027.389225:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+10:45755:x1875136262585088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.389232:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270027.389244:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08385 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.389260:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 11 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.389270:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 11 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.389278:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ee200, rc 0) 00000100:00100000:3.0:1788270027.389374:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+11:45755:x1875136262585088:12345-0@lo:101:mount.lustre.0 Request processed in 149us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270027.389380:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788270027.389515:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270027.389526:0:45755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.389538:0:45755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270027.389591:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270027.389616:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.389639:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a6e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.389695:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585216 00000100:00100000:1.0:1788270027.389700:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585216 00000100:00100000:1.0:1788270027.389730:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788270027.389737:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+11:45755:x1875136262585216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788270027.389871:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+11:45755:x1875136262585216:12345-0@lo:501:mount.lustre.0 Request processed in 135us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.389879:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788270027.389893:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270027.389919:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270027.389957:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.390013:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a6e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.391298:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585344 00000100:00100000:2.0:1788270027.391307:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585344 00000100:00100000:2.0:1788270027.391450:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788270027.391459:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+11:45755:x1875136262585344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270027.391621:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+11:45755:x1875136262585344:12345-0@lo:503:mount.lustre.0 Request processed in 163us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.391627:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788270027.391684:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270027.391992:0:45804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45804:1875136262585472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.392024:0:45804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.392073:0:45804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788270027.392160:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585472 00000100:00100000:2.0:1788270027.392165:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585472 00000100:00100000:2.0:1788270027.392187:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788270027.392194:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+11:45804:x1875136262585472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788270027.394215:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+11:45804:x1875136262585472:12345-0@lo:502:llog_process_th.0 Request processed in 2014us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.394231:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788270027.394248:0:45804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45804:1875136262585472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788270027.394278:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788270027.394290:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394292:0:45804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788270027.394299:0:45804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c265eb0800 00000020:00000080:3.0:1788270027.394301:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788270027.394309:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788270027.394312:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394313:0:45804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788270027.394315:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788270027.394317:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394318:0:45804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788270027.394322:0:45804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c265eb0800 00000020:00000080:3.0:1788270027.394323:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788270027.394380:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788270027.394383:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394385:0:45804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788270027.394387:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788270027.394389:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394391:0:45804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788270027.394394:0:45804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c265eb0800 00000020:00000080:3.0:1788270027.394396:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788270027.394509:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788270027.394515:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394516:0:45804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788270027.394519:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788270027.394522:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.394523:0:45804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788270027.394526:0:45804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c265eb0800 00000020:00000080:3.0:1788270027.394528:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788270027.394572:0:45804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45804:1875136262585600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.394616:0:45804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.394653:0:45804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788270027.394713:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585600 00000100:00100000:0.0:1788270027.394721:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585600 00000100:00100000:0.0:1788270027.394766:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788270027.394774:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+11:45804:x1875136262585600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788270027.394910:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+11:45804:x1875136262585600:12345-0@lo:502:llog_process_th.0 Request processed in 136us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270027.394917:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788270027.395067:0:45804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45804:1875136262585600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788270027.395086:0:45804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788270027.395092:0:45804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270027.395093:0:45804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788270027.395096:0:45804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788270027.395368:0:45755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788270027.395390:0:45755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788270027.395405:0:45755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.395425:0:45755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788270027.395475:0:45755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788270027.395478:0:45755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c265eb0800 10000000:01000000:1.0:1788270027.395481:0:45755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c265eb0800 10000000:01000000:1.0:1788270027.395485:0:45755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788270027.395489:0:45755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c265eb0800 from 1 10000000:01000000:1.0:1788270027.395492:0:45755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788270027.395516:0:45755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.395522:0:45755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.395529:0:45755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270027.395539:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788270027.395560:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270027.395585:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788270027.395591:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585728 00000100:00100000:3.0:1788270027.395596:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585728 00000100:00100000:3.0:1788270027.395626:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788270027.395633:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+11:45755:x1875136262585728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270027.395641:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270027.395653:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c24a9eea00/0xc5f5d7a016e0839a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08393 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.395674:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9eea00/0xc5f5d7a016e0839a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08393 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.395683:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c24a9eea00/0xc5f5d7a016e0839a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08393 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.395691:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eea00, rc 0) 00000100:00100000:3.0:1788270027.395729:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262585728:12345-0@lo:101:mount.lustre.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270027.395735:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788270027.395793:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270027.395806:0:45755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0839a expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.395893:0:45755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0839a expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270027.395944:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270027.395970:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.395995:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a6e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.396155:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585856 00000100:00100000:1.0:1788270027.396159:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585856 00000100:00100000:1.0:1788270027.396184:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788270027.396191:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262585856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788270027.397989:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262585856:12345-0@lo:501:mount.lustre.0 Request processed in 1788us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.398002:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788270027.398614:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270027.398667:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270027.398728:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.398767:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a6e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.398939:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262585984 00000100:00100000:1.0:1788270027.398946:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262585984 00000100:00100000:1.0:1788270027.399031:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788270027.399056:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262585984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788270027.399175:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262585984:12345-0@lo:503:mount.lustre.0 Request processed in 135us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.399181:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788270027.404790:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262585984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270027.405714:0:45808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45808:1875136262586112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788270027.405789:0:45808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270027.405879:0:45808:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a6e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788270027.409953:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586112 00000100:00100000:1.0:1788270027.409967:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586112 00000100:00100000:1.0:1788270027.410029:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788270027.410055:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45808:x1875136262586112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788270027.410235:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45808:x1875136262586112:12345-0@lo:502:llog_process_th.0 Request processed in 197us (4446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270027.410244:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788270027.410616:0:45808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45808:1875136262586112:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788270027.410688:0:45808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788270027.410704:0:45808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98c143504d28) 00000020:00000080:0.0:1788270027.410725:0:45808:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788270027.410828:0:45808:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c265eb0800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788270027.410832:0:45808:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c265eb0800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788270027.410835:0:45808:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c265eb0800 4 00010000:00080000:0.0:1788270027.410943:0:45808:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c248247000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:0.0:1788270027.416067:0:45808:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788270027.417479:0:45808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788270027.417539:0:45808:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788270027.417557:0:45808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc5f5d7a016e083a8 00000100:00080000:0.0:1788270027.417568:0:45808:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788270027.417574:0:45808:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98c248247000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788270027.417610:0:45808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c276264a80 x1875136262586240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788270027.417635:0:45808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788270027.417675:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262586240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788270027.417748:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270027.417795:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586240 00000100:00100000:2.0:1788270027.417805:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586240 00000100:00100000:2.0:1788270027.417840:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270027.417860:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262586240:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788270027.417930:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262586240:12345-0@lo:38:llog_process_th.0 Request processed in 70us (181us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788270027.417940:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270027.417984:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788270027.417992:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c248247000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788270027.417997:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788270027.418000:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262586240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788270027.422349:0:45808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45808:1875136262586368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.422433:0:45808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.422475:0:45808:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270027.422500:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586368 00000100:00100000:3.0:1788270027.422507:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586368 00000100:00100000:3.0:1788270027.422556:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788270027.422566:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:45808:x1875136262586368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.422693:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:45808:x1875136262586368:12345-0@lo:502:llog_process_th.0 Request processed in 127us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270027.422702:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788270027.422758:0:45808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45808:1875136262586368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.422798:0:45808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45808:1875136262586496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788270027.422833:0:45808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270027.422860:0:45808:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270027.423954:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586496 00000100:00100000:0.0:1788270027.423963:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586496 00000100:00100000:0.0:1788270027.424002:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788270027.424012:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+12:45808:x1875136262586496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788270027.424485:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+12:45808:x1875136262586496:12345-0@lo:502:llog_process_th.0 Request processed in 474us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270027.424495:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788270027.427349:0:45808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5051c9b2-4d56-4172-904c-6f13b6100451:45808:1875136262586496:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788270027.428102:0:45808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788270027.428626:0:45755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788270027.428649:0:45755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788270027.428671:0:45755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0839a expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270027.428684:0:45755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144192800/0xc5f5d7a016e08393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0839a expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788270027.428733:0:45755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788270027.428735:0:45755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788270027.428737:0:45755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270027.428738:0:45755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270027.428739:0:45755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270027.428741:0:45755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270027.428742:0:45755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788270027.428744:0:45755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788270027.428746:0:45755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270027.428747:0:45755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788270027.428752:0:45755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788270027.428754:0:45755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788270027.428756:0:45755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788270027.428757:0:45755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270027.428758:0:45755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270027.428760:0:45755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270027.428761:0:45755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270027.428763:0:45755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788270027.428764:0:45755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788270027.428765:0:45755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270027.428766:0:45755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788270027.428788:0:45755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788270027.428807:0:45755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262586624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788270027.428944:0:45755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270027.428992:0:45755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270027.429437:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586624 00000100:00100000:3.0:1788270027.429445:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586624 00000100:00100000:3.0:1788270027.430472:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788270027.430487:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262586624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788270027.430518:0:45771:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788270027.430532:0:45771:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788270027.434501:0:45771:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788270027.434519:0:45771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788270027.434781:0:45792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788270027.434787:0:45792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788270027.434809:0:45792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.434828:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.434837:0:45792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.434890:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.434906:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270027.434919:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45755:x1875136262586624:12345-0@lo:253:mount.lustre.0 Request processed in 4434us (5971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.434930:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262586752:0@lo:104: 00000100:00100000:3.0:1788270027.434932:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788270027.434979:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270027.435090:0:45755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:45755:1875136262586624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788270027.435106:0:45792:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1439326c0 going to sleep for 11 seconds 10000000:01000000:1.0:1788270027.435106:0:45755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788270027.435112:0:45755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788270027.435114:0:45755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788270027.435116:0:45755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270027.435118:0:45755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270027.435119:0:45755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270027.435121:0:45755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270027.435123:0:45755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788270027.435124:0:45755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788270027.435126:0:45755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270027.435127:0:45755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788270027.435138:0:45755:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788270027.438984:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586752 00000100:00100000:3.0:1788270027.438995:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586752 00000100:00100000:3.0:1788270027.439066:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788270027.439079:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262586752:12345-0@lo:104: 00010000:00010000:3.0:1788270027.439095:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.439189:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270027.439196:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262586752:12345-0@lo:104: Request processed in 121us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270027.439203:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788270027.439255:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262586752:0@lo:104: 00010000:00010000:3.0:1788270027.439278:0:45792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.439827:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270027.439835:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.439898:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9efe00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788270027.439903:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.439913:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788270027.439921:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270027.439926:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788270027.439966:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.439977:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788270027.440026:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262586880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270027.440090:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270027.440132:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262586880 00000100:00100000:2.0:1788270027.440139:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262586880 00010000:00010000:2.0:1788270027.440166:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270027.440202:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270027.440210:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5051c9b2-4d56-4172-904c-6f13b6100451+12:3608:x1875136262586880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270027.440222:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270027.440228:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440245:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440324:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e0837e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e08377 expref: 12 pid: 45770 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440344:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440352:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788270027.440366:0:45761:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005579559s 00010000:00010000:2.0:1788270027.440371:0:45761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440382:0:45761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440389:0:45761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440395:0:45761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440401:0:45761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270027.440405:0:45761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440415:0:45761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.440415:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.440435:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e08377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0837e expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270027.440454:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.440456:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270027.440457:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270027.440568:0:45761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270027.440581:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270027.440614:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5051c9b2-4d56-4172-904c-6f13b6100451+11:3608:x1875136262586880:12345-0@lo:103:ldlm_bl.0 Request processed in 405us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270027.440622:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270027.440666:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262586880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270027.443165:0:45792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.443177:0:45792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270027.443182:0:45792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030000/0xc5f5d7a016e083af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788270027.450830:0:45755:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 21474836492 00000040:01000000:1.0:1788270027.451483:0:45755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788270027.451867:0:45817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:2.0:1788270027.451876:0:45816:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 21474836492 00000020:00080000:2.0:1788270027.451880:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836492 00000040:01000000:1.0:1788270027.452146:0:45755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788270027.453026:0:45818:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98c27fb70000 x1875136262587008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270027.453066:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000040:01000000:2.0:1788270027.455072:0:45755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788270027.455112:0:45755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788270027.460305:0:45755:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788270027.460323:0:45755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788270027.460409:0:45755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788270027.464730:0:45817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788270027.464806:0:45817:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788270027.465487:0:45755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788270027.465928:0:45755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788270027.465961:0:45755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788270027.466749:0:45755:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 4, last_idx 5 00080000:10000000:2.0:1788270027.467286:0:45755:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/32) registered 00000001:00000004:2.0:1788270027.468449:0:45755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:2.0:1788270027.469985:0:45755:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788270027.470012:0:45755:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad6581cd7988 00100000:10000000:2.0:1788270027.470018:0:45755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788270027.470474:0:45755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788270027.470490:0:45755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788270027.470507:0:45755:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788270027.470530:0:45755:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788270027.471411:0:45755:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788270027.471574:0:45755:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788270028.231022:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270028.421179:0:45810:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788270028.421188:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270028.422262:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:3.0:1788270028.422272:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1788270028.485095:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 10000000:01000000:1.0:1788270029.133770:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788270029.133778:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c265eb0800 from 27 10000000:01000000:1.0:1788270029.133783:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788270029.133845:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270029.133858:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270029.133870:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270029.133897:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262587136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788270029.133971:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270029.134021:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24df090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270029.134217:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587136 00000100:00100000:2.0:1788270029.134225:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587136 00000100:00100000:2.0:1788270029.134274:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788270029.134283:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+11:45773:x1875136262587136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270029.134296:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270029.134309:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e083b6 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270029.134332:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270029.134343:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270029.134353:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031e00, rc 0) 00000100:00100000:2.0:1788270029.134400:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:45773:x1875136262587136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270029.134406:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788270029.134414:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262587136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788270029.134427:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270029.134437:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270029.134481:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262587264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788270029.134510:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270029.134539:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24df090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270029.134851:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587264 00000100:00100000:2.0:1788270029.134855:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587264 00000100:00100000:2.0:1788270029.134878:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788270029.134884:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45773:x1875136262587264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788270029.134897:0:45771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788270029.134913:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788270029.134916:0:45771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 27 00000100:00100000:2.0:1788270029.134996:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+12:45773:x1875136262587264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270029.135003:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788270029.135360:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262587264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788270029.135392:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788270029.135398:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270029.135405:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270029.252182:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270029.445178:0:45810:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788270029.445188:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270029.445307:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 1 count 1 00000040:00080000:2.0:1788270029.445344:0:45810:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x24:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270029.445476:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 1 00000100:00100000:1.0:1788270029.508104:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000001:02000400:2.0:1788270029.859394:0:46060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788270030.280415:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788270030.383826:0:46112:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788270030.383994:0:46112:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788270030.533956:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000020:00000004:2.0:1788270030.928270:0:46162:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788270030.928442:0:46162:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788270031.304357:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270031.556693:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00010000:00010000:0.0:1788270032.326393:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270032.580853:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000100:00080000:1.0:1788270032.580978:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788270032.580983:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788270032.580986:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788270032.580994:0:466:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 819 00000100:00080000:1.0:1788270032.580999:0:466:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788270032.581006:0:466:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c14408d800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788270032.581030:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27fb73800 x1875136262587520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788270032.581075:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270032.581078:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788270032.581080:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270032.581084:0:466:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788270032.581086:0:466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788270032.581089:0:466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788270032.581091:0:466:0:(import.c:65:import_set_state_nolock()) ffff98c248247000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788270032.581096:0:466:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98c248247000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788270032.581111:0:466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27fb72d80 x1875136262587648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270032.581112:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270032.581128:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262587392:0@lo:400:kworker.0 00000100:00100000:1.0:1788270032.581141:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262587520:0@lo:38:kworker.0 00000100:00100000:2.0:1788270032.581208:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270032.581438:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587392 00000100:00100000:0.0:1788270032.581446:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587392 00000100:00100000:0.0:1788270032.581489:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270032.581499:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+12:3610:x1875136262587392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270032.581589:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270032.581618:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587520 00000100:00100000:3.0:1788270032.581624:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587520 00000100:00100000:3.0:1788270032.581714:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788270032.581721:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875136262587520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788270032.581737:0:45781:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788270032.581834:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875136262587520:12345-0@lo:38:kworker.0 Request processed in 112us (245us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788270032.581842:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270032.583128:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+12:3610:x1875136262587392:12345-0@lo:400:kworker.0 Request processed in 1626us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270032.583139:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270032.583202:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262587392:0@lo:400:kworker.0 00000100:00080000:1.0:1788270032.584082:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788270032.584089:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788270032.584092:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262587520:0@lo:38:kworker.0 00000100:00100000:1.0:1788270032.584102:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262587648:0@lo:38:kworker.0 00000100:00100000:1.0:1788270032.584144:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270032.584191:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587648 00000100:00100000:2.0:1788270032.584198:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587648 00000100:00100000:2.0:1788270032.584233:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788270032.584240:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1875136262587648:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788270032.584265:0:45778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 824 last 0 00000020:00000080:2.0:1788270032.584298:0:45778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc5f5d7a016e083c4 00000004:00100000:2.0:1788270032.584313:0:45778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788270032.584510:0:45778:0:(import.c:65:import_set_state_nolock()) ffff98c27b8e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270032.584594:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875136262587648:12345-0@lo:38:kworker.0 Request processed in 354us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270032.584599:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788270032.584636:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27fb72d80 x1875136262587648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788270042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788270032.584646:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1788270032.584651:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788270032.584655:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788270032.584656:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c248247000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788270032.584659:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875136262587648:0@lo:38:kworker.0 00010000:00010000:0.0:1788270033.348219:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270033.604104:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00010000:00010000:3.0:1788270034.372396:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270034.635522:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000020:01000004:0.0:1788270034.836403:0:46508:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788270034.836407:0:46508:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788270034.836409:0:46508:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788270034.836517:0:46508:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c27f622800 00000020:01000004:0.0:1788270034.836530:0:46508:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788270034.836541:0:46508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788270034.836554:0:46508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98c2759d0000) 00000020:00000080:0.0:1788270034.836568:0:46508:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788270034.873481:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.873617:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788270034.875182:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.875437:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.875631:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.875987:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.876279:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.876512:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.876727:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.876971:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.877201:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.877484:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.877683:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.877892:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.878066:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.878270:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.878761:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.879025:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.879255:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.879525:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.879767:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.880200:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.881604:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.881909:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.883081:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.883322:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.883512:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.883807:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.884034:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.884319:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.884508:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.884701:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.885174:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788270034.885830:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788270034.886279:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788270034.886709:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788270034.886982:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788270034.888442:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788270034.888727:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788270034.889029:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788270034.889340:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788270034.889613:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788270034.889829:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788270034.890056:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788270034.890397:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788270034.890580:0:46508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:2.0:1788270034.892731:0:46508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788270034.892944:0:46508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788270034.892955:0:46508:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788270034.892967:0:46508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e083d2 00000020:01000004:2.0:1788270034.892973:0:46508:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788270034.893021:0:46508:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788270034.893024:0:46508:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788270034.893030:0:46508:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788270034.893087:0:46508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788270034.893091:0:46508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788270034.896191:0:46508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788270034.896224:0:46508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788270034.896227:0:46508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788270034.896229:0:46508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788270034.896230:0:46508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788270034.896231:0:46508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788270034.896231:0:46508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788270034.896232:0:46508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788270034.896233:0:46508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788270034.896234:0:46508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788270034.896235:0:46508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788270034.896238:0:46508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788270034.896239:0:46508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788270034.896240:0:46508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788270034.896241:0:46508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788270034.896241:0:46508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788270034.896242:0:46508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788270034.896242:0:46508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788270034.896243:0:46508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788270034.896244:0:46508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788270034.896244:0:46508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788270034.896267:0:46508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788270034.896283:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262587776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788270034.896340:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.896389:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143932600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.896399:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587776 00000100:00100000:0.0:1788270034.896407:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587776 00000100:00100000:0.0:1788270034.896452:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788270034.896460:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:46508:x1875136262587776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788270034.896489:0:45770:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788270034.896493:0:45770:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788270034.896499:0:45770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788270034.897992:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:46508:x1875136262587776:12345-0@lo:253:mount.lustre.0 Request processed in 1527us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.898003:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788270034.898170:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262587776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788270034.898181:0:46508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788270034.898184:0:46508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788270034.898186:0:46508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788270034.898187:0:46508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788270034.898188:0:46508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788270034.898189:0:46508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788270034.898190:0:46508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788270034.898192:0:46508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788270034.898193:0:46508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788270034.898194:0:46508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788270034.898212:0:46508:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c27f622800 from lustre-MDT0001 10000000:01000000:3.0:1788270034.898238:0:46508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788270034.898241:0:46508:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788270034.898248:0:46508:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c14378b370 local copy 00010000:00010000:3.0:1788270034.898256:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.898320:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262587904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270034.898343:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.898396:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.898424:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587904 00000100:00100000:0.0:1788270034.898428:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587904 00000100:00100000:0.0:1788270034.898453:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788270034.898460:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+12:46508:x1875136262587904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270034.898553:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+12:46508:x1875136262587904:12345-0@lo:501:mount.lustre.0 Request processed in 93us (208us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270034.898560:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788270034.898602:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262587904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788270034.898611:0:46508:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788270034.898622:0:46508:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788270034.898626:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.898632:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.898646:0:46508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c27f622800 10000000:01000000:3.0:1788270034.898649:0:46508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788270034.898652:0:46508:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98c14378b370 10000000:01000000:3.0:1788270034.898653:0:46508:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788270034.898655:0:46508:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98c14378b370 from 1 10000000:01000000:3.0:1788270034.898657:0:46508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788270034.898672:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.898677:0:46508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.898684:0:46508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.898691:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270034.898706:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270034.898753:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588032 00000100:00100000:3.0:1788270034.898754:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.898757:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588032 00000100:00100000:0.0:1788270034.898784:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788270034.898790:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+12:46508:x1875136262588032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270034.898799:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270034.898811:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f1000/0xc5f5d7a016e083e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e083d9 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.898828:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f1000/0xc5f5d7a016e083e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e083d9 expref: 13 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.898837:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f1000/0xc5f5d7a016e083e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e083d9 expref: 13 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.898846:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1000, rc 0) 00000100:00100000:0.0:1788270034.898879:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+13:46508:x1875136262588032:12345-0@lo:101:mount.lustre.0 Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.898885:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788270034.898972:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270034.898984:0:46508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083e0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.898993:0:46508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e083e0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.899007:0:46508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788270034.899019:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083e0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899029:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9efe00/0xc5f5d7a016e083d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083e0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.899036:0:46508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98c27f622800 10000000:01000000:3.0:1788270034.899061:0:46508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788270034.899065:0:46508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98c27f622800 from 1 10000000:01000000:3.0:1788270034.899067:0:46508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788270034.899080:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899087:0:46508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899094:0:46508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.899106:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270034.899131:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.899158:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.899206:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588160 00000100:00100000:0.0:1788270034.899210:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588160 00000100:00100000:0.0:1788270034.899232:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788270034.899238:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+13:46508:x1875136262588160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270034.899245:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270034.899253:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f1200/0xc5f5d7a016e083ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e083e7 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.899265:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f1200/0xc5f5d7a016e083ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e083e7 expref: 14 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.899273:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f1200/0xc5f5d7a016e083ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e083e7 expref: 14 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.899280:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1200, rc 0) 00000100:00100000:0.0:1788270034.899345:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+14:46508:x1875136262588160:12345-0@lo:101:mount.lustre.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.899350:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788270034.899396:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270034.899405:0:46508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083ee expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899413:0:46508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e083ee expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.899422:0:46508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788270034.899435:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083ee expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899441:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee400/0xc5f5d7a016e083e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083ee expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.899447:0:46508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788270034.899451:0:46508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788270034.899455:0:46508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98c27f622800 10000000:01000000:3.0:1788270034.899458:0:46508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788270034.899460:0:46508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788270034.899462:0:46508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788270034.899474:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899479:0:46508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899484:0:46508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.899491:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270034.899508:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.899523:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.899537:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588288 00000100:00100000:2.0:1788270034.899542:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588288 00000100:00100000:2.0:1788270034.899573:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788270034.899580:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+14:46508:x1875136262588288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788270034.899586:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270034.899594:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030800/0xc5f5d7a016e083fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e083f5 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270034.899607:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030800/0xc5f5d7a016e083fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e083f5 expref: 15 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270034.899613:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030800/0xc5f5d7a016e083fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e083f5 expref: 15 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270034.899617:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030800, rc 0) 00000100:00100000:2.0:1788270034.899643:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588288:12345-0@lo:101:mount.lustre.0 Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.899649:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788270034.899668:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270034.899678:0:46508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083fc expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.899686:0:46508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e083fc expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270034.901662:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 46 count 46 00000040:00080000:3.0:1788270034.902215:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270034.905313:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:3.0:1788270034.905349:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 136 off8552 00000040:00080000:3.0:1788270034.905358:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 176 off8728 00000040:00080000:3.0:1788270034.905366:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8952 00000040:00080000:3.0:1788270034.905374:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 224 off9176 00000040:00080000:3.0:1788270034.905380:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 120 off9296 00000040:00080000:3.0:1788270034.905387:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 112 off9408 00000040:00080000:3.0:1788270034.905393:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 160 off9568 00000040:00080000:3.0:1788270034.905400:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9792 00000040:00080000:3.0:1788270034.905406:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10016 00000040:00080000:3.0:1788270034.905413:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 88 off10104 00000040:00080000:3.0:1788270034.905420:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 144 off10248 00000040:00080000:3.0:1788270034.905426:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].13, 152 off10400 00000040:00080000:3.0:1788270034.905432:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].14, 168 off10568 00000040:00080000:3.0:1788270034.905440:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].15, 224 off10792 00000040:00080000:3.0:1788270034.905447:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].16, 224 off11016 00000040:00080000:3.0:1788270034.905453:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].17, 80 off11096 00000040:00080000:3.0:1788270034.905460:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].18, 224 off11320 00000040:00080000:3.0:1788270034.905468:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].19, 224 off11544 00000040:00080000:3.0:1788270034.905474:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].20, 160 off11704 00000040:00080000:3.0:1788270034.905484:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].21, 224 off11928 00000040:00080000:3.0:1788270034.905491:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].22, 224 off12152 00000040:00080000:3.0:1788270034.905498:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].23, 80 off12232 00000040:00080000:3.0:1788270034.905504:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].24, 224 off12456 00000040:00080000:3.0:1788270034.905511:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].25, 224 off12680 00000040:00080000:3.0:1788270034.905518:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].26, 88 off12768 00000040:00080000:3.0:1788270034.905524:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].27, 144 off12912 00000040:00080000:3.0:1788270034.905531:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].28, 152 off13064 00000040:00080000:3.0:1788270034.905537:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].29, 136 off13200 00000040:00080000:3.0:1788270034.905543:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].30, 224 off13424 00000040:00080000:3.0:1788270034.905550:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].31, 224 off13648 00000040:00080000:3.0:1788270034.905556:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].32, 80 off13728 00000040:00080000:3.0:1788270034.905563:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].33, 224 off13952 00000040:00080000:3.0:1788270034.905570:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].34, 224 off14176 00000040:00080000:3.0:1788270034.905577:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].35, 88 off14264 00000040:00080000:3.0:1788270034.905584:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].36, 144 off14408 00000040:00080000:3.0:1788270034.905590:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].37, 152 off14560 00000040:00080000:3.0:1788270034.905596:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].38, 136 off14696 00000040:00080000:3.0:1788270034.905603:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].39, 224 off14920 00000040:00080000:3.0:1788270034.905609:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].40, 224 off15144 00000040:00080000:3.0:1788270034.905615:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].41, 80 off15224 00000040:00080000:3.0:1788270034.905622:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].42, 224 off15448 00000040:00080000:3.0:1788270034.905628:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].43, 224 off15672 00000040:00080000:3.0:1788270034.905634:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].44, 120 off15792 00000040:00080000:3.0:1788270034.905649:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].45, 224 off16016 00000040:00080000:3.0:1788270034.905652:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 45 count 46 00000100:00100000:3.0:1788270034.905740:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270034.905799:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.905911:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.906292:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588416 00000100:00100000:0.0:1788270034.906299:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588416 00000100:00100000:0.0:1788270034.906343:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788270034.906352:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270034.906466:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588416:12345-0@lo:501:mount.lustre.0 Request processed in 115us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.906474:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788270034.906492:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270034.906520:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270034.906549:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.906569:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.906599:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588544 00000100:00100000:2.0:1788270034.906602:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588544 00000100:00100000:2.0:1788270034.906624:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788270034.906631:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270034.907153:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588544:12345-0@lo:503:mount.lustre.0 Request processed in 522us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.907160:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788270034.907274:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588544:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788270034.907614:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788270034.907657:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270034.907693:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.907736:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.907790:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588672 00000100:00100000:0.0:1788270034.907794:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588672 00000100:00100000:0.0:1788270034.907818:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788270034.907822:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270034.908233:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588672:12345-0@lo:502:mount.lustre.0 Request processed in 409us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.908238:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788270034.908293:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270034.908390:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:3.0:1788270034.908405:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 136 off8552 00000040:00080000:3.0:1788270034.908412:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 176 off8728 00000040:00080000:3.0:1788270034.908420:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8952 00000040:00080000:3.0:1788270034.908426:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 224 off9176 00000040:00080000:3.0:1788270034.908433:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 120 off9296 00000040:00080000:3.0:1788270034.908439:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 112 off9408 00000040:00080000:3.0:1788270034.908446:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 160 off9568 00000040:00080000:3.0:1788270034.908452:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9792 00000040:00080000:3.0:1788270034.908459:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10016 00000040:00080000:3.0:1788270034.908466:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 88 off10104 00000040:00080000:3.0:1788270034.908472:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 144 off10248 00000040:00080000:3.0:1788270034.908478:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].13, 152 off10400 00000040:00080000:3.0:1788270034.908485:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].14, 168 off10568 00000040:00080000:3.0:1788270034.908492:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].15, 224 off10792 00000040:00080000:3.0:1788270034.908499:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].16, 224 off11016 00000040:00080000:3.0:1788270034.908506:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].17, 80 off11096 00000040:00080000:3.0:1788270034.908513:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].18, 224 off11320 00000040:00080000:3.0:1788270034.908519:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].19, 224 off11544 00000040:00080000:3.0:1788270034.908526:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].20, 160 off11704 00000040:00080000:3.0:1788270034.908532:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].21, 224 off11928 00000040:00080000:3.0:1788270034.908539:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].22, 224 off12152 00000040:00080000:3.0:1788270034.908547:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].23, 80 off12232 00000040:00080000:3.0:1788270034.908554:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].24, 224 off12456 00000040:00080000:3.0:1788270034.908561:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].25, 224 off12680 00000040:00080000:3.0:1788270034.908568:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].26, 88 off12768 00000040:00080000:3.0:1788270034.908574:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].27, 144 off12912 00000040:00080000:3.0:1788270034.908581:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].28, 152 off13064 00000040:00080000:3.0:1788270034.908587:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].29, 136 off13200 00000040:00080000:3.0:1788270034.908594:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].30, 224 off13424 00000040:00080000:3.0:1788270034.908600:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].31, 224 off13648 00000040:00080000:3.0:1788270034.908607:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].32, 80 off13728 00000040:00080000:3.0:1788270034.908613:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].33, 224 off13952 00000040:00080000:3.0:1788270034.908620:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].34, 224 off14176 00000040:00080000:3.0:1788270034.908626:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].35, 88 off14264 00000040:00080000:3.0:1788270034.908633:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].36, 144 off14408 00000040:00080000:3.0:1788270034.908639:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].37, 152 off14560 00000040:00080000:3.0:1788270034.908646:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].38, 136 off14696 00000040:00080000:3.0:1788270034.908653:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].39, 224 off14920 00000040:00080000:3.0:1788270034.908661:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].40, 224 off15144 00000040:00080000:3.0:1788270034.908667:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].41, 80 off15224 00000040:00080000:3.0:1788270034.908674:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].42, 224 off15448 00000040:00080000:3.0:1788270034.908680:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].43, 224 off15672 00000040:00080000:3.0:1788270034.908687:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].44, 120 off15792 00000100:00100000:3.0:1788270034.908701:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270034.908741:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.908769:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.908811:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588800 00000100:00100000:2.0:1788270034.908816:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588800 00000100:00100000:2.0:1788270034.908846:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788270034.908853:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.908928:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262588800:12345-0@lo:502:mount.lustre.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.908935:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788270034.909203:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262588800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270034.909243:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].45, 224 off16016 00000040:00080000:3.0:1788270034.909251:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788270034.909860:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270034.909871:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.909874:0:46512:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788270034.909879:0:46512:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788270034.909881:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788270034.909896:0:46512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98c1438a8000) 00000020:00000080:1.0:1788270034.909916:0:46512:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788270034.909923:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788270034.910203:0:46512:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788270034.910211:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e0840a 00000020:00000080:1.0:1788270034.910400:0:46512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788270034.910405:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270034.910409:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.910411:0:46512:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788270034.910414:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270034.910417:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.910419:0:46512:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788270034.910422:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788270034.910428:0:46512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98c1438a99b8) 00000020:00000080:1.0:1788270034.910438:0:46512:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788270034.910441:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788270034.910444:0:46512:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788270034.910447:0:46512:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788270034.910453:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788270034.910503:0:46512:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c27f622800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788270034.910513:0:46512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98c1438ab370) 00000020:00000080:1.0:1788270034.910520:0:46512:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788270034.910568:0:46512:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788270034.910572:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e0841f 00000020:00000080:1.0:1788270034.910656:0:46512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788270034.910662:0:46512:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788270034.910665:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc5f5d7a016e08426 00080000:01000000:1.0:1788270034.910671:0:46512:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788270034.910674:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e0842d 00010000:00010000:1.0:1788270034.949484:0:46512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788270034.950793:0:46512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 25769803848 00000001:00080000:1.0:1788270034.951141:0:46512:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788270034.952069:0:46512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788270034.952079:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270034.952084:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.952085:0:46512:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788270034.952087:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270034.952091:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.952092:0:46512:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788270034.952228:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788270034.952233:0:46512:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:00000080:1.0:1788270034.952254:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788270034.952266:0:46512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98c27b800000) 00000020:00000080:1.0:1788270034.952280:0:46512:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788270034.952284:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788270034.952337:0:46512:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788270034.952342:0:46512:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788270034.952347:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e0843b 00010000:00080000:1.0:1788270034.952376:0:46512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c142bd4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788270034.953974:0:46512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788270034.957645:0:46512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788270034.957657:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788270034.957686:0:46512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788270034.957704:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e08442 00000100:00080000:3.0:1788270034.957712:0:46512:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788270034.957731:0:46512:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98c142bd4000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788270034.957766:0:46512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b602300 x1875136262588928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788270034.957794:0:46512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788270034.957849:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788270034.957853:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270034.957855:0:46512:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788270034.957858:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788270034.957860:0:46512:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788270034.957862:0:46512:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788270034.957863:0:46512:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788270034.957864:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788270034.957867:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270034.957868:0:46512:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788270034.957870:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788270034.957875:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270034.957876:0:46512:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788270034.957880:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788270034.957910:0:46512:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788270034.957923:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788270034.957926:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270034.957927:0:46512:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788270034.957930:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788270034.957931:0:46512:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788270034.957933:0:46512:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788270034.957934:0:46512:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788270034.957936:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788270034.957939:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270034.957940:0:46512:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788270034.957943:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788270034.957945:0:46512:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788270034.957948:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788270034.957950:0:46512:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788270034.957953:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788270034.957956:0:46512:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788270034.957980:0:46512:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788270034.957983:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788270034.957996:0:46512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98c14378cd28) 00000020:00000080:3.0:1788270034.958006:0:46512:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788270034.958012:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788270034.958096:0:46512:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00000100:00100000:2.0:1788270034.958205:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262588928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788270034.958268:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.958342:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262588928 00000100:00100000:2.0:1788270034.958350:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262588928 00000100:00100000:2.0:1788270034.958380:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788270034.958388:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875136262588928:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788270034.958411:0:45781:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 826 last 0 00000020:00000080:2.0:1788270034.958440:0:45781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e08450 00000004:00100000:2.0:1788270034.958455:0:45781:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788270034.958460:0:45781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00080000:1.0:1788270034.958581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788270034.958586:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788270034.958589:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788270034.958593:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 824 00000100:00080000:1.0:1788270034.958596:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788270034.958600:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c14408d800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788270034.958618:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27fb72d80 x1875136262589056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788270034.958638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270034.958641:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788270034.958643:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270034.958646:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00080000:01000000:3.0:1788270034.958723:0:46512:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000100:00100000:0.0:1788270034.958730:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262589184:0@lo:400:kworker.0 00000020:00000080:3.0:1788270034.958731:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e08457 00010000:00080000:3.0:1788270034.958764:0:46512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c26b847800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.142@tcp at head 00000100:00100000:0.0:1788270034.958783:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788270034.958974:0:46512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788270034.959203:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262589184 00000100:00100000:2.0:1788270034.959207:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262589184 00000100:00100000:2.0:1788270034.959240:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270034.959247:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262589184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270034.959294:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262589184:12345-0@lo:400:kworker.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.959301:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270034.959322:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262589056:0@lo:38:kworker.0 00000100:00100000:2.0:1788270034.959360:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.959387:0:45782:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788270034.959395:0:45782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:1.0:1788270034.959541:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27fb73800 x1875136262589184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270034.959553:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262589184:0@lo:400:kworker.0 00000100:00100000:2.0:1788270034.959748:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262589056 00000100:00100000:2.0:1788270034.959752:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262589056 00000100:00100000:0.0:1788270034.959849:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788270034.959855:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1875136262589056:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788270034.959903:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1875136262589056:12345-0@lo:38:kworker.0 Request processed in 46us (542us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788270034.959910:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788270034.959915:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788270034.959922:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788270034.959927:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788270034.959931:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262589056:0@lo:38:kworker.0 00000040:01000000:3.0:1788270034.960552:0:46512:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788270034.960704:0:46512:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788270034.962149:0:46512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270034.962418:0:46512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:3.0:1788270034.962543:0:46512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].1, 64 off8256 00000040:00080000:2.0:1788270034.963219:0:46518:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788270034.963224:0:46518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788270034.963677:0:46512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788270034.963687:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788270034.963726:0:46512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788270034.963744:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e0845e 00000100:00080000:1.0:1788270034.963753:0:46512:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788270034.963756:0:46512:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98c26b847800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788270034.963785:0:46512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27fb73800 x1875136262589312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788270034.963813:0:46512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788270034.963872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270034.963878:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270034.963882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270034.963885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788270034.963904:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270034.963908:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.963910:0:46512:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788270034.963911:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788270034.963913:0:46512:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788270034.963915:0:46512:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788270034.963916:0:46512:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788270034.963917:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788270034.963918:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.963919:0:46512:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788270034.963920:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788270034.963923:0:46512:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788270034.963925:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.963926:0:46512:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788270034.963927:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788270034.963930:0:46512:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:1.0:1788270034.963948:0:46512:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788270034.963949:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788270034.963958:0:46512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98c27b803370) 00000020:00000080:1.0:1788270034.963969:0:46512:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788270034.963974:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788270034.964032:0:46512:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788270034.964053:0:46512:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788270034.964058:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc5f5d7a016e0846c 00010000:00080000:1.0:1788270034.964081:0:46512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c144088800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788270034.964218:0:46512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788270034.964259:0:46512:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788270034.964268:0:46512:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788270034.964544:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262589312:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788270034.964583:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262589312 offset 0 length 520: 4 00000100:00080000:2.0:1788270034.964880:0:45781:0:(import.c:65:import_set_state_nolock()) ffff98c281db5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270034.964939:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1875136262588928:12345-0@lo:38:llog_process_th.0 Request processed in 6550us (6669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.964949:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270034.964988:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788270034.964997:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 7 00000100:00080000:1.0:1788270034.965004:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788270034.965009:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788270034.965012:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c142bd4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788270034.965032:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262588928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788270034.965101:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270034.965110:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262589440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270034.965139:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.965166:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262589440 00000100:00100000:2.0:1788270034.965171:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262589440 00000100:00100000:2.0:1788270034.965207:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788270034.965216:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262589440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270034.965252:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446166528 avail 1299927040 00000100:00100000:2.0:1788270034.965419:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262589440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 203us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.965426:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788270034.965456:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262589440:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788270034.965613:0:46512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788270034.965885:0:46512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:0.0:1788270034.966139:0:46512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].1, 64 off8256 00000040:00080000:0.0:1788270034.966612:0:46520:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788270034.966617:0:46520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788270034.967250:0:46512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788270034.967260:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788270034.967289:0:46512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788270034.967309:0:46512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e08473 00000100:00080000:1.0:1788270034.967317:0:46512:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788270034.967321:0:46512:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c144088800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788270034.967348:0:46512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27fb72d80 x1875136262589568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788270034.967377:0:46512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788270034.967420:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270034.967424:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.967425:0:46512:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00080000:0.0:1788270034.967427:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:1.0:1788270034.967428:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270034.967432:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1788270034.967434:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1788270034.967435:0:46512:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788270034.967440:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00080000:0.0:1788270034.967441:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1788270034.967442:0:46512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788270034.967446:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270034.967449:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1788270034.967449:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1788270034.967452:0:46512:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788270034.967455:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270034.967457:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.967458:0:46512:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788270034.967461:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788270034.967476:0:46512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270034.967478:0:46512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270034.967480:0:46512:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788270034.967482:0:46512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 46 count 46 00000100:00100000:2.0:1788270034.967594:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262589568:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788270034.967630:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262589568 offset 0 length 520: 4 00000020:01000000:3.0:1788270034.967683:0:46508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788270034.967704:0:46508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788270034.967730:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083fc expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.967738:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9efc00/0xc5f5d7a016e083f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e083fc expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.967743:0:46508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27f622800 from 1 10000000:01000000:3.0:1788270034.967745:0:46508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788270034.967763:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.967772:0:46508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.967779:0:46508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.967789:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262589696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270034.967817:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.967840:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.967867:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262589696 00000100:00100000:0.0:1788270034.967873:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262589696 00000100:00100000:0.0:1788270034.967914:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788270034.967924:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+15:46508:x1875136262589696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270034.967936:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270034.967949:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0847a expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.967986:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 16 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.967998:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 16 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.968008:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1600, rc 0) 00000100:00100000:0.0:1788270034.968068:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+16:46508:x1875136262589696:12345-0@lo:101:mount.lustre.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.968075:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788270034.968175:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262589696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270034.968185:0:46508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.968191:0:46508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.968592:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262589824:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788270034.968621:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.968645:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.968669:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262589824 00000100:00100000:0.0:1788270034.968674:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262589824 00000100:00100000:0.0:1788270034.968709:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788270034.968727:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+16:46508:x1875136262589824:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788270034.968741:0:45770:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788270034.968757:0:45770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788270034.968761:0:45770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 27 00000100:00100000:0.0:1788270034.968844:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+16:46508:x1875136262589824:12345-0@lo:256:mount.lustre.0 Request processed in 127us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.968852:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788270034.968858:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262589824:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788270034.969528:0:46508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788270034.969578:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.969587:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.969598:0:46508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27f622800 from 1 10000000:01000000:3.0:1788270034.969601:0:46508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270034.969620:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.969627:0:46508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.969634:0:46508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.969646:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262589952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270034.969674:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.969702:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.969770:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262589952 00000100:00100000:0.0:1788270034.969775:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262589952 00000100:00100000:0.0:1788270034.969802:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788270034.969808:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+16:46508:x1875136262589952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270034.969817:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270034.969827:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08488 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.969842:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 17 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.969850:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 17 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.969856:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:0.0:1788270034.969933:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262589952:12345-0@lo:101:mount.lustre.0 Request processed in 125us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.969943:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788270034.970179:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262589952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270034.970190:0:46508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.970198:0:46508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270034.970909:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 13 count 13 00000040:00080000:3.0:1788270034.971213:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270034.971425:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:3.0:1788270034.971442:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 112 off8528 00000040:00080000:3.0:1788270034.971450:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 224 off8752 00000040:00080000:3.0:1788270034.971457:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8976 00000040:00080000:3.0:1788270034.971463:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 112 off9088 00000040:00080000:3.0:1788270034.971470:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 224 off9312 00000040:00080000:3.0:1788270034.971476:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 224 off9536 00000040:00080000:3.0:1788270034.971484:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 128 off9664 00000040:00080000:3.0:1788270034.971491:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:3.0:1788270034.971497:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 224 off10112 00000040:00080000:3.0:1788270034.971504:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 128 off10240 00000040:00080000:3.0:1788270034.971513:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10464 00000040:00080000:3.0:1788270034.971515:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 12 count 13 00000100:00100000:3.0:1788270034.971556:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270034.971589:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.971686:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.971759:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590080 00000100:00100000:2.0:1788270034.971765:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590080 00000100:00100000:2.0:1788270034.971803:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788270034.971876:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270034.971992:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270034.972016:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270034.972079:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.972095:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590080:12345-0@lo:501:mount.lustre.0 Request processed in 83us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.972103:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788270034.972110:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.972125:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590208 00000100:00100000:2.0:1788270034.972128:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590208 00000100:00100000:2.0:1788270034.972155:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788270034.972161:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270034.972386:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270034.972387:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590208:12345-0@lo:503:mount.lustre.0 Request processed in 225us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.972394:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:0.0:1788270034.972625:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788270034.972670:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270034.972692:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270034.972710:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.972737:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590336 00000100:00100000:2.0:1788270034.972742:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590336 00000100:00100000:2.0:1788270034.972770:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788270034.972776:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.972897:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590336:12345-0@lo:502:mount.lustre.0 Request processed in 120us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.972903:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788270034.972917:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270034.973035:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1788270034.973088:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 112 off8528 00000040:00080000:0.0:1788270034.973114:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 224 off8752 00000040:00080000:0.0:1788270034.973131:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8976 00000040:00080000:0.0:1788270034.973146:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 112 off9088 00000040:00080000:0.0:1788270034.973158:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 224 off9312 00000040:00080000:0.0:1788270034.973169:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 224 off9536 00000040:00080000:0.0:1788270034.973181:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 128 off9664 00000040:00080000:0.0:1788270034.973192:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1788270034.973205:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 224 off10112 00000040:00080000:0.0:1788270034.973216:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 128 off10240 00000100:00100000:0.0:1788270034.973233:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270034.973263:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270034.973279:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.973434:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590464 00000100:00100000:2.0:1788270034.973439:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590464 00000100:00100000:2.0:1788270034.973464:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788270034.973471:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.973538:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590464:12345-0@lo:502:mount.lustre.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.973545:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788270034.973557:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270034.973588:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10464 00000040:00080000:0.0:1788270034.973595:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788270034.974224:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270034.974233:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974236:0:46522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788270034.974243:0:46522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27f622800 00000020:00000080:0.0:1788270034.974245:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270034.974252:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270034.974255:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974256:0:46522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788270034.974258:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270034.974260:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974262:0:46522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788270034.974265:0:46522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27f622800 00000020:00000080:0.0:1788270034.974267:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270034.974377:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270034.974382:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974383:0:46522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788270034.974386:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270034.974389:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974390:0:46522:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788270034.974394:0:46522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27f622800 00000020:00000080:0.0:1788270034.974396:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270034.974801:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270034.974869:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974871:0:46522:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788270034.974875:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270034.974878:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974879:0:46522:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788270034.974883:0:46522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27f622800 00000020:00000080:0.0:1788270034.974885:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270034.974911:0:46522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270034.974914:0:46522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270034.974915:0:46522:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788270034.974917:0:46522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 13 count 13 00000020:01000000:3.0:1788270034.975075:0:46508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788270034.975098:0:46508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788270034.975122:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.975130:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270034.975168:0:46508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788270034.975170:0:46508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c27f622800 10000000:01000000:3.0:1788270034.975172:0:46508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c27f622800 10000000:01000000:3.0:1788270034.975175:0:46508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788270034.975179:0:46508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c27f622800 from 1 10000000:01000000:3.0:1788270034.975181:0:46508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788270034.975203:0:46508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.975208:0:46508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270034.975215:0:46508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270034.975227:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270034.975257:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.975288:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270034.975387:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590592 00000100:00100000:0.0:1788270034.975393:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590592 00000100:00100000:0.0:1788270034.975422:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788270034.975430:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:46508:x1875136262590592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270034.975441:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270034.975452:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f1e00/0xc5f5d7a016e0849d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08496 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.975470:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f1e00/0xc5f5d7a016e0849d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08496 expref: 18 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.975479:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f1e00/0xc5f5d7a016e0849d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08496 expref: 18 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270034.975487:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1e00, rc 0) 00000100:00100000:0.0:1788270034.975533:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590592:12345-0@lo:101:mount.lustre.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270034.975539:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788270034.975627:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788270034.975638:0:46508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0849d expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270034.975644:0:46508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0849d expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270034.984826:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 52 count 51 00000040:00080000:2.0:1788270034.985187:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788270034.985400:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:2.0:1788270034.985425:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 120 off8536 00000040:00080000:2.0:1788270034.985442:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 168 off8704 00000040:00080000:2.0:1788270034.985456:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8928 00000040:00080000:2.0:1788270034.985470:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9152 00000040:00080000:2.0:1788270034.985483:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 120 off9272 00000040:00080000:2.0:1788270034.985498:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 168 off9440 00000040:00080000:2.0:1788270034.985526:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9664 00000040:00080000:2.0:1788270034.985540:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 224 off9888 00000040:00080000:2.0:1788270034.985551:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 120 off10008 00000040:00080000:2.0:1788270034.985564:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10232 00000040:00080000:2.0:1788270034.985576:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 224 off10456 00000040:00080000:2.0:1788270034.985588:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 88 off10544 00000040:00080000:2.0:1788270034.985600:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].14, 128 off10672 00000040:00080000:2.0:1788270034.985614:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].15, 144 off10816 00000040:00080000:2.0:1788270034.985627:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].16, 160 off10976 00000040:00080000:2.0:1788270034.985639:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].17, 224 off11200 00000040:00080000:2.0:1788270034.985652:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].18, 224 off11424 00000040:00080000:2.0:1788270034.985666:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].19, 80 off11504 00000040:00080000:2.0:1788270034.985679:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].20, 224 off11728 00000040:00080000:2.0:1788270034.985692:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].21, 224 off11952 00000040:00080000:2.0:1788270034.985705:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].22, 88 off12040 00000040:00080000:2.0:1788270034.985736:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].23, 128 off12168 00000040:00080000:2.0:1788270034.985762:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].24, 144 off12312 00000040:00080000:2.0:1788270034.985777:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].25, 160 off12472 00000040:00080000:2.0:1788270034.985790:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].26, 224 off12696 00000040:00080000:2.0:1788270034.985807:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].27, 224 off12920 00000040:00080000:2.0:1788270034.985821:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].28, 80 off13000 00000040:00080000:2.0:1788270034.985833:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].29, 224 off13224 00000040:00080000:2.0:1788270034.985844:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].30, 224 off13448 00000040:00080000:2.0:1788270034.985856:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].31, 88 off13536 00000040:00080000:2.0:1788270034.985869:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].32, 128 off13664 00000040:00080000:2.0:1788270034.985882:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].33, 144 off13808 00000040:00080000:2.0:1788270034.985893:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].34, 128 off13936 00000040:00080000:2.0:1788270034.985904:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].35, 224 off14160 00000040:00080000:2.0:1788270034.985915:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].36, 224 off14384 00000040:00080000:2.0:1788270034.985928:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].37, 80 off14464 00000040:00080000:2.0:1788270034.985940:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].38, 224 off14688 00000040:00080000:2.0:1788270034.985953:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].39, 224 off14912 00000040:00080000:2.0:1788270034.985977:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].40, 88 off15000 00000040:00080000:2.0:1788270034.985992:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].41, 128 off15128 00000040:00080000:2.0:1788270034.986004:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].42, 144 off15272 00000040:00080000:2.0:1788270034.986017:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].43, 128 off15400 00000040:00080000:2.0:1788270034.986029:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].44, 224 off15624 00000040:00080000:2.0:1788270034.986096:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].45, 224 off15848 00000040:00080000:2.0:1788270034.986113:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].46, 80 off15928 00000040:00080000:2.0:1788270034.986126:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].47, 224 off16152 00000040:00080000:2.0:1788270034.986139:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].48, 232 off16384 00000040:00080000:2.0:1788270034.986241:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].49, 224 off16608 00000040:00080000:2.0:1788270034.986260:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].50, 120 off16728 00000040:00080000:2.0:1788270034.986275:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].51, 224 off16952 00000040:00080000:2.0:1788270034.986279:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 51 count 51 00000100:00100000:2.0:1788270034.986360:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270034.986424:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.986459:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590720 00000100:00100000:2.0:1788270034.986466:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590720 00000100:00100000:2.0:1788270034.986506:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788270034.986515:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270034.986610:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590720:12345-0@lo:501:mount.lustre.0 Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.986618:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788270034.986659:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.986678:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270034.986707:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270034.986750:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.986768:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270034.987068:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590848 00000100:00100000:3.0:1788270034.987073:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590848 00000100:00100000:3.0:1788270034.987096:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788270034.987103:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270034.987173:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590848:12345-0@lo:503:mount.lustre.0 Request processed in 71us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270034.987180:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788270034.987346:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788270034.987665:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788270034.987790:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.987824:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.987848:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262590976 00000100:00100000:2.0:1788270034.987853:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262590976 00000100:00100000:2.0:1788270034.987915:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788270034.987923:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.987993:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262590976:12345-0@lo:502:mount.lustre.0 Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.987999:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788270034.990102:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270034.990130:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262590976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270034.990330:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:3.0:1788270034.990359:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 120 off8536 00000040:00080000:3.0:1788270034.990373:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 168 off8704 00000040:00080000:3.0:1788270034.990386:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8928 00000040:00080000:3.0:1788270034.990399:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9152 00000040:00080000:3.0:1788270034.990412:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 120 off9272 00000040:00080000:3.0:1788270034.990425:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 168 off9440 00000040:00080000:3.0:1788270034.990438:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9664 00000040:00080000:3.0:1788270034.990451:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 224 off9888 00000040:00080000:3.0:1788270034.990464:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 120 off10008 00000040:00080000:3.0:1788270034.990476:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10232 00000040:00080000:3.0:1788270034.990488:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 224 off10456 00000040:00080000:3.0:1788270034.990501:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 88 off10544 00000040:00080000:3.0:1788270034.990514:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].14, 128 off10672 00000040:00080000:3.0:1788270034.990526:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].15, 144 off10816 00000040:00080000:3.0:1788270034.990539:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].16, 160 off10976 00000040:00080000:3.0:1788270034.990552:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].17, 224 off11200 00000040:00080000:3.0:1788270034.990564:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].18, 224 off11424 00000040:00080000:3.0:1788270034.990576:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].19, 80 off11504 00000040:00080000:3.0:1788270034.990601:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].20, 224 off11728 00000040:00080000:3.0:1788270034.990615:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].21, 224 off11952 00000040:00080000:3.0:1788270034.990628:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].22, 88 off12040 00000040:00080000:3.0:1788270034.990640:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].23, 128 off12168 00000040:00080000:3.0:1788270034.990651:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].24, 144 off12312 00000040:00080000:3.0:1788270034.990662:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].25, 160 off12472 00000040:00080000:3.0:1788270034.990675:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].26, 224 off12696 00000040:00080000:3.0:1788270034.990687:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].27, 224 off12920 00000040:00080000:3.0:1788270034.990699:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].28, 80 off13000 00000040:00080000:3.0:1788270034.991521:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].29, 224 off13224 00000040:00080000:3.0:1788270034.991559:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].30, 224 off13448 00000040:00080000:3.0:1788270034.991570:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].31, 88 off13536 00000040:00080000:3.0:1788270034.991581:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].32, 128 off13664 00000040:00080000:3.0:1788270034.991591:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].33, 144 off13808 00000040:00080000:3.0:1788270034.991600:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].34, 128 off13936 00000040:00080000:3.0:1788270034.991612:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].35, 224 off14160 00000040:00080000:3.0:1788270034.991636:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].36, 224 off14384 00000040:00080000:3.0:1788270034.991647:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].37, 80 off14464 00000040:00080000:3.0:1788270034.991657:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].38, 224 off14688 00000040:00080000:3.0:1788270034.991667:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].39, 224 off14912 00000040:00080000:3.0:1788270034.991678:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].40, 88 off15000 00000040:00080000:3.0:1788270034.991690:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].41, 128 off15128 00000040:00080000:3.0:1788270034.991702:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].42, 144 off15272 00000040:00080000:3.0:1788270034.991727:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].43, 128 off15400 00000040:00080000:3.0:1788270034.991745:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].44, 224 off15624 00000040:00080000:3.0:1788270034.991758:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].45, 224 off15848 00000040:00080000:3.0:1788270034.991770:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].46, 80 off15928 00000040:00080000:3.0:1788270034.991781:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].47, 224 off16152 00000040:00080000:3.0:1788270034.991793:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].48, 232 off16384 00000100:00100000:3.0:1788270034.991841:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262591104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270034.991913:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.991956:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.992084:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591104 00000100:00100000:2.0:1788270034.992091:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591104 00000100:00100000:2.0:1788270034.992136:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788270034.992144:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262591104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.992250:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262591104:12345-0@lo:502:mount.lustre.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.992259:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788270034.992328:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262591104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270034.992501:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].49, 224 off16608 00000040:00080000:3.0:1788270034.992525:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].50, 120 off16728 00000100:00100000:3.0:1788270034.992558:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262591232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270034.992599:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270034.992635:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270034.992682:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591232 00000100:00100000:2.0:1788270034.992688:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591232 00000100:00100000:2.0:1788270034.992735:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788270034.992745:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262591232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270034.992837:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262591232:12345-0@lo:502:mount.lustre.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.992844:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788270034.992924:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262591232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270034.992960:0:46508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].51, 224 off16952 00000040:00080000:3.0:1788270034.992968:0:46508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788270034.994436:0:46527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788270034.994454:0:46527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98c248a2cd28) 00000020:00000080:3.0:1788270034.994476:0:46527:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788270034.994584:0:46527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c27f622800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788270034.994587:0:46527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c27f622800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788270034.994589:0:46527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27f622800 3 00010000:00080000:3.0:1788270034.994632:0:46527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27b5e2000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788270034.996427:0:46527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788270034.996641:0:46527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788270034.996690:0:46527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788270034.996703:0:46527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc5f5d7a016e084ab 00000100:00080000:3.0:1788270034.996727:0:46527:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788270034.996734:0:46527:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98c27b5e2000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788270034.996771:0:46527:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b600380 x1875136262591360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788270034.996802:0:46527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788270034.996840:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270034.996847:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270034.996850:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270034.996853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788270034.996970:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262591360:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788270034.997443:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788270034.997596:0:46527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 52 count 51 00000100:00100000:2.0:1788270034.997817:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591360 00000100:00100000:2.0:1788270034.997825:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591360 00000100:00100000:2.0:1788270034.997858:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788270034.997866:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1875136262591360:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788270034.997892:0:45778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 826 last 0 00000020:00000080:2.0:1788270034.997923:0:45778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc5f5d7a016e084b2 00000004:00100000:2.0:1788270034.997939:0:45778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788270034.997967:0:45778:0:(import.c:65:import_set_state_nolock()) ffff98c2458b6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270034.998027:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875136262591360:12345-0@lo:38:llog_process_th.0 Request processed in 159us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270034.998035:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788270034.998111:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c26b600380 x1875136262591360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788270044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270034.998119:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788270034.998134:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 7 00000100:00080000:2.0:1788270034.998139:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788270034.998142:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788270034.998144:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b5e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788270034.998150:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875136262591360:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788270034.998175:0:46508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788270034.998207:0:46508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788270034.998225:0:46508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0849d expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270034.998235:0:46508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee800/0xc5f5d7a016e08496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0849d expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788270034.998287:0:46508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788270034.998290:0:46508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788270034.998292:0:46508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788270034.998293:0:46508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788270034.998295:0:46508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788270034.998296:0:46508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788270034.998298:0:46508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788270034.998300:0:46508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788270034.998302:0:46508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788270034.998306:0:46508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788270034.998309:0:46508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788270034.998311:0:46508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788270034.998312:0:46508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788270034.998314:0:46508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788270034.998315:0:46508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788270034.998316:0:46508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788270034.998317:0:46508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788270034.998318:0:46508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788270034.998319:0:46508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788270034.998336:0:46508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788270034.998351:0:46508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262591488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788270034.998395:0:46508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270034.998422:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591488 00000100:00100000:2.0:1788270034.998426:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591488 00000100:00100000:2.0:1788270034.998464:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788270034.998472:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262591488:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788270034.998495:0:45771:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788270034.998509:0:45771:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788270034.998620:0:46508:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb68b40 going to sleep for 11 seconds 00000001:00100000:1.0:1788270035.004419:0:45756:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788270035.004691:0:45771:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788270035.004707:0:45771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788270035.004738:0:45792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788270035.004744:0:45792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788270035.004767:0:45792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.004785:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 18 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.004794:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 18 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.004802:0:45792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.004842:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 18 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.004855:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 18 pid: 45768 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270035.004870:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262591616:0@lo:104: 00000100:00100000:3.0:1788270035.004935:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788270035.004994:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 18 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270035.005000:0:45760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591616 00010000:00010000:3.0:1788270035.005006:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 18 pid: 45770 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270035.005010:0:45760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591616 00000100:00100000:3.0:1788270035.005017:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262591744:0@lo:104: 00000100:00100000:0.0:1788270035.005109:0:45760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270035.005122:0:45760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262591616:12345-0@lo:104: 00010000:00010000:0.0:1788270035.005136:0:45760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270035.005148:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.005167:0:45792:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f300 going to sleep for 11 seconds 00010000:00010000:0.0:1788270035.005195:0:45760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270035.005200:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262591616:0@lo:104: 00000100:00100000:0.0:1788270035.005207:0:45760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262591616:12345-0@lo:104: Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270035.005217:0:45760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270035.005235:0:45760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591744 00000100:00100000:0.0:1788270035.005239:0:45760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591744 00000100:00100000:0.0:1788270035.005252:0:45760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788270035.005257:0:45760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262591744:12345-0@lo:104: 00010000:00010000:0.0:1788270035.005266:0:45760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005363:0:45760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788270035.005369:0:45760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262591744:12345-0@lo:104: Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270035.005376:0:45760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788270035.005393:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262591744:0@lo:104: 00010000:00010000:0.0:1788270035.005401:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788270035.005409:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.005414:0:45792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005418:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788270035.005424:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005434:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788270035.005442:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270035.005447:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788270035.005480:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005489:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788270035.005491:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:46508:x1875136262591488:12345-0@lo:253:mount.lustre.0 Request processed in 7018us (7094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.005502:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788270035.005520:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005528:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef400/0xc5f5d7a016e0847a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08481 expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005539:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270035.005542:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005547:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc149cc20) 00000100:00100000:3.0:1788270035.005550:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262591872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788270035.005550:0:46508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:46508:1875136262591488:0@lo:253:mount.lustre.0 10000000:00010000:0.0:1788270035.005551:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005564:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788270035.005569:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788270035.005570:0:46508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788270035.005576:0:46508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 10000000:01000000:0.0:1788270035.005577:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:01000004:2.0:1788270035.005582:0:46508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788270035.005585:0:46508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788270035.005587:0:46508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788270035.005590:0:46508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1788270035.005591:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788270035.005593:0:46508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:0.0:1788270035.005596:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788270035.005597:0:46508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788270035.005601:0:46508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:0.0:1788270035.005603:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1788270035.005604:0:46508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1788270035.005617:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788270035.005621:0:46508:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788270035.005622:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c144192400/0xc5f5d7a016e083b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e083bd expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270035.005633:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270035.005634:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270035.005635:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270035.005648:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262592000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788270035.005680:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.005695:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262591872 00000100:00100000:3.0:1788270035.005701:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262591872 00010000:00010000:3.0:1788270035.005733:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 18 pid: 45768 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005740:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270035.005759:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592000 00000100:00100000:3.0:1788270035.005764:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592000 00000100:00100000:1.0:1788270035.005772:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788270035.005780:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 19 pid: 45770 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270035.005786:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+19:3608:x1875136262591872:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270035.005800:0:45762:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788270035.005801:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788270035.005809:0:45762:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788270035.005811:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 19 pid: 45768 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005824:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 19 pid: 45768 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005837:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1410f1600/0xc5f5d7a016e08481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0847a expref: 19 pid: 45768 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005849:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270035.005890:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+18:3608:x1875136262591872:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270035.005900:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788270035.005918:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270035.005926:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+17:3609:x1875136262592000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788270035.005935:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270035.005940:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 17 pid: 45770 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005948:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 17 pid: 45770 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005958:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240031e00/0xc5f5d7a016e083bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e083b6 expref: 17 pid: 45770 timeout: 926 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005970:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005977:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788270035.005988:0:45763:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005579559s 00010000:00010000:1.0:1788270035.005992:0:45763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.005999:0:45763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.006006:0:45763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.006012:0:45763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.006017:0:45763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270035.006022:0:45763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.006030:0:45763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.006062:0:45763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270035.006073:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270035.006077:0:45792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.006090:0:45792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270035.006095:0:45792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c24a9ef200/0xc5f5d7a016e084b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270035.006100:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+16:3609:x1875136262592000:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270035.006113:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270035.006141:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262591872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788270035.006358:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262592000:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788270035.011222:0:46508:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 21474836518 00000040:01000000:0.0:1788270035.011445:0:46508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788270035.011448:0:46534:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 21474836518 00000020:00080000:3.0:1788270035.011453:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836518 00000040:01000000:0.0:1788270035.011691:0:46535:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788270035.011709:0:46508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788270035.012080:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.012171:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1788270035.012212:0:46508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788270035.012217:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cb40 going to sleep for 11 seconds 00000040:00080000:0.0:1788270035.012241:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788270035.012641:0:46508:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788270035.012647:0:46508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788270035.012679:0:46508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788270035.013656:0:46508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788270035.014144:0:46508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788270035.014165:0:46508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:1.0:1788270035.014414:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592128 00000100:00100000:1.0:1788270035.014422:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592128 00000100:00100000:1.0:1788270035.014464:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788270035.014474:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592128:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.014579:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592128:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270035.014586:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788270035.015479:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592128:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788270035.015516:0:46536:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788270035.015567:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.015614:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.015645:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.015648:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592256 00000100:00100000:2.0:1788270035.015655:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592256 00000100:00100000:2.0:1788270035.015686:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788270035.015696:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592256:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788270035.015863:0:46508:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00000100:00100000:2.0:1788270035.015935:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 240us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.015944:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00080000:10000000:0.0:1788270035.016617:0:46508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x34:0x0] (8/32) registered 00000040:00080000:1.0:1788270035.019165:0:46535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788270035.019258:0:46535:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788270035.021385:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.021507:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:46536:1875136262592384:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.021576:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.021624:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270035.022091:0:45787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592384 00000100:00100000:1.0:1788270035.022098:0:45787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592384 00000100:00100000:1.0:1788270035.022140:0:45787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788270035.022149:0:45787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:46536:x1875136262592384:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.022209:0:45787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:46536:x1875136262592384:12345-0@lo:900:lod0001_rec0000.0 Request processed in 62us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270035.022215:0:45787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788270035.022512:0:46536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c26b600700 x1875136262592384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788270051 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270035.022524:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:46536:1875136262592384:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.022569:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.022601:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.022624:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270035.022674:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592512 00000100:00100000:0.0:1788270035.022679:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592512 00000100:00100000:0.0:1788270035.022729:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788270035.022737:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788270035.022808:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270035.022815:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788270035.022876:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.022960:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.023059:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.023074:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.023099:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592640 00000100:00100000:2.0:1788270035.023105:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592640 00000100:00100000:2.0:1788270035.023132:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788270035.023140:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592640:12345-0@lo:1000:lod0001_rec0000.0 00000001:00000004:1.0:1788270035.023367:0:46508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:0.0:1788270035.024795:0:46508:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788270035.024820:0:46508:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffad6580c97988 00100000:10000000:0.0:1788270035.024826:0:46508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788270035.025075:0:46508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788270035.025102:0:46508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788270035.025121:0:46508:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788270035.025135:0:46508:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788270035.025880:0:46508:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788270035.026088:0:46508:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788270035.027365:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4220us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.027378:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788270035.027700:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592640:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788270035.027764:0:46536:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 0, last_idx 2 00000100:00100000:1.0:1788270035.027886:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.027961:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270035.027992:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592768 00000100:00100000:1.0:1788270035.027998:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.028106:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592768 00000100:00100000:2.0:1788270035.028154:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788270035.028167:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788270035.028532:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 368us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.028540:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788270035.028609:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788270035.028642:0:46536:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:1.0:1788270035.028646:0:46536:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200002b13:0x1:0x0] at index 1 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1788270035.028697:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.028747:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270035.028771:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.028948:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262592896 00000100:00100000:2.0:1788270035.028953:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262592896 00000100:00100000:2.0:1788270035.028979:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788270035.028988:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592896:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788270035.029146:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262592896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.029155:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788270035.029172:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262592896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.029358:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.029414:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270035.029445:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.029469:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262593024 00000100:00100000:2.0:1788270035.029475:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262593024 00000100:00100000:2.0:1788270035.029503:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788270035.029513:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262593024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788270035.034262:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262593024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4745us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.034277:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788270035.034283:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.034406:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593152:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.034456:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.034487:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a98ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.034497:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262593152 00000100:00100000:2.0:1788270035.034505:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262593152 00000100:00100000:2.0:1788270035.034558:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788270035.034571:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262593152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788270035.034657:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46536:x1875136262593152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.034666:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788270035.034684:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593152:0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1788270035.034748:0:46536:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c24a98c240 with version 1 00000040:00080000:3.0:1788270035.034774:0:46536:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 1, last_idx 2 00000004:00080000:3.0:1788270035.034784:0:46536:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c24a98cb40 with version 2 00000040:00080000:3.0:1788270035.034788:0:46536:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200002b13:0x1:0x0] at index 1 of catalog [0x200000401:0x1:0x0] 00000004:00080000:2.0:1788270035.034790:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 1 rpc_version 1 00000020:00100000:2.0:1788270035.034810:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788270035.034819:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c14409b480 x1875136262593408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270035.034834:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262593408:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270035.034865:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.034885:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262593408 00000100:00100000:2.0:1788270035.034886:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:3.0:1788270035.034889:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262593408 00000100:00100000:3.0:1788270035.034920:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788270035.034929:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:46515:x1875136262593408:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788270035.035439:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:46515:x1875136262593408:12345-0@lo:1000:osp_up0-1.0 Request processed in 511us (572us total) trans 30064771073 rc 0/0 00000100:00100000:3.0:1788270035.035451:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788270035.035451:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262593408:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788270035.035464:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 2 rpc_version 2 00000020:00100000:2.0:1788270035.035476:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788270035.035482:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c144099880 x1875136262593664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270035.035494:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262593664:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270035.035526:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270035.035547:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:3.0:1788270035.035626:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262593664 00000100:00100000:3.0:1788270035.035631:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262593664 00000100:00100000:3.0:1788270035.035654:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788270035.035661:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46515:x1875136262593664:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788270035.035794:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262593664:12345-0@lo:1000:osp_up0-1.0 Request processed in 133us (268us total) trans 30064771074 rc 0/0 00000100:00100000:3.0:1788270035.035801:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788270035.036132:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262593664:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788270035.036658:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.036737:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270035.036766:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b74600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.036816:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262593792 00000100:00100000:2.0:1788270035.036822:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262593792 00000100:00100000:2.0:1788270035.038790:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788270035.038805:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46536:x1875136262593792:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788270035.039006:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46536:x1875136262593792:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 206us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270035.039014:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788270035.039117:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593792:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788270035.039173:0:46536:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788270035.039178:0:46536:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200002b13:0x2:0x0] at index 2 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1788270035.039252:0:46536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788270035.039296:0:46536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270035.040150:0:46536:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27526ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270035.042295:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262593920 00000100:00100000:3.0:1788270035.042307:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262593920 00000100:00100000:3.0:1788270035.042352:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788270035.042362:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46536:x1875136262593920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788270035.042472:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46536:x1875136262593920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (3176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270035.042480:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788270035.045152:0:46536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:46536:1875136262593920:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788270035.045227:0:46536:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788270035.045273:0:46536:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c2481096c0 with version 3 00000004:00080000:0.0:1788270035.045306:0:46536:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c248109480 with version 4 00000040:00080000:0.0:1788270035.045310:0:46536:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200002b13:0x2:0x0] at index 2 of catalog [0x200000401:0x1:0x0] 00000040:00080000:0.0:1788270035.045330:0:46536:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 2 count 1 00000004:00080000:0.0:1788270035.045402:0:46536:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788270035.045407:0:46536:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:1.0:1788270035.047797:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 3 rpc_version 3 00000020:00100000:1.0:1788270035.047838:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788270035.047850:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c27fb71c00 x1875136262594176/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788270035.047875:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262594176:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788270035.047938:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270035.047983:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.047997:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262594176 00000100:00100000:2.0:1788270035.048006:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262594176 00000100:00100000:2.0:1788270035.048406:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788270035.048416:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262594176:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270035.048618:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:46515:x1875136262594176:12345-0@lo:1000:osp_up0-1.0 Request processed in 204us (679us total) trans 30064771075 rc 0/0 00000100:00100000:2.0:1788270035.048627:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788270035.048683:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262594176:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788270035.048695:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 4 rpc_version 4 00000020:00100000:2.0:1788270035.048710:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788270035.048730:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c14409ad80 x1875136262594432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270035.048746:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262594432:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270035.048777:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270035.048794:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2812160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270035.048807:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262594432 00000100:00100000:2.0:1788270035.048810:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262594432 00000100:00100000:2.0:1788270035.048855:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788270035.048863:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:46515:x1875136262594432:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270035.048943:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:46515:x1875136262594432:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (166us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788270035.048948:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788270035.048973:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262594432:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788270035.397271:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270035.652104:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000040:00080000:2.0:1788270036.039804:0:46530:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788270036.039814:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270036.041029:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 2 count 2 00000040:00080000:2.0:1788270036.041054:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788270036.167004:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788270036.167013:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27f622800 from 28 10000000:01000000:1.0:1788270036.167019:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788270036.167161:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270036.167182:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270036.167194:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270036.167221:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788270036.167292:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270036.167346:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270036.167356:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262594560 00000100:00100000:1.0:1788270036.167367:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262594560 00000100:00100000:1.0:1788270036.167429:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788270036.167438:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+16:45773:x1875136262594560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788270036.167454:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270036.167473:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e084c0 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270036.167497:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 17 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270036.167516:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 17 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270036.167529:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192000, rc 0) 00000100:00100000:1.0:1788270036.167595:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262594560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270036.167600:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788270036.167929:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788270036.167949:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270036.167961:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270036.168133:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788270036.168176:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270036.168199:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24a98c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788270036.168217:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262594688 00000100:00100000:2.0:1788270036.168222:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262594688 00000100:00100000:2.0:1788270036.168266:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788270036.168274:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262594688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788270036.168292:0:45771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788270036.168307:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788270036.168310:0:45771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 28 00000100:00100000:2.0:1788270036.168386:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262594688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270036.168394:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788270036.168428:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788270036.168480:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788270036.168486:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.168494:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788270036.168508:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788270036.168510:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c265eb0800 from 28 10000000:01000000:2.0:1788270036.168513:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788270036.168530:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.168536:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.168541:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270036.168549:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788270036.168566:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270036.168582:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24846a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270036.168595:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262594816 00000100:00100000:2.0:1788270036.168599:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262594816 00000100:00100000:2.0:1788270036.168622:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788270036.168628:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262594816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270036.168636:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270036.168647:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e084ce expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.168664:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 18 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.168673:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 18 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.168685:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030c00, rc 0) 00000100:00100000:2.0:1788270036.168735:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262594816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270036.168742:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788270036.168861:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788270036.168871:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270036.168878:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270036.168915:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788270036.168940:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270036.168960:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270036.169005:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262594944 00000100:00100000:2.0:1788270036.169010:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262594944 00000100:00100000:2.0:1788270036.169161:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788270036.169169:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262594944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788270036.169180:0:45768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788270036.169191:0:45768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788270036.169193:0:45768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 28 00000100:00100000:2.0:1788270036.169253:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262594944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270036.169260:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788270036.169344:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262594944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788270036.169384:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788270036.169390:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270036.169397:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270036.420725:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270036.676099:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 0 seconds 00000040:00080000:2.0:1788270037.060378:0:46530:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788270037.060388:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270037.060537:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 1 count 1 00000040:00080000:2.0:1788270037.060595:0:46530:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1e:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270037.060754:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788270037.062788:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270027/real 1788270027] req@ffff98c14409aa00 x1875136262584576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270037.062816:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c14409aa00 x1875136262584576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270037.062826:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270027/real 1788270027] req@ffff98c144099f80 x1875136262584448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270037.062836:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c144099f80 x1875136262584448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788270037.062852:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788270037.062868:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788270037.062872:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262584576:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788270037.062877:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275a8a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788270037.062881:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788270037.062884:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262584448:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788270037.062946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788270037.062952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788270037.062955:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788270037.062962:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262595072:0@lo:400:kworker.0 00000100:00080000:3.0:1788270037.062965:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98c14408d800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788270037.062993:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b602680 x1875136262595200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788270037.063008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270037.063012:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788270037.063014:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c275a8a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788270037.063018:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 819 00000100:00080000:3.0:1788270037.063024:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788270037.063030:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c275a8a800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788270037.063032:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270037.063069:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262595200:0@lo:38:kworker.0 00000100:00100000:3.0:1788270037.063072:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b600000 x1875136262595328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788270037.063086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270037.063089:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788270037.063092:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c275d9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788270037.063096:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 819 00000100:00080000:3.0:1788270037.063099:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788270037.063104:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c275d9f000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270037.063109:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270037.063113:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262595072 00000100:00100000:3.0:1788270037.063121:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26b603480 x1875136262595456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788270037.063122:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262595072 00000100:00100000:2.0:1788270037.063142:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262595328:0@lo:8:kworker.0 00000400:00000100:2.0:1788270037.063169:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262595328 offset 0 length 520: 4 00000100:00080000:3.0:1788270037.063170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788270037.063175:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788270037.063177:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788270037.063182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788270037.063183:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262595456:0@lo:8:kworker.0 00000100:00080000:3.0:1788270037.063190:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788270037.063192:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:3610:x1875136262595072:12345-0@lo:400:kworker.0 00000400:00000100:2.0:1788270037.063206:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136262595456 offset 0 length 520: 4 00000100:00100000:2.0:1788270037.063242:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262595200 00000100:00100000:2.0:1788270037.063245:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262595200 00000100:00100000:2.0:1788270037.063263:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788270037.063268:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875136262595200:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788270037.063288:0:45781:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 828 last 0 00000020:00000080:2.0:1788270037.063318:0:45781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e084dc 00000100:00100000:3.0:1788270037.063333:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262595712:0@lo:400:kworker.0 00000004:00100000:2.0:1788270037.063333:0:45781:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788270037.063340:0:45781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 30064771072 00000100:00100000:3.0:1788270037.063381:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270037.063404:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270037.063408:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262595840:0@lo:400:kworker.0 00000100:00100000:3.0:1788270037.063413:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262595584:0@lo:400:kworker.0 00000100:00100000:2.0:1788270037.063458:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270037.063498:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262595712 00000100:00100000:2.0:1788270037.063502:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262595712 00000100:00100000:2.0:1788270037.063521:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788270037.063527:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3608:x1875136262595712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270037.063562:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3608:x1875136262595712:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270037.063568:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788270037.063615:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270037.063649:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262595712:0@lo:400:kworker.0 00000100:00100000:0.0:1788270037.063733:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:3610:x1875136262595072:12345-0@lo:400:kworker.0 Request processed in 545us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270037.063740:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788270037.063782:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262595840 00000100:00100000:0.0:1788270037.063786:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262595840 00000100:00100000:0.0:1788270037.063819:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262595584 00000100:00100000:0.0:1788270037.063822:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262595584 00000100:00100000:0.0:1788270037.063838:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788270037.063845:0:45778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788270037.063846:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262595840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270037.063856:0:45778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788270037.063862:0:45777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788270037.063876:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788270037.063886:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262595584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270037.063893:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262595840:12345-0@lo:400:kworker.0 Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270037.063901:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788270037.063938:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262595584:12345-0@lo:400:kworker.0 Request processed in 53us (322us total) trans 0 rc 0/0 00010000:00080000:0.0:1788270037.063939:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c26b600700 x1875136262595840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270037.063952:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788270037.063959:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262595840:0@lo:400:kworker.0 00010000:00080000:3.0:1788270037.063990:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c26b601500 x1875136262595584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270037.064000:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262595584:0@lo:400:kworker.0 00000100:00100000:1.0:1788270037.067851:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262595072:0@lo:400:kworker.0 00000100:00080000:3.0:1788270037.068295:0:45781:0:(import.c:65:import_set_state_nolock()) ffff98c2758e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788270037.069102:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3606:x1875136262595200:12345-0@lo:38:kworker.0 Request processed in 5829us (5994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270037.069114:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788270037.069284:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1788270037.069294:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788270037.069299:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788270037.069302:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c14408d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788270037.069325:0:3606:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000189357d2): req@ffff98c27fb70000 x1875136262587008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270037.069343:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262595200:0@lo:38:kworker.0 00000100:00100000:2.0:1788270037.069412:0:45818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270037.069440:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788270037.069443:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262595968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270037.069457:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262587008 00000100:00100000:2.0:1788270037.069464:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262587008 00000100:00100000:0.0:1788270037.069480:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270037.069833:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262595968 00000100:00100000:1.0:1788270037.069839:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262595968 00000100:00100000:2.0:1788270037.069840:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788270037.069852:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:45818:x1875136262587008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788270037.069868:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788270037.069879:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262595968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270037.069904:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446363136 avail 1300123648 00000100:00100000:2.0:1788270037.069922:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:45818:x1875136262587008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270037.069929:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788270037.069956:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262595968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270037.069963:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788270037.070013:0:45818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262587008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788270037.070036:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262595968:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1788270037.070147:0:45818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788270037.070180:0:45818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262596096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788270037.070208:0:45818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270037.070233:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24846ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270037.070267:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596096 00000100:00100000:0.0:1788270037.070272:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596096 00000100:00100000:0.0:1788270037.070306:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788270037.070313:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45818:x1875136262596096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788270037.070438:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45818:x1875136262596096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 125us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270037.070445:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788270037.070515:0:45818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262596096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788270037.070705:0:45818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262596224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788270037.070732:0:45818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270037.070753:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24846ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270037.070875:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596224 00000100:00100000:0.0:1788270037.070880:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596224 00000100:00100000:0.0:1788270037.070909:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788270037.070917:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45818:x1875136262596224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788270037.070977:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45818:x1875136262596224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270037.070983:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788270037.071031:0:45818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262596224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788270037.071326:0:45818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262596352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788270037.071366:0:45818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270037.071382:0:45818:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24846a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270037.072512:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596352 00000100:00100000:0.0:1788270037.072519:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596352 00000100:00100000:0.0:1788270037.072554:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788270037.072562:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45818:x1875136262596352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788270037.081748:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45818:x1875136262596352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 9177us (10370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270037.081763:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788270037.083075:0:45818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45818:1875136262596352:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788270037.086810:0:45818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788270037.086894:0:45818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 10, retries 0 00000004:00080000:3.0:1788270037.086899:0:45818:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:2.0:1788270037.126887:0:46779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788270037.446346:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788270037.748605:0:46831:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788270037.748815:0:46831:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788270038.381719:0:46881:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788270038.381880:0:46881:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788270038.472732:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788270039.009476:0:46929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8347a2b0 20000000:00000080:1.0:1788270039.009491:0:46929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c26bf7f400 uarg=0000000000000000 20000000:01000000:1.0:1788270039.009532:0:46929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788270039.009539:0:46929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788270039.009543:0:46929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788270039.010486:0:46930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788270039.010566:0:46929:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788270039.010573:0:46929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788270039.010812:0:46929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.010831:0:46929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 17 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.010839:0:46929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 17 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.010845:0:46929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.010884:0:46929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 17 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.010898:0:46929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 17 pid: 45768 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270039.010918:0:46929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:46929:1875136262596480:0@lo:104: 00000100:00100000:1.0:1788270039.010982:0:46929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788270039.011113:0:46929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 17 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.011122:0:46929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 17 pid: 45770 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270039.011131:0:46929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:46929:1875136262596608:0@lo:104: 00000100:00100000:1.0:1788270039.011153:0:46929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270039.011285:0:46929:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788270039.011358:0:45760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596480 00000100:00100000:0.0:1788270039.011366:0:45760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596480 00000100:00100000:0.0:1788270039.011404:0:45760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596608 00000100:00100000:0.0:1788270039.011407:0:45760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596608 00000100:00100000:3.0:1788270039.011416:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788270039.011427:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+4:46929:x1875136262596480:12345-0@lo:104: 00010000:00010000:3.0:1788270039.011438:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270039.011506:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270039.011513:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+4:46929:x1875136262596480:12345-0@lo:104: Request processed in 89us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270039.011519:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788270039.011522:0:46929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:46929:1875136262596480:0@lo:104: 00000100:00100000:3.0:1788270039.011536:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788270039.011542:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:46929:x1875136262596608:12345-0@lo:104: 00010000:00010000:3.0:1788270039.011550:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011568:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270039.011574:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011590:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9eee00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788270039.011594:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011602:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788270039.011610:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270039.011615:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788270039.011633:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270039.011639:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:46929:x1875136262596608:12345-0@lo:104: Request processed in 97us (485us total) trans 0 rc 0/0 00010000:00010000:0.0:1788270039.011654:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011657:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788270039.011661:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788270039.011690:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011695:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788270039.011697:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e08488 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0848f expref: -99 pid: 46508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011705:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262596736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788270039.011709:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270039.011712:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011718:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788270039.011721:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011728:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788270039.011734:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270039.011739:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788270039.011748:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270039.011752:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011757:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788270039.011763:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011768:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262596864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788270039.011769:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c240031200/0xc5f5d7a016e08385 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0838c expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270039.011781:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270039.011783:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270039.011786:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270039.011820:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596736 00000100:00100000:1.0:1788270039.011823:0:46929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:46929:1875136262596608:0@lo:104: 00000100:00100000:3.0:1788270039.011824:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596736 00010000:00010000:1.0:1788270039.011839:0:46929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270039.011841:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 18 pid: 45768 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011859:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596864 00000100:00100000:3.0:1788270039.011862:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596864 00010000:00010000:3.0:1788270039.011873:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 19 pid: 45770 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011898:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788270039.011905:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+19:3608:x1875136262596736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270039.011915:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270039.011920:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 19 pid: 45768 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270039.011934:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 19 pid: 45768 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270039.011941:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788270039.011945:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1410f0c00/0xc5f5d7a016e0848f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e08488 expref: 19 pid: 45768 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270039.011949:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5051c9b2-4d56-4172-904c-6f13b6100451+19:3608:x1875136262596864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270039.011955:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270039.011956:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270039.011961:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 18 pid: 45770 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.011970:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 18 pid: 45770 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.011979:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0838c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e08385 expref: 18 pid: 45770 timeout: 930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.011980:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+18:3608:x1875136262596736:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270039.011986:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788270039.011990:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.011998:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012009:0:46531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270039.012013:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262596736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788270039.012017:0:46531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012023:0:46531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012030:0:46531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012056:0:46531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270039.012061:0:46531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012068:0:46531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012098:0:46531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270039.012107:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270039.012134:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5051c9b2-4d56-4172-904c-6f13b6100451+16:3608:x1875136262596864:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270039.012140:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788270039.012244:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262596864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270039.012277:0:46929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270039.012283:0:46929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270039.012289:0:46929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c144192400/0xc5f5d7a016e084e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 46929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270039.012520:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270039.013626:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270039.493000:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270039.686623:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788270040.260315:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270040.260350:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262596992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270040.260449:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270040.260616:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262596992 00000100:00100000:3.0:1788270040.260638:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262596992 00000100:00100000:3.0:1788270040.260700:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788270040.260712:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3610:x1875136262596992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270040.260759:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446203392 avail 1299963904 00000100:00100000:3.0:1788270040.260820:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3610:x1875136262596992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270040.260827:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788270040.260893:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262596992:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788270040.261102:0:45773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788270040.261108:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27f622800 from 13 10000000:01000000:2.0:1788270040.261113:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788270040.261154:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270040.261167:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270040.261178:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270040.261197:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.261235:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270040.261272:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788270040.263727:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597120 00000100:00100000:0.0:1788270040.263746:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597120 00000100:00100000:0.0:1788270040.263813:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788270040.263827:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+16:45773:x1875136262597120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788270040.263850:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270040.263878:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e084ea expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.263913:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 17 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.263926:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 17 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.263937:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0400, rc 0) 00000100:00100000:0.0:1788270040.264029:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262597120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270040.264036:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788270040.264206:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270040.264228:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270040.264239:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270040.264334:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.264372:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270040.264421:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788270040.264617:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597248 00000100:00100000:3.0:1788270040.264634:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597248 00000100:00100000:3.0:1788270040.264675:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788270040.264685:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262597248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270040.264828:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262597248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270040.264835:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788270040.264918:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.264949:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.264996:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270040.265018:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788270040.265122:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597376 00000100:00100000:0.0:1788270040.265127:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597376 00000100:00100000:0.0:1788270040.265161:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788270040.265171:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262597376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788270040.265258:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262597376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270040.265265:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788270040.265352:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788270040.266584:0:47010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788270040.267157:0:45773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788270040.267188:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788270040.267200:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270040.267212:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270040.267224:0:45773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788270040.267228:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c265eb0800 from 13 10000000:01000000:3.0:1788270040.267231:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270040.267269:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270040.267278:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270040.267291:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270040.267317:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788270040.267384:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270040.267521:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249a23540 going to sleep for 11 seconds 00000100:00100000:0.0:1788270040.267639:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597504 00000100:00100000:0.0:1788270040.267649:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597504 00000100:00100000:0.0:1788270040.267733:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788270040.267745:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+17:45773:x1875136262597504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788270040.267759:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270040.267774:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e084f8 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.267803:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 18 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.267816:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 18 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.267826:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1c00, rc 0) 00000100:00100000:0.0:1788270040.267881:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262597504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270040.267889:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788270040.268025:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788270040.268063:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270040.268072:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270040.268148:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270040.268180:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270040.273976:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788270040.277154:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597632 00000100:00100000:2.0:1788270040.277173:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597632 00000100:00100000:2.0:1788270040.279716:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788270040.279745:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262597632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.279977:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262597632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (11794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270040.279986:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788270040.283748:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.283832:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788270040.283932:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270040.283987:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270040.284034:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597760 00000100:00100000:0.0:1788270040.284071:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597760 00000100:00100000:0.0:1788270040.284140:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788270040.284153:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262597760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788270040.284279:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:45773:x1875136262597760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270040.284285:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788270040.284378:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262597760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788270040.285274:0:47014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788270040.285485:0:45773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788270040.285516:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788270040.285528:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.285542:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270040.516474:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788270041.290192:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771076 is committed 00010000:00010000:2.0:1788270041.541148:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788270042.309777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270042.309783:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270042.309786:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270042.309789:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270042.309808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270042.309811:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270042.309813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270042.309816:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788270042.309857:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262598272:0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.309926:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270042.309964:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788270042.309971:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262597888:0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.309999:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270042.310024:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262598400:0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.310066:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270042.310092:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262598016:0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.310115:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270042.310134:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270042.310140:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262598144:0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.310161:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270042.310193:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598400 00000100:00100000:0.0:1788270042.310199:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598400 00000100:00100000:0.0:1788270042.310236:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598144 00000100:00100000:0.0:1788270042.310240:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598144 00000100:00100000:0.0:1788270042.310259:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788270042.310268:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262598400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.310321:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262598400:12345-0@lo:400:kworker.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270042.310328:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788270042.310344:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788270042.310350:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262598144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.310381:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262598144:12345-0@lo:400:kworker.0 Request processed in 31us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270042.310387:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788270042.310405:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598272 00000100:00100000:0.0:1788270042.310409:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598272 00000100:00100000:0.0:1788270042.310431:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598016 00000100:00100000:0.0:1788270042.310434:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598016 00000100:00100000:0.0:1788270042.310447:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270042.310453:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262598272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.310484:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262598272:12345-0@lo:400:kworker.0 Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270042.310490:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270042.310501:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788270042.310507:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262598016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270042.310786:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262597888 00000100:00100000:2.0:1788270042.310791:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262597888 00000100:00100000:2.0:1788270042.310823:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788270042.310831:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:3609:x1875136262597888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270042.310866:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:3609:x1875136262597888:12345-0@lo:400:kworker.0 Request processed in 37us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270042.310872:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788270042.310962:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c276264000 x1875136262598144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270042.310976:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262598144:0@lo:400:kworker.0 00000100:00100000:2.0:1788270042.311001:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262597888:0@lo:400:kworker.0 00010000:00080000:2.0:1788270042.311011:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c276267480 x1875136262598400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270042.311020:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262598400:0@lo:400:kworker.0 00000100:00100000:2.0:1788270042.311027:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771076 gen 2 00000004:00080000:2.0:1788270042.311032:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771073 committed transno 30064771076 00000004:00080000:2.0:1788270042.311069:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771074 committed transno 30064771076 00000004:00080000:2.0:1788270042.311079:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771075 committed transno 30064771076 00000004:00080000:2.0:1788270042.311088:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771076 committed transno 30064771076 00000100:00100000:2.0:1788270042.311098:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262598272:0@lo:400:kworker.0 00000100:00100000:0.0:1788270042.314457:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262598016:12345-0@lo:400:kworker.0 Request processed in 3939us (4331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270042.314470:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788270042.314477:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262598016:0@lo:400:kworker.0 00000100:00100000:1.0:1788270042.315757:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270042.315772:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262598528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270042.315823:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270042.315866:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598528 00000100:00100000:1.0:1788270042.315873:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598528 00000100:00100000:1.0:1788270042.315913:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788270042.315922:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262598528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270042.315954:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270042.315996:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262598528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270042.316003:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788270042.316056:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262598528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270042.564439:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788270043.322001:0:47277:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788270043.322007:0:47277:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788270043.322008:0:47277:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788270043.322188:0:47277:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c27a608000 00000020:01000004:0.0:1788270043.322208:0:47277:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788270043.322224:0:47277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788270043.322242:0:47277:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98c2759d4d28) 00000020:00000080:0.0:1788270043.322264:0:47277:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000001:00100000:2.0:1788270043.337456:0:46509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00100000:10000000:3.0:1788270043.373339:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788270043.374705:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788270043.375176:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788270043.375426:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788270043.375693:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788270043.376327:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788270043.376631:0:47277:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788270043.379911:0:47277:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788270043.380338:0:47277:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788270043.380355:0:47277:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788270043.380371:0:47277:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f5d7a016e0850d 00000020:01000004:3.0:1788270043.380381:0:47277:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788270043.380410:0:47277:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788270043.380415:0:47277:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788270043.380422:0:47277:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788270043.380428:0:47277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788270043.380454:0:47277:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98c248a299b8) 00000020:00000080:3.0:1788270043.380469:0:47277:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788270043.383517:0:47277:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788270043.383940:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788270043.383946:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788270043.390691:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788270043.390713:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788270043.395185:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788270043.395203:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788270043.400470:0:47277:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788270043.400683:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788270043.400689:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788270043.405358:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788270043.405390:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788270043.434175:0:47277:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788270043.434564:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788270043.434582:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788270043.439070:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788270043.439084:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788270043.439825:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788270043.439833:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788270043.442428:0:47277:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788270043.442632:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788270043.442638:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788270043.447262:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788270043.447342:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788270043.483375:0:47277:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788270043.483604:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788270043.483612:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788270043.484497:0:47277:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788270043.484504:0:47277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788270043.485623:0:47277:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788270043.485653:0:47277:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788270043.485848:0:47277:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788270043.499123:0:47277:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788270043.499173:0:47277:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788270043.499179:0:47277:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788270043.499181:0:47277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788270043.499182:0:47277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788270043.499183:0:47277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788270043.499185:0:47277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788270043.499186:0:47277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788270043.499188:0:47277:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788270043.499190:0:47277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788270043.499192:0:47277:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788270043.499197:0:47277:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788270043.499200:0:47277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788270043.499201:0:47277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788270043.499203:0:47277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788270043.499204:0:47277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788270043.499205:0:47277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788270043.499207:0:47277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788270043.499208:0:47277:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788270043.499209:0:47277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788270043.499210:0:47277:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788270043.499247:0:47277:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788270043.499275:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262598656:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788270043.499362:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.499540:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2486613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270043.499602:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598656 00000100:00100000:2.0:1788270043.499610:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598656 00000100:00100000:2.0:1788270043.499694:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788270043.499703:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:47277:x1875136262598656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788270043.499736:0:45771:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788270043.499739:0:45771:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788270043.499743:0:45771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788270043.500131:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+18:47277:x1875136262598656:12345-0@lo:253:mount.lustre.0 Request processed in 417us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.500146:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262598656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788270043.500156:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 10000000:01000000:0.0:1788270043.500164:0:47277:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788270043.500168:0:47277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788270043.500170:0:47277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788270043.500171:0:47277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788270043.500173:0:47277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788270043.500174:0:47277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788270043.500177:0:47277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788270043.500180:0:47277:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788270043.500181:0:47277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788270043.500183:0:47277:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788270043.500207:0:47277:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c27a608000 from lustre-OST0000 10000000:01000000:0.0:1788270043.500240:0:47277:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788270043.500244:0:47277:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788270043.500253:0:47277:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c14378b370 local copy 00010000:00010000:0.0:1788270043.500265:0:47277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270043.500356:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262598784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270043.500513:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.500543:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270043.500561:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598784 00000100:00100000:2.0:1788270043.500601:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598784 00000100:00100000:2.0:1788270043.500646:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788270043.500660:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:47277:x1875136262598784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270043.500771:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+18:47277:x1875136262598784:12345-0@lo:501:mount.lustre.0 Request processed in 116us (257us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270043.500779:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262598784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270043.500786:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 10000000:01000000:0.0:1788270043.500802:0:47277:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788270043.500821:0:47277:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788270043.500827:0:47277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.500834:0:47277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270043.500861:0:47277:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c27a608000 10000000:01000000:0.0:1788270043.500867:0:47277:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788270043.500873:0:47277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788270043.500875:0:47277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788270043.500880:0:47277:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788270043.500883:0:47277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788270043.500909:0:47277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.500918:0:47277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.500928:0:47277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270043.500941:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262598912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788270043.500974:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.500992:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270043.501014:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262598912 00000100:00100000:2.0:1788270043.501021:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262598912 00000100:00100000:0.0:1788270043.501081:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788270043.501090:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+18:47277:x1875136262598912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270043.501099:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270043.501113:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1410f0000/0xc5f5d7a016e08522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0851b expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.501312:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1410f0000/0xc5f5d7a016e08522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0851b expref: 19 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.501325:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1410f0000/0xc5f5d7a016e08522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0851b expref: 19 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.501335:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0000, rc 0) 00000100:00100000:0.0:1788270043.501390:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262598912:12345-0@lo:101:mount.lustre.0 Request processed in 301us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.501397:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788270043.501620:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262598912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788270043.501633:0:47277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08522 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.501642:0:47277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08522 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270043.506110:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:2.0:1788270043.508635:0:47277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270043.510673:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1788270043.510723:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:3.0:1788270043.510741:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:3.0:1788270043.510770:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:3.0:1788270043.510787:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:3.0:1788270043.510800:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:3.0:1788270043.510814:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:3.0:1788270043.510826:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:3.0:1788270043.510838:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:3.0:1788270043.510850:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:3.0:1788270043.510863:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:3.0:1788270043.510875:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:3.0:1788270043.510901:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:3.0:1788270043.510907:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:3.0:1788270043.511033:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270043.511237:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.511318:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788270043.511362:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599040 00000100:00100000:2.0:1788270043.511369:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599040 00000100:00100000:2.0:1788270043.511424:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788270043.511434:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270043.511710:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599040:12345-0@lo:501:mount.lustre.0 Request processed in 277us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.511718:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788270043.511784:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270043.511819:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270043.511861:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.511915:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.511955:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599168 00000100:00100000:0.0:1788270043.511962:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599168 00000100:00100000:0.0:1788270043.512027:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788270043.512035:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270043.512770:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599168:12345-0@lo:503:mount.lustre.0 Request processed in 734us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.512779:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788270043.512882:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788270043.513314:0:47277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788270043.513382:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270043.513425:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.513490:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.513545:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599296 00000100:00100000:0.0:1788270043.513552:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599296 00000100:00100000:0.0:1788270043.513600:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788270043.513608:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.513993:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599296:12345-0@lo:502:mount.lustre.0 Request processed in 385us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.514001:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788270043.514091:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270043.514270:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:3.0:1788270043.514294:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:3.0:1788270043.514308:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:3.0:1788270043.514321:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:3.0:1788270043.514348:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:3.0:1788270043.514363:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:3.0:1788270043.514377:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:3.0:1788270043.514390:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:3.0:1788270043.514402:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:3.0:1788270043.514414:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:3.0:1788270043.514426:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:3.0:1788270043.514439:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:3.0:1788270043.514461:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270043.514495:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.514523:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788270043.514588:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599424 00000100:00100000:1.0:1788270043.514594:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599424 00000100:00100000:1.0:1788270043.514630:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788270043.514638:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788270043.514720:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599424:12345-0@lo:502:mount.lustre.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270043.514727:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788270043.514853:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270043.514888:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:3.0:1788270043.514895:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788270043.515663:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788270043.515673:0:47294:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788270043.515679:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.515682:0:47294:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788270043.515687:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788270043.515702:0:47294:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98c2759d19b8) 00000020:00000080:0.0:1788270043.515725:0:47294:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788270043.515733:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788270043.515821:0:47294:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c27a608000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788270043.515830:0:47294:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788270043.515837:0:47294:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5f5d7a016e08530 00010000:00010000:0.0:1788270043.519470:0:47294:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788270043.519951:0:47294:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803791 00080000:10000000:0.0:1788270043.521393:0:47294:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xf:0x0] (8/32) registered 00000020:00000080:0.0:1788270043.522638:0:47294:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788270043.522649:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.522655:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.522657:0:47294:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788270043.522660:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788270043.522663:0:47294:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788270043.522665:0:47294:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788270043.522666:0:47294:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788270043.522667:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788270043.522670:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.522671:0:47294:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788270043.522673:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270043.522676:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.522677:0:47294:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788270043.522680:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788270043.522682:0:47294:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788270043.522684:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.522686:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.522688:0:47294:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788270043.522690:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270043.522692:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.522693:0:47294:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788270043.522697:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788270043.522723:0:47294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.522726:0:47294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.522728:0:47294:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788270043.522731:0:47294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:3.0:1788270043.522992:0:47277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788270043.523025:0:47277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788270043.523067:0:47277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08522 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.523080:0:47277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c1410f1400/0xc5f5d7a016e0851b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08522 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270043.523088:0:47277:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27a608000 from 1 10000000:01000000:3.0:1788270043.523091:0:47277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270043.523126:0:47277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.523138:0:47277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.523148:0:47277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270043.523171:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270043.523237:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.523279:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270043.524702:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599552 00000100:00100000:1.0:1788270043.524713:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599552 00000100:00100000:1.0:1788270043.524756:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788270043.524776:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+19:47277:x1875136262599552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788270043.524790:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270043.524806:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08537 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270043.524831:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 20 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270043.524841:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 20 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270043.524848:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193200, rc 0) 00000100:00100000:1.0:1788270043.524901:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599552:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270043.524909:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788270043.525074:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270043.525094:0:47277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.525103:0:47277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270043.528215:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 13 count 13 00000040:00080000:1.0:1788270043.529632:0:47277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788270043.529950:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:1.0:1788270043.529975:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:1.0:1788270043.529992:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:1.0:1788270043.530007:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:1.0:1788270043.530032:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:1.0:1788270043.530067:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:1.0:1788270043.530082:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:1.0:1788270043.530096:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:1.0:1788270043.530108:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:1.0:1788270043.530120:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10112 00000040:00080000:1.0:1788270043.530132:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 128 off10240 00000040:00080000:1.0:1788270043.530150:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 224 off10464 00000040:00080000:1.0:1788270043.530156:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 12 count 13 00000100:00100000:1.0:1788270043.530237:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788270043.530307:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270043.530363:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249a04f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.530363:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599680 00000100:00100000:0.0:1788270043.530373:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599680 00000100:00100000:0.0:1788270043.530419:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788270043.530429:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270043.530547:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599680:12345-0@lo:501:mount.lustre.0 Request processed in 119us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.530555:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788270043.533219:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788270043.533273:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788270043.533338:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270043.533379:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249a04f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270043.533520:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599808 00000100:00100000:3.0:1788270043.533527:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599808 00000100:00100000:3.0:1788270043.533742:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788270043.533753:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270043.533937:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599808:12345-0@lo:503:mount.lustre.0 Request processed in 185us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270043.533944:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788270043.534088:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788270043.534710:0:47277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788270043.534784:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.534828:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.535096:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788270043.537257:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262599936 00000100:00100000:1.0:1788270043.537270:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262599936 00000100:00100000:1.0:1788270043.537326:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788270043.537336:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788270043.537751:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262599936:12345-0@lo:502:mount.lustre.0 Request processed in 415us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270043.537759:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788270043.538444:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262599936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270043.538800:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:3.0:1788270043.538829:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:3.0:1788270043.538842:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:3.0:1788270043.538856:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:3.0:1788270043.538868:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:3.0:1788270043.538879:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:3.0:1788270043.538891:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:3.0:1788270043.538904:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000040:00080000:3.0:1788270043.538915:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:3.0:1788270043.538926:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10112 00000040:00080000:3.0:1788270043.538939:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 128 off10240 00000100:00100000:3.0:1788270043.538973:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270043.539025:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.539181:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270043.539272:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600064 00000100:00100000:1.0:1788270043.539279:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600064 00000100:00100000:1.0:1788270043.539322:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788270043.539331:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262600064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788270043.539582:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262600064:12345-0@lo:502:mount.lustre.0 Request processed in 252us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270043.539590:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788270043.539711:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788270043.539757:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 224 off10464 00000040:00080000:3.0:1788270043.539766:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788270043.540639:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270043.540649:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.540652:0:47298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788270043.540659:0:47298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27a608000 00000020:00000080:0.0:1788270043.540661:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270043.540669:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.540671:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.540673:0:47298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788270043.540675:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270043.540678:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.540679:0:47298:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788270043.540682:0:47298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27a608000 00000020:00000080:0.0:1788270043.540684:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270043.540776:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.540780:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.540781:0:47298:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788270043.540784:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270043.540786:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.540787:0:47298:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788270043.540791:0:47298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27a608000 00000020:00000080:0.0:1788270043.540793:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270043.543702:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.543729:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.543732:0:47298:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788270043.543736:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788270043.543740:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.543742:0:47298:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788270043.543746:0:47298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27a608000 00000020:00000080:0.0:1788270043.543749:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788270043.543803:0:47298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788270043.543806:0:47298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788270043.543808:0:47298:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788270043.543811:0:47298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 13 count 13 00000020:01000000:0.0:1788270043.543873:0:47277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788270043.543902:0:47277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788270043.543919:0:47277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.543930:0:47277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270043.543988:0:47277:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788270043.543991:0:47277:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c27a608000 10000000:01000000:0.0:1788270043.543994:0:47277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c27a608000 10000000:01000000:0.0:1788270043.543998:0:47277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788270043.544003:0:47277:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c27a608000 from 1 10000000:01000000:0.0:1788270043.544005:0:47277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788270043.544056:0:47277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.544064:0:47277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.544075:0:47277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270043.544100:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788270043.544163:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.544196:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788270043.544324:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600192 00000100:00100000:1.0:1788270043.544331:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600192 00000100:00100000:1.0:1788270043.544383:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788270043.544391:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:47277:x1875136262600192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788270043.544406:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270043.544418:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144192c00/0xc5f5d7a016e0854c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08545 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270043.544438:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144192c00/0xc5f5d7a016e0854c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08545 expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270043.544448:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144192c00/0xc5f5d7a016e0854c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08545 expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270043.544457:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192c00, rc 0) 00000100:00100000:1.0:1788270043.544492:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600192:12345-0@lo:101:mount.lustre.0 Request processed in 101us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270043.544498:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788270043.545498:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270043.545515:0:47277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0854c expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.545525:0:47277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0854c expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270043.548686:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 00000040:00080000:0.0:1788270043.548943:0:47277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788270043.549107:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:0.0:1788270043.549128:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:0.0:1788270043.549139:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:0.0:1788270043.549150:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:0.0:1788270043.549161:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:0.0:1788270043.549171:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:0.0:1788270043.549181:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:0.0:1788270043.549191:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:0.0:1788270043.549201:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:0.0:1788270043.549211:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:0.0:1788270043.549234:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:0.0:1788270043.549245:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:0.0:1788270043.549255:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:0.0:1788270043.549266:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:0.0:1788270043.549276:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:0.0:1788270043.549286:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:0.0:1788270043.549296:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:0.0:1788270043.549306:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:0.0:1788270043.549316:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:0.0:1788270043.549327:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:0.0:1788270043.549337:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:0.0:1788270043.549346:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:0.0:1788270043.549356:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:0.0:1788270043.549367:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:0.0:1788270043.551853:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 160 off12472 00000040:00080000:0.0:1788270043.551892:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12696 00000040:00080000:0.0:1788270043.551916:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12920 00000040:00080000:0.0:1788270043.551929:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off13000 00000040:00080000:0.0:1788270043.551940:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13224 00000040:00080000:0.0:1788270043.551951:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13448 00000040:00080000:0.0:1788270043.551961:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13536 00000040:00080000:0.0:1788270043.551972:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13664 00000040:00080000:0.0:1788270043.551982:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13808 00000040:00080000:0.0:1788270043.551992:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13936 00000040:00080000:0.0:1788270043.552002:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14160 00000040:00080000:0.0:1788270043.552012:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14384 00000040:00080000:0.0:1788270043.552022:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14464 00000040:00080000:0.0:1788270043.552033:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14688 00000040:00080000:0.0:1788270043.552466:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14912 00000040:00080000:0.0:1788270043.552480:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 88 off15000 00000040:00080000:0.0:1788270043.552491:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 128 off15128 00000040:00080000:0.0:1788270043.552501:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].42, 144 off15272 00000040:00080000:0.0:1788270043.552525:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].43, 128 off15400 00000040:00080000:0.0:1788270043.552540:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].44, 224 off15624 00000040:00080000:0.0:1788270043.552551:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].45, 224 off15848 00000040:00080000:0.0:1788270043.552562:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].46, 80 off15928 00000040:00080000:0.0:1788270043.553487:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].47, 224 off16152 00000040:00080000:0.0:1788270043.553499:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].48, 232 off16384 00000040:00080000:0.0:1788270043.553719:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].49, 224 off16608 00000040:00080000:0.0:1788270043.553737:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].50, 120 off16728 00000040:00080000:0.0:1788270043.553751:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].51, 224 off16952 00000040:00080000:0.0:1788270043.553756:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 51 count 51 00000100:00100000:0.0:1788270043.553850:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270043.553908:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.553953:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2488659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270043.554030:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600320 00000100:00100000:1.0:1788270043.554053:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600320 00000100:00100000:1.0:1788270043.554096:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788270043.554104:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788270043.554215:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600320:12345-0@lo:501:mount.lustre.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270043.554222:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788270043.554709:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270043.554741:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270043.554781:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.554807:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600448 00000100:00100000:0.0:1788270043.554811:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600448 00000100:00100000:0.0:1788270043.554838:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788270043.554844:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270043.554909:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600448:12345-0@lo:503:mount.lustre.0 Request processed in 65us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.554916:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788270043.554954:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2488659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.554965:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788270043.555316:0:47277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788270043.555370:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.555419:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.555442:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600576 00000100:00100000:0.0:1788270043.555446:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600576 00000100:00100000:0.0:1788270043.555470:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788270043.555475:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.555545:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600576:12345-0@lo:502:mount.lustre.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.555551:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788270043.555597:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.555609:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270043.555751:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1788270043.555768:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:0.0:1788270043.555775:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:0.0:1788270043.555781:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:0.0:1788270043.555788:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:0.0:1788270043.555805:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:0.0:1788270043.555813:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:0.0:1788270043.555819:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:0.0:1788270043.555826:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1788270043.555833:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:0.0:1788270043.555840:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:0.0:1788270043.555846:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:0.0:1788270043.555853:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:0.0:1788270043.555859:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:0.0:1788270043.555866:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:0.0:1788270043.555872:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:0.0:1788270043.555878:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:0.0:1788270043.555885:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:0.0:1788270043.555891:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:0.0:1788270043.555898:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:0.0:1788270043.555905:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:0.0:1788270043.555920:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:0.0:1788270043.555928:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:0.0:1788270043.555935:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:0.0:1788270043.555942:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 160 off12472 00000040:00080000:0.0:1788270043.555948:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12696 00000040:00080000:0.0:1788270043.555955:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12920 00000040:00080000:0.0:1788270043.555961:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off13000 00000040:00080000:0.0:1788270043.555968:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13224 00000040:00080000:0.0:1788270043.555975:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13448 00000040:00080000:0.0:1788270043.555981:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13536 00000040:00080000:0.0:1788270043.555988:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13664 00000040:00080000:0.0:1788270043.555994:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13808 00000040:00080000:0.0:1788270043.556000:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13936 00000040:00080000:0.0:1788270043.556007:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14160 00000040:00080000:0.0:1788270043.556013:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14384 00000040:00080000:0.0:1788270043.556020:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14464 00000040:00080000:0.0:1788270043.556035:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14688 00000040:00080000:0.0:1788270043.556064:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14912 00000040:00080000:0.0:1788270043.556071:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 88 off15000 00000040:00080000:0.0:1788270043.556079:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 128 off15128 00000040:00080000:0.0:1788270043.556091:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].42, 144 off15272 00000040:00080000:0.0:1788270043.556103:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].43, 128 off15400 00000040:00080000:0.0:1788270043.556116:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].44, 224 off15624 00000040:00080000:0.0:1788270043.556128:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].45, 224 off15848 00000040:00080000:0.0:1788270043.556141:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].46, 80 off15928 00000040:00080000:0.0:1788270043.556150:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].47, 224 off16152 00000040:00080000:0.0:1788270043.556156:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].48, 232 off16384 00000100:00100000:0.0:1788270043.556175:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.556202:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.556220:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600704 00000100:00100000:0.0:1788270043.556223:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600704 00000100:00100000:0.0:1788270043.556240:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788270043.556243:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.556290:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600704:12345-0@lo:502:mount.lustre.0 Request processed in 46us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.556294:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788270043.556319:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.556328:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270043.556409:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].49, 224 off16608 00000040:00080000:0.0:1788270043.556421:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].50, 120 off16728 00000100:00100000:0.0:1788270043.556433:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.556454:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.556468:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600832 00000100:00100000:0.0:1788270043.556470:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600832 00000100:00100000:0.0:1788270043.556484:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788270043.556487:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270043.556542:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262600832:12345-0@lo:502:mount.lustre.0 Request processed in 52us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.556548:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788270043.556585:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.556597:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262600832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270043.556628:0:47277:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].51, 224 off16952 00000040:00080000:0.0:1788270043.556635:0:47277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788270043.558630:0:47302:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788270043.558646:0:47302:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98c275d83370) 00000020:00000080:2.0:1788270043.558667:0:47302:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788270043.558745:0:47302:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c27a608000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788270043.558748:0:47302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c27a608000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788270043.558751:0:47302:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27a608000 3 00010000:00080000:2.0:1788270043.558777:0:47302:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c143bc3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788270043.560335:0:47302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788270043.563558:0:47302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788270043.563684:0:47302:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788270043.563697:0:47302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc5f5d7a016e0855a 00000100:00080000:2.0:1788270043.563708:0:47302:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270043.563714:0:47302:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c143bc3800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270043.563748:0:47302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14409ad80 x1875136262600960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270043.563794:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262600960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788270043.563861:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788270043.563914:0:47302:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788270043.563973:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.563977:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788270043.563980:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.563983:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788270043.564007:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.564010:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788270043.564012:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.564015:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788270043.564065:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262600960 00000100:00100000:2.0:1788270043.564072:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262600960 00000100:00100000:2.0:1788270043.564101:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788270043.564108:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262600960:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788270043.564141:0:45776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 835 last 0 00000020:00000080:2.0:1788270043.564171:0:45776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc5f5d7a016e08561 00000004:00100000:2.0:1788270043.564186:0:45776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788270043.564213:0:45776:0:(import.c:65:import_set_state_nolock()) ffff98c143bc6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270043.564261:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875136262600960:12345-0@lo:38:llog_process_th.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.564268:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788270043.564292:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262601088:0@lo:400:kworker.0 00000100:00100000:2.0:1788270043.564319:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270043.564340:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270043.564345:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262601472:0@lo:400:kworker.0 00000100:00100000:2.0:1788270043.564367:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.566633:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601088 00000100:00100000:0.0:1788270043.566645:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601088 00000100:00100000:2.0:1788270043.566675:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262601216:0@lo:400:kworker.0 00000100:00100000:0.0:1788270043.566689:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788270043.566697:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262601088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270043.566722:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270043.566744:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270043.566748:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262601088:12345-0@lo:400:kworker.0 Request processed in 52us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.566750:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262601344:0@lo:400:kworker.0 00000100:00100000:0.0:1788270043.566756:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788270043.566771:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.566789:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601344 00000100:00100000:0.0:1788270043.566793:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601344 00000100:00100000:2.0:1788270043.566803:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601472 00000100:00100000:2.0:1788270043.566805:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601472 00000100:00100000:0.0:1788270043.566810:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788270043.566816:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262601344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270043.566825:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601216 00000100:00100000:2.0:1788270043.566827:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601216 00000100:00100000:2.0:1788270043.566840:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788270043.566846:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262601472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270043.566848:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262601344:12345-0@lo:400:kworker.0 Request processed in 33us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270043.566854:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788270043.566871:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262601472:12345-0@lo:400:kworker.0 Request processed in 25us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.566876:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788270043.566885:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c271ff8000 x1875136262601472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270043.566888:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788270043.566894:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262601216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270043.566900:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262601472:0@lo:400:kworker.0 00000100:00100000:0.0:1788270043.566912:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262601088:0@lo:400:kworker.0 00000100:00100000:2.0:1788270043.566915:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262601216:12345-0@lo:400:kworker.0 Request processed in 22us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.566920:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788270043.566945:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c14409ad80 x1875136262600960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788270053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270043.566953:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788270043.566960:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00080000:2.0:1788270043.566967:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788270043.566971:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788270043.566975:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c143bc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788270043.566981:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1875136262600960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788270043.567035:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262601344:0@lo:400:kworker.0 00010000:00080000:2.0:1788270043.567064:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c14409bb80 x1875136262601216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270043.567072:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262601216:0@lo:400:kworker.0 00000020:01000004:2.0:1788270043.567186:0:47302:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788270043.567199:0:47302:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98c275d80000) 00000020:00000080:2.0:1788270043.567218:0:47302:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788270043.567289:0:47302:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c27a608000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788270043.567293:0:47302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c27a608000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788270043.567295:0:47302:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c27a608000 3 00010000:00080000:2.0:1788270043.567323:0:47302:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27b77b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788270043.574874:0:47302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788270043.575178:0:47302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788270043.575227:0:47302:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788270043.575240:0:47302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc5f5d7a016e0856f 00000100:00080000:2.0:1788270043.575251:0:47302:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270043.575257:0:47302:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98c27b77b800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270043.575302:0:47302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c271ff8700 x1875136262601600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788270043.575334:0:47302:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788270043.575358:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.575363:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788270043.575366:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.575368:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788270043.575372:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1788270043.575604:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1875136262601600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788270043.575676:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.575735:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601600 00000100:00100000:3.0:1788270043.575742:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601600 00000100:00100000:3.0:1788270043.575769:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788270043.575776:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1875136262601600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788270043.575799:0:45778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 835 last 0 00000020:00000080:3.0:1788270043.575826:0:45778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc5f5d7a016e08576 00000004:00100000:3.0:1788270043.575839:0:45778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788270043.575868:0:45778:0:(import.c:65:import_set_state_nolock()) ffff98c143798000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788270043.575910:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875136262601600:12345-0@lo:38:llog_process_th.0 Request processed in 133us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270043.575916:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788270043.575949:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c271ff8700 x1875136262601600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788270053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270043.575959:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788270043.575965:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 7 00000100:00080000:3.0:1788270043.575971:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788270043.575975:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788270043.575977:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c27b77b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788270043.575982:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1875136262601600:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788270043.576269:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788270043.576272:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788270043.576275:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788270043.576831:0:47302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 52 count 51 00000020:01000000:0.0:1788270043.576886:0:47277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788270043.576919:0:47277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788270043.576935:0:47277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0854c expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.576945:0:47277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c1410f0800/0xc5f5d7a016e08545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0854c expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788270043.576987:0:47277:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788270043.576989:0:47277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788270043.576990:0:47277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788270043.576991:0:47277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788270043.576992:0:47277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788270043.576993:0:47277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788270043.576995:0:47277:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788270043.576997:0:47277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788270043.576999:0:47277:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788270043.577003:0:47277:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788270043.577006:0:47277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788270043.577007:0:47277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788270043.577008:0:47277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788270043.577009:0:47277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788270043.577010:0:47277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788270043.577011:0:47277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788270043.577012:0:47277:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788270043.577013:0:47277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788270043.577014:0:47277:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788270043.577032:0:47277:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788270043.577065:0:47277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262601728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788270043.577114:0:47277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270043.577142:0:47277:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270043.577163:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601728 00000100:00100000:0.0:1788270043.577168:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601728 00000100:00100000:0.0:1788270043.577197:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788270043.577204:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262601728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788270043.577223:0:45770:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788270043.577235:0:45770:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788270043.581817:0:45770:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788270043.581840:0:45770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788270043.582074:0:45792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788270043.582080:0:45792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788270043.582103:0:45792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.582122:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.582131:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.582138:0:45792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.582178:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.582192:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270043.582207:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262601856:0@lo:104: 00000100:00100000:2.0:1788270043.582217:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:47277:x1875136262601728:12345-0@lo:253:mount.lustre.0 Request processed in 5012us (5101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.582226:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788270043.582244:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788270043.582286:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 20 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.582294:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 20 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270043.582296:0:47277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:47277:1875136262601728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788270043.582302:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262601984:0@lo:104: 10000000:01000000:1.0:1788270043.582307:0:47277:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788270043.582310:0:47277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788270043.582312:0:47277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788270043.582313:0:47277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270043.582314:0:47277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270043.582316:0:47277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270043.582317:0:47277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270043.582319:0:47277:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788270043.582321:0:47277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:3.0:1788270043.582323:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788270043.582323:0:47277:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788270043.582335:0:47277:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788270043.582346:0:45792:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2759f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270043.582368:0:45760:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788270043.582391:0:45760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601856 00000100:00100000:3.0:1788270043.582396:0:45760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601856 00000100:00100000:2.0:1788270043.582407:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262601984 00000100:00100000:2.0:1788270043.582410:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262601984 00000100:00100000:2.0:1788270043.582423:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788270043.582436:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+4:45792:x1875136262601856:12345-0@lo:104: 00010000:00010000:2.0:1788270043.582448:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.582488:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788270043.582494:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+4:45792:x1875136262601856:12345-0@lo:104: Request processed in 64us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.583167:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788270043.583192:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788270043.583199:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262601984:12345-0@lo:104: 00010000:00010000:2.0:1788270043.583209:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.583251:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788270043.583257:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a1e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262601984:12345-0@lo:104: Request processed in 59us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.583264:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788270043.583275:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788270043.583281:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.583288:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788270043.583292:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.583298:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270043.583301:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788270043.583313:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270043.583318:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788270043.583337:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262601856:0@lo:104: 00000100:00100000:2.0:1788270043.583346:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262601984:0@lo:104: 00010000:00010000:0.0:1788270043.583346:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.583352:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788270043.583359:0:45792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.583367:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.583373:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c240030e00/0xc5f5d7a016e084ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084d5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270043.583384:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270043.583386:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270043.583387:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270043.583406:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262602112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788270043.583437:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270043.583652:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602112 00000100:00100000:2.0:1788270043.583658:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602112 00010000:00010000:2.0:1788270043.583675:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270043.583848:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788270043.583856:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+21:3608:x1875136262602112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270043.583866:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270043.583871:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.583881:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.583895:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030c00/0xc5f5d7a016e084d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e084ce expref: 21 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.583905:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:0.0:1788270043.584154:0:47277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00100000:2.0:1788270043.584194:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+20:3608:x1875136262602112:12345-0@lo:103:ldlm_bl.0 Request processed in 338us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270043.584202:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788270043.584256:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270043.584262:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.584269:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788270043.584272:0:45764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.584278:0:45764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788270043.584284:0:45764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788270043.584289:0:45764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788270043.584308:0:45764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.584314:0:45764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788270043.584327:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.584333:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c1410f0600/0xc5f5d7a016e084c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084c7 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.584344:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270043.584346:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270043.584348:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270043.584358:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270043.584367:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262602240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270043.585112:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262602112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788270043.585138:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270043.585177:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602240 00000100:00100000:3.0:1788270043.585183:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602240 00010000:00010000:2.0:1788270043.585184:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270043.585186:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270043.585200:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 20 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270043.585224:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788270043.585231:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5051c9b2-4d56-4172-904c-6f13b6100451+20:3610:x1875136262602240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270043.585240:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270043.585245:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 20 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585255:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 20 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585266:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c144192000/0xc5f5d7a016e084c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e084c0 expref: 20 pid: 45770 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585283:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585292:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788270043.585306:0:45762:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005579559s 00010000:00010000:3.0:1788270043.585310:0:45762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585317:0:45762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585323:0:45762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585330:0:45762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585335:0:45762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ee200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270043.585339:0:45762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585346:0:45762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585367:0:45762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270043.585377:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270043.585409:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5051c9b2-4d56-4172-904c-6f13b6100451+19:3610:x1875136262602240:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270043.585416:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788270043.585649:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262602240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270043.585671:0:45792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.585678:0:45792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270043.585684:0:45792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c24a9ee200/0xc5f5d7a016e0857d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788270043.589285:0:47277:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788270043.589293:0:47277:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788270043.589326:0:47277:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788270043.589359:0:47277:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788270043.589375:0:47277:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788270043.589393:0:47277:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788270043.590010:0:47277:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788270043.590220:0:47277:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788270043.590736:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788270044.070673:0:47358:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788270044.070876:0:47358:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788270044.612103:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270034/real 1788270034] req@ffff98c27fb72d80 x1875136262589568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270044 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270044.612131:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27fb72d80 x1875136262589568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270044 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270044.612141:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270034/real 1788270034] req@ffff98c27fb73800 x1875136262589312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270044 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270044.612210:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27fb73800 x1875136262589312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270044 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788270044.612230:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788270044.612250:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788270044.612254:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262589568:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788270044.612260:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c26b847800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788270044.612265:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788270044.612268:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262589312:0@lo:8:llog_process_th.0 00010000:00010000:2.0:1788270044.612383:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788270044.615366:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270044.615373:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270044.615377:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270044.615380:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788270044.615397:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270044.615400:0:38087:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788270044.615404:0:38087:0:(import.c:65:import_set_state_nolock()) ffff98c26b847800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788270044.615412:0:38087:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 826 00000100:00080000:0.0:1788270044.615417:0:38087:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788270044.615424:0:38087:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98c26b847800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788270044.615445:0:38087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c276267480 x1875136262602880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788270044.615462:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270044.615466:0:38087:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788270044.615468:0:38087:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788270044.615471:0:38087:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 826 00000100:00080000:0.0:1788270044.615474:0:38087:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788270044.615478:0:38087:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c144088800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788270044.615492:0:38087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c276265c00 x1875136262603008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788270044.615571:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262602368:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615643:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615683:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262603136:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615714:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615740:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270044.615747:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262602752:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615776:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615802:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262602496:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615827:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615844:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262603264:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615870:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615890:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788270044.615896:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262602624:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615918:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615935:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262603392:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.615956:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.615985:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602368 00000100:00100000:0.0:1788270044.615993:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602368 00000100:00100000:1.0:1788270044.616064:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602752 00000100:00100000:1.0:1788270044.616069:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602752 00000100:00100000:1.0:1788270044.616098:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602496 00000100:00100000:1.0:1788270044.616101:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602496 00000100:00100000:1.0:1788270044.616121:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788270044.616132:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262602752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270044.616220:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788270044.616230:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262602496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270044.616272:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262602496:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270044.616279:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788270044.616317:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262602496:0@lo:400:kworker.0 00000100:00100000:2.0:1788270044.616349:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603136 00000100:00100000:2.0:1788270044.616353:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603136 00000100:00100000:2.0:1788270044.616372:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603264 00000100:00100000:2.0:1788270044.616374:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603264 00000100:00100000:1.0:1788270044.616452:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262602752:12345-0@lo:400:kworker.0 Request processed in 321us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270044.616460:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788270044.616491:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602624 00000100:00100000:1.0:1788270044.616495:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602624 00000100:00100000:1.0:1788270044.616511:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603392 00000100:00100000:1.0:1788270044.616514:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603392 00000100:00100000:0.0:1788270044.616525:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788270044.616572:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+19:3610:x1875136262602368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.616606:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+19:3610:x1875136262602368:12345-0@lo:400:kworker.0 Request processed in 42us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270044.616611:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788270044.616649:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788270044.616853:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788270044.616861:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262602624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270044.616900:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262602624:12345-0@lo:400:kworker.0 Request processed in 40us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270044.616907:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788270044.616972:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262603136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.617008:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262603136:12345-0@lo:400:kworker.0 Request processed in 353us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270044.617014:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788270044.617064:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262602752:0@lo:400:kworker.0 00000100:00100000:0.0:1788270044.617075:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262602368:0@lo:400:kworker.0 00010000:00080000:0.0:1788270044.617094:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c276264000 x1875136262603136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270044.617104:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262603136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270044.619647:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788270044.619660:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270044.619664:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262603392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788270044.619667:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270044.619747:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262603392:12345-0@lo:400:kworker.0 Request processed in 89us (3788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270044.619756:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788270044.619773:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788270044.619780:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262603264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270044.619811:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262603264:12345-0@lo:400:kworker.0 Request processed in 32us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270044.619818:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788270044.619844:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c276265180 x1875136262602624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270044.619851:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262602880:0@lo:8:kworker.0 00000100:00100000:2.0:1788270044.619872:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262602624:0@lo:400:kworker.0 00010000:00080000:2.0:1788270044.619893:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c276264a80 x1875136262603392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270044.619904:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270044.619909:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262603392:0@lo:400:kworker.0 00010000:00080000:2.0:1788270044.619924:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c276265500 x1875136262603264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270044.619932:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262603264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270044.619948:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262603008:0@lo:8:kworker.0 00000100:00100000:1.0:1788270044.619977:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270044.620020:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262602880 00000100:00100000:1.0:1788270044.620026:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262602880 00000100:00100000:1.0:1788270044.620080:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603008 00000100:00100000:1.0:1788270044.620084:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603008 00000100:00100000:2.0:1788270044.620088:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270044.620095:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262602880:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788270044.620121:0:47284:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 836 last 0 00000020:00000080:2.0:1788270044.620150:0:47284:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e08584 00002000:00100000:2.0:1788270044.620165:0:47284:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98c143bc0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788270044.620169:0:47284:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788270044.620172:0:47284:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788270044.620326:0:47284:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788270044.620349:0:47284:0:(import.c:65:import_set_state_nolock()) ffff98c2491e9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270044.620389:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3606:x1875136262602880:12345-0@lo:8:kworker.0 Request processed in 293us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270044.620396:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788270044.620409:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788270044.620414:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262603008:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788270044.620425:0:47284:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788270044.620449:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262603008:12345-0@lo:8:kworker.0 Request processed in 34us (472us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788270044.620454:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788270044.620478:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c276267480 x1875136262602880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788270059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270044.620486:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788270044.620492:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 7 00000100:00080000:2.0:1788270044.620499:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788270044.620504:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788270044.620506:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c26b847800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788270044.620519:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788270044.620523:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262602880:0@lo:8:kworker.0 00000100:00080000:2.0:1788270044.620533:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788270044.620537:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788270044.620540:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262603008:0@lo:8:kworker.0 00000004:00080000:2.0:1788270044.620632:0:46518:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788270044.620689:0:46518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 836327649115ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788270044.620696:0:46518:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788270044.620968:0:46519:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0xa3:0x0] 00000100:00100000:2.0:1788270044.620987:0:46519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:46519:1875136262603648:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788270044.621014:0:46519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270044.621033:0:46519:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24888dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270044.621071:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262603520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270044.621095:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270044.621127:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603648 00000100:00100000:2.0:1788270044.621132:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603648 00000100:00100000:2.0:1788270044.621171:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788270044.621180:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:46519:x1875136262603648:12345-0@lo:5:osp-pre-0-1.0 00000100:00080000:0.0:1788270044.623123:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270044.624145:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603520 00000100:00100000:3.0:1788270044.624154:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603520 00000100:00100000:3.0:1788270044.624197:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788270044.624207:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262603520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270044.624228:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788270044.624313:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262603520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (3215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270044.624321:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1788270044.624472:0:47281:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788270044.624480:0:47281:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -30 00002000:02000040:2.0:1788270044.624484:0:47281:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:164 to 0x280000400:193) 00000004:00080000:3.0:1788270044.625655:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1788270044.626422:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c271ffb480 x1875136262603520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788270060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270044.626447:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262603520:0@lo:13:osp-pre-0-1.0 00002000:00010000:2.0:1788270044.633763:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270044.633775:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.633793:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=836s v=(0 0) 00010000:00010000:2.0:1788270044.633798:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270044.633804:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.633961:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.633975:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.633983:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634005:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270044.634029:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270044.634052:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634062:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270044.634068:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634077:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634096:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634103:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076c65ee/0xc5f5d7a016e0858b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634120:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.634122:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.634125:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270044.634468:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270044.634475:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634485:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=836s v=(0 0) 00010000:00010000:2.0:1788270044.634488:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270044.634492:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634501:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634510:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634518:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634536:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270044.634569:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270044.634575:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634583:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270044.634587:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634595:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634607:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634614:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d402a291/0xc5f5d7a016e08592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.634629:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.634631:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.634632:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270044.634902:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270044.634909:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634918:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=836s v=(0 0) 00010000:00010000:2.0:1788270044.634921:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270044.634926:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634935:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634950:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.634957:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.636590:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788270044.638223:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270044.638236:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.638254:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=836s v=(0 0) 00010000:00010000:2.0:1788270044.638259:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270044.638266:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.638281:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.638292:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.638300:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641795:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270044.641810:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641823:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.641828:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641838:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641862:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641870:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007451c501/0xc5f5d7a016e08599 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641892:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.641896:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641902:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.641904:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641912:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641922:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.641929:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.641931:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.641933:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.642010:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788270044.642017:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000707c14ee/0xc5f5d7a016e085a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270044.642536:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270044.642542:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.642566:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=836s v=(0 0) 00010000:00010000:2.0:1788270044.642570:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270044.642576:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.642588:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.642596:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.642604:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.642626:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.642756:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.642763:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.642772:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.642777:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.642791:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.642804:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.642812:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6578ef/0xc5f5d7a016e085a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.642829:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.642831:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.642833:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.642860:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270044.642992:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270044.642999:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.643007:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=836s v=(0 0) 00010000:00010000:2.0:1788270044.643011:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270044.643015:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.643025:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.643033:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.643689:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.643742:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788270044.644361:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.644369:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.644380:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.644384:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.644390:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.644402:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.644411:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.644420:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644471:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270044.644478:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644486:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.644490:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644499:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644513:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644526:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e085ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644540:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.644554:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644561:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.644564:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644571:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644581:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644589:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.644591:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.644593:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.644649:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788270044.644654:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e085b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.644791:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.645181:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.645188:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645197:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.645201:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.645205:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645215:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645229:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645237:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645286:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788270044.645568:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.645574:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645583:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.645587:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.645591:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645601:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645609:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.645617:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645686:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270044.645693:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645700:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270044.645704:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645711:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645731:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645737:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e085bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645755:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270044.645759:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645765:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270044.645768:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645775:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645785:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.645792:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.645794:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.645796:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.646020:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788270044.646026:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e085c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.646246:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.646728:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.646736:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.646745:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.646749:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.646753:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.646764:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.646772:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.646780:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.646797:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.646821:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.646828:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.646843:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.646847:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.646855:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.646869:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.646876:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.646892:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.646894:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.646896:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.652323:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.652337:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.652358:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.652363:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.652370:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.652385:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.652396:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.652405:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.652434:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270044.652456:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270044.652465:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.652475:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270044.652481:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.652491:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.652510:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.652518:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e085d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.652537:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.652539:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.652541:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.655432:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.655447:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.655464:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.655469:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.655475:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.655489:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.655505:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.655513:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.655535:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.655672:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.655680:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.655690:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.655695:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.655704:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.655723:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.655731:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e085d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.655747:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.655749:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.655750:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.657741:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.657755:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.657770:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.657774:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.657779:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.657792:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.657801:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.657808:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.657834:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.657860:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.657868:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.657880:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.657956:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.657968:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.657984:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.657992:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e085df lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.658016:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.658018:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.658020:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.658373:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.658380:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.658389:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.658392:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.658396:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.658406:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.658415:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.658423:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.658443:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270044.658933:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270044.658941:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.659018:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270044.659023:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.659032:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.659145:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.659153:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e085e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.659166:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.659168:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.659169:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.664064:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.664081:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664099:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.664104:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.664111:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664124:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664135:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664142:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664162:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.664207:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.664215:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664226:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.664231:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664243:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664262:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664271:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e962c3/0xc5f5d7a016e085ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664287:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.664289:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.664291:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.664710:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.664716:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664725:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.664729:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.664733:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664742:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664749:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664757:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.664773:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.664793:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.664800:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664815:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.664820:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664828:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664839:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664847:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e085f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.664861:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.664863:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.664865:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.665030:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.665036:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.665088:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.665091:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.665096:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.665105:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.665111:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.665118:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.665196:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.665312:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.665318:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665326:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.665329:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665337:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665348:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665355:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f492d31/0xc5f5d7a016e085fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665372:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.665374:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.665376:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.665506:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.665524:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.665533:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.665536:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.665541:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.665561:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.665569:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.665576:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.665596:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.665752:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.665757:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665764:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.665768:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665776:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665788:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665795:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08602 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.665812:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.665814:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.665816:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.666002:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.666008:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666016:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.666019:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.666023:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666066:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666074:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666082:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666097:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.666219:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.666224:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666231:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.666235:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666242:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666252:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666258:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b34339e/0xc5f5d7a016e08609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666271:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.666272:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.666274:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.666406:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.666411:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666420:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.666423:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.666427:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666435:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666441:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666454:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666473:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.666699:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.666704:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666717:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.666720:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666728:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666739:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666746:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e08610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.666758:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.666760:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.666761:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.666833:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.666839:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666847:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.666850:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.666854:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666864:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666871:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666878:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.666936:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.667169:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.667174:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667182:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.667185:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667193:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667204:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667209:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08617 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667222:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.667223:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.667225:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.667325:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.667331:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.667346:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.667349:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.667353:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.667362:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.667370:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.667377:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.667394:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.667415:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.667421:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667429:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.667433:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667441:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667452:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667460:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0861e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.667479:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.667481:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.667483:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.667995:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.668002:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668011:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.668015:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.668019:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668028:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668075:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668084:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668120:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270044.668151:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270044.668157:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.668166:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270044.668171:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.668178:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.668190:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.668197:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e08625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.668212:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.668213:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270044.668215:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.668386:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.668392:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668400:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.668403:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.668407:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668416:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668425:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668433:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.668575:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.668595:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.668601:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.668608:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.668611:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.668618:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.668631:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.668639:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000768af9da/0xc5f5d7a016e0862c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.668656:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.668658:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.668660:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.669070:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.669077:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669086:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.669090:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.669095:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669105:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669113:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669120:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669134:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.669163:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.669169:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.669182:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.669185:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.669192:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.669203:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.669211:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f2b5ca1/0xc5f5d7a016e08633 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.669224:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.669227:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.669229:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.669394:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.669400:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669408:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.669412:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.669415:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669425:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669445:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669452:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.669472:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.670372:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.670379:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.670389:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.670393:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.670401:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.670415:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.670422:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdc8381/0xc5f5d7a016e0863a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.670439:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.670441:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.670443:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270044.670756:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270044.670764:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.670774:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=836s v=(0 0) 00010000:00010000:1.0:1788270044.670777:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270044.670782:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.670792:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.670800:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.670809:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.670832:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270044.673884:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270044.673897:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.673912:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270044.673917:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.673928:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.673947:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.673961:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e08641 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.673981:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.673982:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270044.673984:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.674384:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.674393:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.674403:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.674408:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.674414:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.674426:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.674435:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.674442:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.675178:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270044.675280:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270044.675289:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.675299:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270044.675304:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.675312:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.675326:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.675333:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e08648 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270044.675348:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270044.675351:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270044.675353:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.675788:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.675795:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.675806:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.675809:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.675813:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.675822:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.675830:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.675836:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.675946:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270044.676185:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.676192:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676202:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.676206:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676215:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676228:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676237:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e0864f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676256:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.676258:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.676260:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270044.676338:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270044.676344:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.676353:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=836s v=(0 0) 00010000:00010000:0.0:1788270044.676356:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270044.676361:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.676370:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.676378:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.676386:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.676435:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788270044.676465:0:47281:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:163 00000100:00100000:0.0:1788270044.676572:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:46519:x1875136262603648:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55390us (55552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270044.676586:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270044.676595:0:46519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:46519:1875136262603648:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788270044.676614:0:46519:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0xc1:0x0] from OST, last_created [0x280000400:0xc1:0x0]last_used is [0x280000400:0xa3:0x0] 00000100:00100000:1.0:1788270044.676658:0:46519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:46519:1875136262603776:0@lo:5:osp-pre-0-1.0 00010000:00010000:3.0:1788270044.676678:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270044.676685:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270044.676693:0:46519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788270044.676699:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270044.676704:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676712:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270044.676723:0:46519:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512440c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788270044.676725:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676735:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08656 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.676748:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.676750:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270044.676752:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270044.676758:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603776 00000100:00100000:2.0:1788270044.676764:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603776 00000100:00100000:2.0:1788270044.676805:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788270044.676815:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:46519:x1875136262603776:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788270044.676851:0:47284:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 194 00000001:00080000:1.0:1788270044.683932:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771073 is committed 00000001:00100000:1.0:1788270044.683995:0:47278:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788270044.684217:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:46519:x1875136262603776:12345-0@lo:5:osp-pre-0-1.0 Request processed in 7397us (7518us total) trans 30064771073 rc 0/0 00000100:00100000:2.0:1788270044.684230:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788270044.684292:0:46519:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 30064771073 gen 2 00000100:00100000:1.0:1788270044.684302:0:46519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:46519:1875136262603776:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788270044.684316:0:46519:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0xc1:0x0]-[0x280000400:0xe1:0x0] 00000100:00100000:1.0:1788270044.684364:0:46519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:46519:1875136262603904:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788270044.684406:0:46519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270044.684450:0:46519:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270044.684663:0:45788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262603904 00000100:00100000:0.0:1788270044.684671:0:45788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262603904 00000100:00100000:0.0:1788270044.684717:0:45788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270044.684727:0:45788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:46519:x1875136262603904:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788270044.684787:0:45788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:46519:x1875136262603904:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270044.684794:0:45788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788270044.684857:0:46519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27fb72d80 x1875136262603904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788270060 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270044.684868:0:46519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:46519:1875136262603904:0@lo:900:osp-pre-0-1.0 10000000:01000000:3.0:1788270044.935146:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788270044.935152:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27f622800 from 29 10000000:01000000:3.0:1788270044.935157:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788270044.935199:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.935211:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.935222:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270044.935248:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788270044.935313:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270044.935387:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c25e956600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270044.939634:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604032 00000100:00100000:2.0:1788270044.939648:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604032 00000100:00100000:2.0:1788270044.939698:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788270044.939708:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+19:45773:x1875136262604032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270044.939727:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270044.939748:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0865d expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.939777:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 20 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.939788:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 20 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.939798:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5da00, rc 0) 00000100:00100000:2.0:1788270044.939877:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:45773:x1875136262604032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270044.939884:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788270044.939940:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270044.939960:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.939969:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270044.940025:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788270044.940075:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270044.940100:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788270044.940599:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604160 00000100:00100000:0.0:1788270044.940605:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604160 00000100:00100000:0.0:1788270044.940643:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788270044.940650:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:45773:x1875136262604160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788270044.940664:0:45771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788270044.940679:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788270044.940682:0:45771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 29 00000100:00100000:0.0:1788270044.940821:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:45773:x1875136262604160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270044.940827:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788270044.940863:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788270044.940919:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788270044.940926:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.940935:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270044.940946:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788270044.940948:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c265eb0800 from 29 10000000:01000000:0.0:1788270044.940951:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788270044.940970:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.940978:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270044.940987:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270044.941001:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788270044.941024:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270044.941117:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495000 going to sleep for 11 seconds 00000100:00100000:2.0:1788270044.941691:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604288 00000100:00100000:2.0:1788270044.941698:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604288 00000100:00100000:2.0:1788270044.941726:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788270044.941734:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:45773:x1875136262604288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270044.941743:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270044.941754:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0866b expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.941772:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.941782:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270044.941790:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5dc00, rc 0) 00000100:00100000:2.0:1788270044.941836:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262604288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270044.941842:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788270044.941869:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270044.941882:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.941890:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270044.941935:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788270044.941966:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270044.941988:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c25e956300 going to sleep for 11 seconds 00000100:00100000:0.0:1788270044.941997:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604416 00000100:00100000:0.0:1788270044.942001:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604416 00000100:00100000:0.0:1788270044.942030:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788270044.942052:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262604416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788270044.942063:0:45768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788270044.942076:0:45768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788270044.942079:0:45768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 29 00000100:00100000:0.0:1788270044.942150:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262604416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270044.942157:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788270044.942209:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262604416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788270044.942252:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788270044.942259:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270044.942266:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270045.383599:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270045.383622:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262604544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270045.383684:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270045.383780:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604544 00000100:00100000:2.0:1788270045.383787:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604544 00000100:00100000:2.0:1788270045.383834:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788270045.383844:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262604544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270045.383872:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446203392 avail 1299963904 00000100:00100000:2.0:1788270045.383946:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262604544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270045.383953:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788270045.386181:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262604544:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270045.636229:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270046.660990:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788270046.895183:0:47648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1788270047.300758:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788270047.372914:0:47700:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788270047.373139:0:47700:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788270047.428333:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262604672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270047.428417:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270047.428577:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604672 00000100:00100000:1.0:1788270047.428586:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604672 00000100:00100000:1.0:1788270047.428678:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788270047.428690:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262604672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270047.428728:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270047.428781:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262604672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270047.428787:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788270047.428849:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262604672:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270047.695466:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788270047.869664:0:47750:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788270047.869873:0:47750:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788270048.708424:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270049.734572:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270049.926839:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788270049.988290:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270049.988297:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788270049.988300:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270049.988303:0:38087:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788270049.988320:0:38087:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788270049.988322:0:38087:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788270049.988325:0:38087:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788270049.988331:0:38087:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 836 00000100:00080000:1.0:1788270049.988335:0:38087:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788270049.988341:0:38087:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c144088800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788270049.988356:0:38087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27f291880 x1875136262605440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788270049.988389:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262604928:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988437:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270049.988490:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262605568:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988516:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270049.988539:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788270049.988544:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262605056:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988564:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270049.988581:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262605696:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988602:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270049.988624:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262605440:0@lo:8:kworker.0 00000100:00100000:1.0:1788270049.988641:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270049.988660:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604928 00000100:00100000:1.0:1788270049.988664:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604928 00000100:00100000:1.0:1788270049.988692:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788270049.988698:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262604928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988749:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262604928:12345-0@lo:400:kworker.0 Request processed in 50us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.988756:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788270049.988775:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605568 00000100:00100000:1.0:1788270049.988777:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605568 00000100:00100000:1.0:1788270049.988794:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605056 00000100:00100000:1.0:1788270049.988796:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605056 00000100:00100000:1.0:1788270049.988806:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605696 00000100:00100000:1.0:1788270049.988809:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605696 00000100:00100000:1.0:1788270049.988830:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270049.988836:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262605568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988862:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262605568:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.988866:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270049.988875:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788270049.988878:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262605056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988892:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262605056:12345-0@lo:400:kworker.0 Request processed in 14us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.988896:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788270049.988901:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788270049.988904:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262605696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988916:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262605696:12345-0@lo:400:kworker.0 Request processed in 12us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.988919:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788270049.988947:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27fb71500 x1875136262605056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270049.988960:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262605056:0@lo:400:kworker.0 00010000:00080000:1.0:1788270049.988967:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f290e00 x1875136262605696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270049.988975:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262605696:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.988983:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262604928:0@lo:400:kworker.0 00010000:00080000:1.0:1788270049.988991:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f291500 x1875136262605568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270049.988999:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262605568:0@lo:400:kworker.0 00000100:00100000:2.0:1788270049.989074:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262604800:0@lo:400:kworker.0 00000100:00100000:2.0:1788270049.989105:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270049.989133:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262605312:0@lo:400:kworker.0 00000100:00100000:2.0:1788270049.989152:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270049.989164:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788270049.989167:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262605184:0@lo:400:kworker.0 00000100:00100000:2.0:1788270049.989178:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270049.989190:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262605824:0@lo:400:kworker.0 00000100:00100000:2.0:1788270049.989209:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270049.989292:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605440 00000100:00100000:0.0:1788270049.989296:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605440 00000100:00100000:0.0:1788270049.989308:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605312 00000100:00100000:0.0:1788270049.989309:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605312 00000100:00100000:0.0:1788270049.989322:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788270049.989326:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262605312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270049.989355:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262605312:12345-0@lo:400:kworker.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270049.989358:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788270049.989367:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788270049.989369:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262605440:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788270049.989382:0:47281:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788270049.989399:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262605440:12345-0@lo:8:kworker.0 Request processed in 29us (758us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788270049.989403:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788270049.989412:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270049.989415:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270049.989429:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262605312:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.989534:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262604800 00000100:00100000:1.0:1788270049.989537:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262604800 00000100:00100000:1.0:1788270049.989566:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788270049.989573:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:3608:x1875136262604800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.989611:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:3608:x1875136262604800:12345-0@lo:400:kworker.0 Request processed in 39us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.989615:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788270049.989635:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605184 00000100:00100000:1.0:1788270049.989638:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605184 00000100:00100000:1.0:1788270049.989650:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788270049.989653:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262605184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.989671:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262605184:12345-0@lo:400:kworker.0 Request processed in 18us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.989675:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788270049.989688:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788270049.989692:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788270049.989694:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262605440:0@lo:8:kworker.0 00000100:00100000:1.0:1788270049.989705:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605824 00000100:00100000:1.0:1788270049.989707:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605824 00000100:00100000:1.0:1788270049.989722:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788270049.989725:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262605824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.989742:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262605824:12345-0@lo:400:kworker.0 Request processed in 16us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270049.989745:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788270049.989754:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270049.989763:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262605184:0@lo:400:kworker.0 00010000:00080000:1.0:1788270049.989771:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f292a00 x1875136262605824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270049.989777:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262605824:0@lo:400:kworker.0 00000100:00100000:1.0:1788270049.989781:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262604800:0@lo:400:kworker.0 00000100:00100000:0.0:1788270049.990715:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262605952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270049.990748:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270049.990891:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262605952 00000100:00100000:0.0:1788270049.990896:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262605952 00000100:00100000:0.0:1788270049.990931:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270049.990938:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262605952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270049.990960:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1788270049.991167:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262605952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 228us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270049.991174:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788270049.991501:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262605952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270050.500376:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270050.500520:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262606080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270050.500586:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270050.500693:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606080 00000100:00100000:1.0:1788270050.500701:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606080 00000100:00100000:1.0:1788270050.500780:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788270050.500791:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262606080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270050.500821:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446203392 avail 1299963904 00000100:00100000:1.0:1788270050.500877:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262606080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270050.500885:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788270050.500951:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262606080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270050.756128:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788270051.531022:0:48094:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788270051.531025:0:48094:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788270051.531026:0:48094:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788270051.531498:0:48094:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c2491ea000 00000020:01000004:2.0:1788270051.531512:0:48094:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788270051.531524:0:48094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788270051.531535:0:48094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98c275d819b8) 00000020:00000080:2.0:1788270051.531546:0:48094:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788270051.569168:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788270051.573093:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788270051.573465:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788270051.573824:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788270051.574069:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788270051.574336:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788270051.574587:0:48094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788270051.575833:0:48094:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788270051.576021:0:48094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788270051.576033:0:48094:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788270051.576085:0:48094:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f5d7a016e08680 00000020:01000004:3.0:1788270051.576091:0:48094:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788270051.576110:0:48094:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788270051.576112:0:48094:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788270051.576116:0:48094:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788270051.576139:0:48094:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788270051.576141:0:48094:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788270051.583907:0:48094:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788270051.583951:0:48094:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788270051.583965:0:48094:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788270051.583967:0:48094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788270051.583968:0:48094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788270051.583969:0:48094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788270051.583971:0:48094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788270051.583972:0:48094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788270051.583974:0:48094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788270051.583976:0:48094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788270051.583978:0:48094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788270051.583981:0:48094:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788270051.583984:0:48094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788270051.583985:0:48094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788270051.583986:0:48094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788270051.583987:0:48094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788270051.583989:0:48094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788270051.583990:0:48094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788270051.583991:0:48094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788270051.583992:0:48094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788270051.583993:0:48094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788270051.584018:0:48094:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788270051.584153:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788270051.584220:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.584267:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.584461:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606208 00000100:00100000:2.0:1788270051.584470:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606208 00000100:00100000:1.0:1788270051.584788:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788270051.584800:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:48094:x1875136262606208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788270051.584886:0:45771:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788270051.584889:0:45771:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788270051.584893:0:45771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788270051.585126:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:48094:x1875136262606208:12345-0@lo:253:mount.lustre.0 Request processed in 328us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.585134:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788270051.585228:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788270051.585238:0:48094:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788270051.585240:0:48094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788270051.585242:0:48094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788270051.585243:0:48094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788270051.585244:0:48094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788270051.585245:0:48094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788270051.585246:0:48094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788270051.585247:0:48094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788270051.585249:0:48094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788270051.585250:0:48094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788270051.585283:0:48094:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c2491ea000 from lustre-OST0001 10000000:01000000:3.0:1788270051.585312:0:48094:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788270051.585316:0:48094:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788270051.585325:0:48094:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c14378b370 local copy 00010000:00010000:3.0:1788270051.585334:0:48094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.585417:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270051.585459:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.585527:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251351480 going to sleep for 11 seconds 00000100:00100000:0.0:1788270051.585598:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606336 00000100:00100000:0.0:1788270051.585603:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606336 00000100:00100000:0.0:1788270051.585631:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788270051.585638:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:48094:x1875136262606336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270051.585732:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:48094:x1875136262606336:12345-0@lo:501:mount.lustre.0 Request processed in 94us (272us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270051.585739:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788270051.585793:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788270051.585804:0:48094:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788270051.585881:0:48094:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788270051.585887:0:48094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.585895:0:48094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c144193800/0xc5f5d7a016e082c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e082cf expref: -99 pid: 45755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270051.585917:0:48094:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c2491ea000 10000000:01000000:3.0:1788270051.585922:0:48094:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788270051.585927:0:48094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788270051.585929:0:48094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788270051.585933:0:48094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788270051.585936:0:48094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788270051.585956:0:48094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.585964:0:48094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.585977:0:48094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.585989:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270051.586014:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270051.586125:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606464 00000100:00100000:1.0:1788270051.586130:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606464 00000100:00100000:1.0:1788270051.586157:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788270051.586163:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:48094:x1875136262606464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788270051.586171:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270051.586182:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144193600/0xc5f5d7a016e0868e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08687 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.586202:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144193600/0xc5f5d7a016e0868e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08687 expref: 22 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.586212:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144193600/0xc5f5d7a016e0868e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08687 expref: 22 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.586221:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193600, rc 0) 00000100:00100000:1.0:1788270051.586246:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606464:12345-0@lo:101:mount.lustre.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.586251:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788270051.586392:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251351480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.586407:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788270051.586420:0:48094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0868e expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.586442:0:48094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0868e expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270051.588213:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000040:00080000:2.0:1788270051.588744:0:48094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788270051.590925:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:2.0:1788270051.590968:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:2.0:1788270051.590986:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:2.0:1788270051.591001:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:2.0:1788270051.591018:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:2.0:1788270051.591034:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:2.0:1788270051.591094:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:2.0:1788270051.591125:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:2.0:1788270051.591146:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 120 off9752 00000040:00080000:2.0:1788270051.591170:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9976 00000040:00080000:2.0:1788270051.591175:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 11 00000100:00100000:2.0:1788270051.591271:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270051.591331:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.591445:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606592 00000100:00100000:0.0:1788270051.591452:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606592 00000100:00100000:2.0:1788270051.591489:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788270051.591511:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788270051.591522:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270051.591662:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606592:12345-0@lo:501:mount.lustre.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270051.591671:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788270051.591697:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270051.591730:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270051.591773:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.591787:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270051.591799:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606720 00000100:00100000:1.0:1788270051.591805:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606720 00000100:00100000:1.0:1788270051.591847:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788270051.591855:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788270051.592577:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606720:12345-0@lo:503:mount.lustre.0 Request processed in 720us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.592584:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788270051.592608:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788270051.592946:0:48094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788270051.593001:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270051.593066:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.593093:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270051.593115:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606848 00000100:00100000:1.0:1788270051.593121:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606848 00000100:00100000:1.0:1788270051.593145:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788270051.593152:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788270051.593690:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606848:12345-0@lo:502:mount.lustre.0 Request processed in 538us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.593698:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788270051.594139:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788270051.594267:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:2.0:1788270051.594285:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:2.0:1788270051.594292:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:2.0:1788270051.594299:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:2.0:1788270051.594307:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:2.0:1788270051.594313:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:2.0:1788270051.594320:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:2.0:1788270051.594326:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:2.0:1788270051.594334:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 120 off9752 00000100:00100000:2.0:1788270051.594365:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270051.594401:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.594450:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270051.594455:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262606976 00000100:00100000:1.0:1788270051.594462:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262606976 00000100:00100000:1.0:1788270051.594498:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788270051.594506:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788270051.594590:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262606976:12345-0@lo:502:mount.lustre.0 Request processed in 84us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.594601:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788270051.594719:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262606976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788270051.594757:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9976 00000040:00080000:2.0:1788270051.594765:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788270051.595541:0:48098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788270051.595549:0:48098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788270051.595556:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270051.595558:0:48098:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788270051.595565:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788270051.595578:0:48098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98c27b8019b8) 00000020:00000080:1.0:1788270051.595600:0:48098:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788270051.595607:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788270051.595674:0:48098:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c2491ea000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788270051.595682:0:48098:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788270051.595690:0:48098:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5f5d7a016e0869c 00010000:00010000:1.0:1788270051.599204:0:48098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788270051.599654:0:48098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 25769803788 00080000:10000000:1.0:1788270051.600742:0:48098:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xf:0x0] (8/32) registered 00000020:00000080:1.0:1788270051.601591:0:48098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788270051.601601:0:48098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270051.601607:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270051.601609:0:48098:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788270051.601612:0:48098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270051.601616:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270051.601617:0:48098:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788270051.601621:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788270051.601623:0:48098:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788270051.601626:0:48098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270051.601629:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270051.601630:0:48098:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788270051.601632:0:48098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788270051.601634:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270051.601636:0:48098:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788270051.601639:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788270051.601661:0:48098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788270051.601664:0:48098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788270051.601665:0:48098:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788270051.601667:0:48098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 11 count 11 00000020:01000000:3.0:1788270051.601879:0:48094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788270051.601913:0:48094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788270051.601939:0:48094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0868e expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.601952:0:48094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c24a9ee200/0xc5f5d7a016e08687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0868e expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270051.601962:0:48094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c2491ea000 from 1 10000000:01000000:3.0:1788270051.601965:0:48094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270051.602002:0:48094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.602011:0:48094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.602022:0:48094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.602080:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788270051.602169:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270051.602207:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607104 00000100:00100000:3.0:1788270051.602215:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251351480 going to sleep for 11 seconds 00000100:00100000:1.0:1788270051.602216:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607104 00000100:00100000:1.0:1788270051.602276:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788270051.602288:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+22:48094:x1875136262607104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788270051.602301:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270051.602315:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e086a3 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.602343:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.602352:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.602358:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192000, rc 0) 00000100:00100000:1.0:1788270051.602396:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607104:12345-0@lo:101:mount.lustre.0 Request processed in 112us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.602401:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788270051.602940:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788270051.602954:0:48094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.602963:0:48094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270051.604081:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 13 count 13 00000040:00080000:3.0:1788270051.604315:0:48094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270051.604506:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:3.0:1788270051.604530:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:3.0:1788270051.604545:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:3.0:1788270051.604558:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:3.0:1788270051.604570:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:3.0:1788270051.604586:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:3.0:1788270051.604615:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:3.0:1788270051.604632:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:3.0:1788270051.604647:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:3.0:1788270051.604660:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10112 00000040:00080000:3.0:1788270051.604675:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 128 off10240 00000040:00080000:3.0:1788270051.604694:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 224 off10464 00000040:00080000:3.0:1788270051.604699:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 12 count 13 00000100:00100000:3.0:1788270051.604757:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270051.605212:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.605257:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607232 00000100:00100000:3.0:1788270051.605260:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.605264:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607232 00000100:00100000:2.0:1788270051.605313:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788270051.605324:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270051.605445:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607232:12345-0@lo:501:mount.lustre.0 Request processed in 124us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.605453:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788270051.605471:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788270051.605504:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788270051.605549:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.605569:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.605576:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607360 00000100:00100000:2.0:1788270051.605583:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607360 00000100:00100000:2.0:1788270051.605612:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788270051.605622:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270051.605868:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607360:12345-0@lo:503:mount.lustre.0 Request processed in 248us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.605877:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788270051.605894:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788270051.606245:0:48094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788270051.606287:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788270051.606314:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.606334:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.606350:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607488 00000100:00100000:2.0:1788270051.606355:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607488 00000100:00100000:2.0:1788270051.606386:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788270051.606395:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.606549:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270051.606554:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607488:12345-0@lo:502:mount.lustre.0 Request processed in 99us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.606566:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000040:00080000:0.0:1788270051.606737:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:0.0:1788270051.606762:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:0.0:1788270051.606777:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:0.0:1788270051.606791:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:0.0:1788270051.606804:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:0.0:1788270051.606818:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:0.0:1788270051.606833:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:0.0:1788270051.606850:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000040:00080000:0.0:1788270051.606881:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:0.0:1788270051.606900:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10112 00000040:00080000:0.0:1788270051.606925:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 128 off10240 00000100:00100000:0.0:1788270051.606950:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.606994:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.607019:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.607129:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607616 00000100:00100000:2.0:1788270051.607134:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607616 00000100:00100000:2.0:1788270051.607167:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788270051.607174:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270051.607273:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607616:12345-0@lo:502:mount.lustre.0 Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.607280:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788270051.607328:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270051.607365:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 224 off10464 00000040:00080000:0.0:1788270051.607372:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788270051.607780:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270051.607787:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607789:0:48102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788270051.607794:0:48102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c2491ea000 00000020:00000080:2.0:1788270051.607796:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788270051.607809:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270051.607812:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607813:0:48102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788270051.607816:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270051.607818:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607819:0:48102:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788270051.607822:0:48102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c2491ea000 00000020:00000080:2.0:1788270051.607824:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788270051.607876:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270051.607879:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607879:0:48102:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788270051.607881:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270051.607883:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607884:0:48102:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788270051.607886:0:48102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c2491ea000 00000020:00000080:2.0:1788270051.607887:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788270051.607898:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270051.607900:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607901:0:48102:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788270051.607902:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788270051.607903:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607904:0:48102:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788270051.607906:0:48102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c2491ea000 00000020:00000080:2.0:1788270051.607907:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788270051.607918:0:48102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788270051.607920:0:48102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788270051.607920:0:48102:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788270051.607922:0:48102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 13 count 13 00000020:01000000:0.0:1788270051.607977:0:48094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788270051.608001:0:48094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788270051.608016:0:48094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270051.608026:0:48094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788270051.608095:0:48094:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788270051.608097:0:48094:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c2491ea000 10000000:01000000:0.0:1788270051.608100:0:48094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c2491ea000 10000000:01000000:0.0:1788270051.608105:0:48094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788270051.608109:0:48094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c2491ea000 from 1 10000000:01000000:0.0:1788270051.608111:0:48094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788270051.608133:0:48094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270051.608138:0:48094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270051.608144:0:48094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270051.608155:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788270051.608186:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.608220:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607744 00000100:00100000:2.0:1788270051.608227:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607744 00000100:00100000:0.0:1788270051.608232:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.608258:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788270051.608267:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:48094:x1875136262607744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788270051.608278:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270051.608290:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5c400/0xc5f5d7a016e086b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e086b1 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.608312:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5c400/0xc5f5d7a016e086b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e086b1 expref: 24 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.608323:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5c400/0xc5f5d7a016e086b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e086b1 expref: 24 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.608332:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c400, rc 0) 00000100:00100000:2.0:1788270051.608374:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262607744:12345-0@lo:101:mount.lustre.0 Request processed in 109us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.608381:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788270051.608412:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788270051.608441:0:48094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e086b8 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270051.608453:0:48094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e086b8 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270051.610011:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 00000040:00080000:0.0:1788270051.610289:0:48094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788270051.610518:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:0.0:1788270051.610541:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:0.0:1788270051.610553:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:0.0:1788270051.610565:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:0.0:1788270051.610576:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:0.0:1788270051.610592:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:0.0:1788270051.610610:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:0.0:1788270051.610630:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:0.0:1788270051.610646:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:0.0:1788270051.610656:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:0.0:1788270051.610671:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:0.0:1788270051.610681:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:0.0:1788270051.610693:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:0.0:1788270051.610718:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:0.0:1788270051.610738:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:0.0:1788270051.610758:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:0.0:1788270051.610789:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:0.0:1788270051.610811:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:0.0:1788270051.610831:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:0.0:1788270051.610853:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:0.0:1788270051.610868:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:0.0:1788270051.610887:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:0.0:1788270051.610907:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:0.0:1788270051.610927:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:0.0:1788270051.610940:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 160 off12472 00000040:00080000:0.0:1788270051.610952:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12696 00000040:00080000:0.0:1788270051.610976:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12920 00000040:00080000:0.0:1788270051.610986:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off13000 00000040:00080000:0.0:1788270051.610997:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13224 00000040:00080000:0.0:1788270051.611008:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13448 00000040:00080000:0.0:1788270051.611017:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13536 00000040:00080000:0.0:1788270051.611028:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13664 00000040:00080000:0.0:1788270051.611067:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13808 00000040:00080000:0.0:1788270051.611089:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13936 00000040:00080000:0.0:1788270051.611105:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14160 00000040:00080000:0.0:1788270051.611115:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14384 00000040:00080000:0.0:1788270051.611125:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14464 00000040:00080000:0.0:1788270051.611135:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14688 00000040:00080000:0.0:1788270051.611145:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14912 00000040:00080000:0.0:1788270051.611155:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 88 off15000 00000040:00080000:0.0:1788270051.611164:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 128 off15128 00000040:00080000:0.0:1788270051.611177:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].42, 144 off15272 00000040:00080000:0.0:1788270051.611197:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].43, 128 off15400 00000040:00080000:0.0:1788270051.611208:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].44, 224 off15624 00000040:00080000:0.0:1788270051.611222:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].45, 224 off15848 00000040:00080000:0.0:1788270051.611238:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].46, 80 off15928 00000040:00080000:0.0:1788270051.611251:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].47, 224 off16152 00000040:00080000:0.0:1788270051.611266:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].48, 232 off16384 00000040:00080000:0.0:1788270051.611409:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].49, 224 off16608 00000040:00080000:0.0:1788270051.611439:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].50, 120 off16728 00000040:00080000:0.0:1788270051.611460:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].51, 224 off16952 00000040:00080000:0.0:1788270051.611465:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 51 count 51 00000100:00100000:0.0:1788270051.611542:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270051.611600:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.611636:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262607872 00000100:00100000:2.0:1788270051.611644:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262607872 00000100:00100000:0.0:1788270051.611645:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.611693:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788270051.611704:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262607872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788270051.611828:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262607872:12345-0@lo:501:mount.lustre.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.611838:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788270051.611849:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262607872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788270051.611882:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788270051.611913:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.611935:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.611938:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608000 00000100:00100000:2.0:1788270051.611943:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608000 00000100:00100000:2.0:1788270051.611971:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788270051.611979:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788270051.612079:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608000:12345-0@lo:503:mount.lustre.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.612088:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788270051.612091:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788270051.612434:0:48094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788270051.612481:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.612507:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.612526:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608128 00000100:00100000:0.0:1788270051.612530:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608128 00000100:00100000:0.0:1788270051.612548:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788270051.612553:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.612638:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608128:12345-0@lo:502:mount.lustre.0 Request processed in 82us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270051.612644:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788270051.612680:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270051.612690:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270051.612821:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1788270051.612839:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:0.0:1788270051.612852:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:0.0:1788270051.612876:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:0.0:1788270051.612905:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:0.0:1788270051.612924:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:0.0:1788270051.612943:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:0.0:1788270051.612959:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:0.0:1788270051.612975:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1788270051.612986:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:0.0:1788270051.612994:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:0.0:1788270051.613002:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:0.0:1788270051.613009:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:0.0:1788270051.613015:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:0.0:1788270051.613022:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:0.0:1788270051.613029:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:0.0:1788270051.613063:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:0.0:1788270051.613086:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:0.0:1788270051.613104:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:0.0:1788270051.613119:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:0.0:1788270051.613155:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:0.0:1788270051.613177:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:0.0:1788270051.613200:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:0.0:1788270051.613221:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:0.0:1788270051.613244:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 160 off12472 00000040:00080000:0.0:1788270051.613258:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12696 00000040:00080000:0.0:1788270051.613274:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12920 00000040:00080000:0.0:1788270051.613302:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off13000 00000040:00080000:0.0:1788270051.613328:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13224 00000040:00080000:0.0:1788270051.613351:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13448 00000040:00080000:0.0:1788270051.613373:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13536 00000040:00080000:0.0:1788270051.613391:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13664 00000040:00080000:0.0:1788270051.613406:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13808 00000040:00080000:0.0:1788270051.613419:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13936 00000040:00080000:0.0:1788270051.613447:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14160 00000040:00080000:0.0:1788270051.613462:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14384 00000040:00080000:0.0:1788270051.613484:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14464 00000040:00080000:0.0:1788270051.613492:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14688 00000040:00080000:0.0:1788270051.613500:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14912 00000040:00080000:0.0:1788270051.613507:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 88 off15000 00000040:00080000:0.0:1788270051.613515:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 128 off15128 00000040:00080000:0.0:1788270051.613525:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].42, 144 off15272 00000040:00080000:0.0:1788270051.613536:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].43, 128 off15400 00000040:00080000:0.0:1788270051.613543:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].44, 224 off15624 00000040:00080000:0.0:1788270051.613550:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].45, 224 off15848 00000040:00080000:0.0:1788270051.613556:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].46, 80 off15928 00000040:00080000:0.0:1788270051.613563:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].47, 224 off16152 00000040:00080000:0.0:1788270051.613569:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].48, 232 off16384 00000100:00100000:0.0:1788270051.613591:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.613627:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.613653:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.613874:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608256 00000100:00100000:2.0:1788270051.613880:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608256 00000100:00100000:2.0:1788270051.613918:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788270051.613928:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788270051.614017:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608256:12345-0@lo:502:mount.lustre.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.614024:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788270051.614094:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270051.614262:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].49, 224 off16608 00000040:00080000:0.0:1788270051.614291:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].50, 120 off16728 00000100:00100000:0.0:1788270051.614315:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.614355:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.614380:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608384 00000100:00100000:0.0:1788270051.614384:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608384 00000100:00100000:0.0:1788270051.614576:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788270051.614586:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788270051.614660:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262608384:12345-0@lo:502:mount.lustre.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270051.614668:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788270051.614709:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270051.614723:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262608384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788270051.614762:0:48094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].51, 224 off16952 00000040:00080000:0.0:1788270051.614769:0:48094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788270051.616735:0:48106:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788270051.616752:0:48106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98c275d84d28) 00000020:00000080:2.0:1788270051.616778:0:48106:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788270051.616855:0:48106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c2491ea000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788270051.616858:0:48106:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c2491ea000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788270051.616861:0:48106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c2491ea000 3 00010000:00080000:2.0:1788270051.616889:0:48106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c2491ec800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788270051.619966:0:48106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788270051.620220:0:48106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788270051.620265:0:48106:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788270051.620276:0:48106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5f5d7a016e086c6 00000100:00080000:2.0:1788270051.620287:0:48106:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270051.620292:0:48106:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c2491ec800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270051.620326:0:48106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c271ff9f80 x1875136262608512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788270051.620357:0:48106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788270051.620549:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262608512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788270051.620617:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.620687:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608512 00000100:00100000:0.0:1788270051.620694:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608512 00000100:00100000:0.0:1788270051.620727:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788270051.620734:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1875136262608512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788270051.620756:0:45776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 843 last 0 00000020:00000080:0.0:1788270051.620795:0:45776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc5f5d7a016e086cd 00000004:00100000:0.0:1788270051.620876:0:45776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788270051.620976:0:45776:0:(import.c:65:import_set_state_nolock()) ffff98c27b779800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788270051.621036:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875136262608512:12345-0@lo:38:llog_process_th.0 Request processed in 301us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270051.621064:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788270051.621109:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c271ff9f80 x1875136262608512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788270061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270051.621120:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788270051.621127:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:0.0:1788270051.621134:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788270051.621138:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788270051.621140:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2491ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788270051.621146:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1875136262608512:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788270051.622622:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270051.622627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788270051.622629:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270051.622632:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788270051.622666:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262608640:0@lo:400:kworker.0 00000100:00080000:3.0:1788270051.622707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270051.622709:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788270051.622712:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788270051.622718:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788270051.622719:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 841 00000100:00080000:3.0:1788270051.622725:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788270051.622730:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c144088800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788270051.622745:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c248219c00 x1875136262609152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788270051.622755:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608640 00000100:00100000:0.0:1788270051.622762:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270051.622763:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608640 00000100:00100000:0.0:1788270051.622774:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262609280:0@lo:400:kworker.0 00000100:00100000:3.0:1788270051.622803:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262608896:0@lo:400:kworker.0 00000100:00100000:1.0:1788270051.622818:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788270051.622829:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262608640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270051.622840:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.622860:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262609536:0@lo:400:kworker.0 00000100:00100000:0.0:1788270051.622880:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270051.622896:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262608640:12345-0@lo:400:kworker.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000020:01000004:2.0:1788270051.622906:0:48106:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1788270051.622907:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270051.622910:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000020:00000080:2.0:1788270051.622925:0:48106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98c276b6cd28) 00000100:00100000:1.0:1788270051.622929:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608896 00000100:00100000:1.0:1788270051.622934:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608896 00000100:00100000:3.0:1788270051.622939:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000020:00000080:2.0:1788270051.622947:0:48106:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1788270051.622949:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262608768:0@lo:400:kworker.0 00000100:00100000:2.0:1788270051.622970:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788270051.622974:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262609024:0@lo:400:kworker.0 00000100:00100000:2.0:1788270051.622983:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262608896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270051.622996:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270051.623023:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270051.623025:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609280 00000100:00100000:3.0:1788270051.623026:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262609408:0@lo:400:kworker.0 00000100:00100000:1.0:1788270051.623032:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609280 00000100:00100000:2.0:1788270051.623077:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262608896:12345-0@lo:400:kworker.0 Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270051.623087:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262608640:0@lo:400:kworker.0 00000100:00100000:2.0:1788270051.623088:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788270051.623089:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270051.623105:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609536 00000100:00100000:1.0:1788270051.623110:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609536 00000100:00100000:3.0:1788270051.623124:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262608896:0@lo:400:kworker.0 00000100:00100000:0.0:1788270051.623134:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262609152:0@lo:8:kworker.0 00000100:00100000:1.0:1788270051.623142:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262608768 00000100:00100000:1.0:1788270051.623147:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262608768 00000100:00100000:3.0:1788270051.623160:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609408 00000100:00100000:0.0:1788270051.623166:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.623167:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609408 00000100:00100000:1.0:1788270051.623172:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788270051.623184:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262609280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270051.623203:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609024 00000100:00100000:3.0:1788270051.623207:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788270051.623210:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609024 00000100:00100000:0.0:1788270051.623220:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788270051.623222:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262609536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270051.623232:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262608768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270051.623239:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262609280:12345-0@lo:400:kworker.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.623249:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609152 00000100:00100000:1.0:1788270051.623249:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788270051.623256:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609152 00000100:00100000:1.0:1788270051.623273:0:45776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788270051.623280:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262609536:12345-0@lo:400:kworker.0 Request processed in 62us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.623280:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270051.623281:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262608768:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.623284:0:45776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788270051.623297:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788270051.623298:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262609024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270051.623307:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788270051.623315:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270051.623316:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788270051.623324:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270051.623328:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262609408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788270051.623331:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270051.623348:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262609024:12345-0@lo:400:kworker.0 Request processed in 56us (327us total) trans 0 rc 0/0 00010000:00080000:3.0:1788270051.623359:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c248218e00 x1875136262608768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270051.623360:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262609408:12345-0@lo:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.623361:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788270051.623374:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788270051.623383:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788270051.623389:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262608768:0@lo:400:kworker.0 00000100:00100000:2.0:1788270051.623393:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262609152:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788270051.623407:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c24821ad80 x1875136262609280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788270051.623410:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c248218000 x1875136262609408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270051.623439:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262609280:0@lo:400:kworker.0 00000100:00100000:3.0:1788270051.623445:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262609408:0@lo:400:kworker.0 00000100:00100000:0.0:1788270051.623459:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262609024:0@lo:400:kworker.0 00000100:00100000:2.0:1788270051.623465:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1875136262609152:12345-0@lo:8:kworker.0 Request processed in 71us (297us total) trans 0 rc -11/-11 00010000:00080000:3.0:1788270051.623467:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c248219180 x1875136262609536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270051.623478:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788270051.623485:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262609536:0@lo:400:kworker.0 00000020:01000004:2.0:1788270051.623634:0:48106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c2491ea000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788270051.623639:0:48106:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c2491ea000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788270051.623642:0:48106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c2491ea000 3 00010000:00080000:2.0:1788270051.623671:0:48106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c2491e8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.142@tcp at head 00000100:00100000:1.0:1788270051.624894:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788270051.624903:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788270051.624909:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788270051.624913:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262609152:0@lo:8:kworker.0 00010000:00010000:2.0:1788270051.625901:0:48106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788270051.626289:0:48106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788270051.626354:0:48106:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788270051.626371:0:48106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc5f5d7a016e086db 00000100:00080000:2.0:1788270051.626380:0:48106:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788270051.626384:0:48106:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98c2491e8800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788270051.626416:0:48106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c271ff9f80 x1875136262609664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788270051.626449:0:48106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788270051.626469:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262609664:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788270051.626531:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788270051.626753:0:48106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 52 count 51 00000020:01000000:1.0:1788270051.626814:0:48094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788270051.626851:0:48094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788270051.626866:0:48094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e086b8 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.626867:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609664 00000100:00100000:3.0:1788270051.626875:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609664 00010000:00010000:1.0:1788270051.626879:0:48094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c1410f0200/0xc5f5d7a016e086b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e086b8 expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.626910:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788270051.626915:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1875136262609664:12345-0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788270051.626926:0:48094:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788270051.626928:0:48094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788270051.626930:0:48094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270051.626931:0:48094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270051.626932:0:48094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270051.626933:0:48094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270051.626935:0:48094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788270051.626937:0:48094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270051.626938:0:48094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:3.0:1788270051.626942:0:45777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 843 last 0 10000000:01000000:1.0:1788270051.626943:0:48094:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788270051.626949:0:48094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788270051.626951:0:48094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788270051.626953:0:48094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270051.626954:0:48094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270051.626956:0:48094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270051.626957:0:48094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270051.626958:0:48094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788270051.626960:0:48094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270051.626960:0:48094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788270051.626974:0:48094:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000020:00000080:3.0:1788270051.626978:0:45777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc5f5d7a016e086e2 00000100:00100000:1.0:1788270051.626986:0:48094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262609792:0@lo:253:mount.lustre.0 00000004:00100000:3.0:1788270051.626996:0:45777:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788270051.627025:0:48094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788270051.627032:0:45777:0:(import.c:65:import_set_state_nolock()) ffff98c143799800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270051.627195:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609792 00000100:00100000:2.0:1788270051.627200:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609792 00000100:00100000:2.0:1788270051.627277:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788270051.627280:0:48094:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.627286:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262609792:12345-0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788270051.627289:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875136262609664:12345-0@lo:38:llog_process_th.0 Request processed in 369us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270051.627300:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:2.0:1788270051.627306:0:45770:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788270051.627320:0:45770:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788270051.627357:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c271ff9f80 x1875136262609664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788270061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270051.627367:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788270051.627373:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 7 00000100:00080000:3.0:1788270051.627379:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788270051.627383:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788270051.627385:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c2491e8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788270051.627390:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1875136262609664:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788270051.627416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270051.627421:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788270051.627720:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788270051.627723:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:3.0:1788270051.628298:0:45770:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788270051.628312:0:45770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788270051.628328:0:45792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788270051.628334:0:45792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788270051.628353:0:45792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628373:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 24 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628382:0:45792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 24 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628389:0:45792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628418:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 24 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628445:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 24 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270051.628457:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262609920:0@lo:104: 00000100:00100000:2.0:1788270051.628498:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270051.628513:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:48094:x1875136262609792:12345-0@lo:253:mount.lustre.0 Request processed in 1228us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270051.628523:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788270051.628544:0:48094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5051c9b2-4d56-4172-904c-6f13b6100451:48094:1875136262609792:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1788270051.628550:0:45792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788270051.628557:0:48094:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00010000:00010000:2.0:1788270051.628562:0:45792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 23 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788270051.628562:0:48094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788270051.628565:0:48094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788270051.628568:0:48094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788270051.628570:0:48094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788270051.628573:0:48094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788270051.628577:0:48094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788270051.628579:0:48094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1788270051.628581:0:45792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262610048:0@lo:104: 00000020:01000004:1.0:1788270051.628582:0:48094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788270051.628585:0:48094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788270051.628596:0:48094:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788270051.628610:0:45792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270051.628631:0:45792:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b74240 going to sleep for 11 seconds 00000100:00100000:2.0:1788270051.628651:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262609920 00000100:00100000:2.0:1788270051.628656:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262609920 00000100:00100000:2.0:1788270051.628683:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610048 00000100:00100000:2.0:1788270051.628687:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610048 00000100:00100000:2.0:1788270051.628707:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788270051.628713:0:45760:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788270051.628718:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+4:45792:x1875136262609920:12345-0@lo:104: 00000100:00100000:3.0:1788270051.628724:0:45760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788270051.628733:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628788:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270051.628792:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262609920:0@lo:104: 00000100:00100000:2.0:1788270051.628798:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+4:45792:x1875136262609920:12345-0@lo:104: Request processed in 82us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.628806:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788270051.628824:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788270051.628833:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262610048:12345-0@lo:104: 00010000:00010000:2.0:1788270051.628841:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628893:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788270051.628900:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:45792:x1875136262610048:12345-0@lo:104: Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270051.628907:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788270051.628935:0:45792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45792:1875136262610048:0@lo:104: 00010000:00010000:3.0:1788270051.628950:0:45792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.628997:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270051.629004:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629013:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788270051.629017:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629028:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788270051.629065:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788270051.629071:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788270051.629102:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629109:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788270051.629176:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629184:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c1410f0c00/0xc5f5d7a016e0866b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08672 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270051.629193:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788270051.629198:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270051.629203:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270051.629206:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262610176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270051.629216:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9eee00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788270051.629220:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629228:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788270051.629236:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270051.629244:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788270051.629246:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788270051.629264:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629270:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788270051.629271:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610176 00000100:00100000:3.0:1788270051.629275:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610176 00010000:00010000:2.0:1788270051.629288:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270051.629288:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262610304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270051.629294:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 24 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270051.629309:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9eee00/0xc5f5d7a016e0865d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e08664 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270051.629318:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788270051.629329:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270051.629330:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610304 00000100:00100000:3.0:1788270051.629334:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610304 00010000:00010000:2.0:1788270051.629334:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270051.629339:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270051.629347:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270051.629350:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 25 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.629377:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788270051.629387:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+25:3610:x1875136262610176:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788270051.629389:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788270051.629401:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788270051.629403:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5051c9b2-4d56-4172-904c-6f13b6100451+25:3610:x1875136262610304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270051.629407:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 25 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.629434:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 25 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.629447:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5dc00/0xc5f5d7a016e08672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0866b expref: 25 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.629459:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270051.629490:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262610176:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (248us total) trans 0 rc 0/0 00010000:00010000:1.0:1788270051.629494:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788270051.629505:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788270051.629505:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 24 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629522:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 23 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629534:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5da00/0xc5f5d7a016e08664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0865d expref: 23 pid: 45770 timeout: 943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.629546:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262610176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788270051.629547:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629559:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788270051.629570:0:45761:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005579559s 00010000:00010000:1.0:1788270051.629574:0:45761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629580:0:45761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629587:0:45761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629593:0:45761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629598:0:45761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270051.629603:0:45761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629610:0:45761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629631:0:45761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270051.629641:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270051.629672:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5051c9b2-4d56-4172-904c-6f13b6100451+22:3610:x1875136262610304:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270051.629678:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788270051.629697:0:45792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.629704:0:45792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270051.629708:0:45792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5c600/0xc5f5d7a016e086e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270051.629726:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262610304:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788270051.630203:0:48094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:2.0:1788270051.632098:0:48094:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788270051.632105:0:48094:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788270051.632224:0:48094:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788270051.632261:0:48094:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788270051.632280:0:48094:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788270051.632295:0:48094:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788270051.633260:0:48094:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788270051.633560:0:48094:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788270051.780194:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788270052.073821:0:48163:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788270052.074025:0:48163:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788270052.548604:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262610432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270052.548678:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.549284:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610432 00000100:00100000:1.0:1788270052.549294:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610432 00000100:00100000:1.0:1788270052.549394:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788270052.549418:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262610432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270052.549455:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270052.549514:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262610432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.549522:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788270052.550550:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262610432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270052.676147:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270037/real 1788270037] req@ffff98c26b600000 x1875136262595328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.676183:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c26b600000 x1875136262595328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.676194:0:3606:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788270037/real 1788270037] req@ffff98c26b603480 x1875136262595456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.676207:0:3606:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c26b603480 x1875136262595456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788270052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788270052.676236:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275a8a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788270052.676253:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788270052.676257:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262595328:0@lo:8:kworker.0 00000100:00080000:3.0:1788270052.676264:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788270052.676269:0:3606:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788270052.676272:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262595456:0@lo:8:kworker.0 00000100:00100000:2.0:1788270052.676539:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788270052.676678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270052.676684:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1788270052.676686:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262610560:0@lo:400:kworker.0 00000100:00080000:0.0:1788270052.676688:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c275a8a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788270052.676696:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 828 00000100:00080000:0.0:1788270052.676702:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788270052.676708:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c275a8a800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788270052.676731:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14262f100 x1875136262610688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270052.676751:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270052.676801:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610560 00000100:00100000:2.0:1788270052.676806:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610560 00000100:00100000:2.0:1788270052.676838:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788270052.676844:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:3607:x1875136262610560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270052.676879:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:3607:x1875136262610560:12345-0@lo:400:kworker.0 Request processed in 36us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.676884:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788270052.676921:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262610560:0@lo:400:kworker.0 00000100:00100000:3.0:1788270052.677208:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262610688:0@lo:8:kworker.0 00000100:00100000:3.0:1788270052.677250:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270052.677338:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610688 00000100:00100000:2.0:1788270052.677341:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610688 00000100:00100000:2.0:1788270052.677366:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788270052.677372:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262610688:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788270052.677397:0:47281:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 844 last 0 00000020:00000080:2.0:1788270052.677432:0:47281:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e086f0 00002000:00100000:2.0:1788270052.677444:0:47281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98c142562800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788270052.677448:0:47281:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788270052.677451:0:47281:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788270052.677524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270052.677529:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788270052.677532:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c275d9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788270052.677537:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 828 00002000:00080000:2.0:1788270052.677538:0:47281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788270052.677540:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788270052.677546:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c275d9f000 using connection 192.168.201.142@tcp/0@lo 00000100:00080000:2.0:1788270052.677563:0:47281:0:(import.c:65:import_set_state_nolock()) ffff98c142565000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788270052.677565:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14262d500 x1875136262610816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788270052.677992:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262610816:0@lo:8:kworker.0 00000100:00100000:2.0:1788270052.678000:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3606:x1875136262610688:12345-0@lo:8:kworker.0 Request processed in 623us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.678009:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788270052.678028:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.678116:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262610944:0@lo:400:kworker.0 00000100:00100000:2.0:1788270052.678145:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610816 00000100:00100000:2.0:1788270052.678151:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610816 00000100:00100000:1.0:1788270052.678153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270052.678178:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788270052.678180:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788270052.678186:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1875136262610816:12345-0@lo:8:kworker.0 00000100:00080000:3.0:1788270052.678188:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:3.0:1788270052.678197:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788270052.678201:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788270052.678204:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275a8a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1788270052.678207:0:47283:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 844 last 0 00000020:00000080:2.0:1788270052.678226:0:47283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5f5d7a016e086f7 00002000:00100000:2.0:1788270052.678233:0:47283:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98c142566800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788270052.678238:0:47283:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788270052.678240:0:47283:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:3.0:1788270052.678273:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788270052.678280:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262610688:0@lo:8:kworker.0 00002000:00080000:2.0:1788270052.678377:0:47283:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788270052.678391:0:47283:0:(import.c:65:import_set_state_nolock()) ffff98c142561800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788270052.681537:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262610944 00000100:00100000:1.0:1788270052.681548:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262610944 00000100:00100000:1.0:1788270052.681589:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788270052.681595:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262610944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.681653:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262610944:12345-0@lo:400:kworker.0 Request processed in 58us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.681659:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788270052.681686:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262fb80 x1875136262610944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270052.681697:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262610944:0@lo:400:kworker.0 00000004:00080000:1.0:1788270052.681721:0:45800:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788270052.681784:0:45800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844388744825ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788270052.681789:0:45800:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788270052.682070:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262611072:0@lo:400:kworker.0 00000004:00080000:1.0:1788270052.682090:0:45801:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xa2:0x0] 00000100:00100000:1.0:1788270052.682111:0:45801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45801:1875136262611328:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788270052.682119:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.682153:0:45801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270052.682162:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611072 00000100:00100000:3.0:1788270052.682167:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611072 00000100:00100000:1.0:1788270052.682179:0:45801:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270052.682192:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270052.682200:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262611200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270052.682225:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.682258:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611200 00000100:00100000:1.0:1788270052.682262:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611200 00000100:00100000:1.0:1788270052.682297:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270052.682304:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262611200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270052.682324:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1788270052.682360:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262611200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.682367:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788270052.682384:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270052.682436:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262611200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270052.682471:0:47281:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788270052.682476:0:47281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788270052.682502:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1875136262610816:12345-0@lo:8:kworker.0 Request processed in 4314us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.682511:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788270052.682530:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611328 00000100:00100000:2.0:1788270052.682533:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611328 00000100:00100000:2.0:1788270052.682566:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788270052.682574:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:45801:x1875136262611328:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788270052.682716:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788270052.682719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788270052.682722:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788270052.682727:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98c144088800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788270052.682743:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c14262ea00 x1875136262611584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788270052.682762:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262611584:0@lo:8:kworker.0 00000100:00100000:2.0:1788270052.682799:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.682804:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262611840:0@lo:400:kworker.0 00000100:00100000:2.0:1788270052.682824:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611584 00000100:00100000:2.0:1788270052.682828:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611584 00000100:00100000:0.0:1788270052.682833:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.682850:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788270052.682854:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262611712:0@lo:400:kworker.0 00000100:00100000:0.0:1788270052.682866:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.682875:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262612224:0@lo:400:kworker.0 00000100:00100000:0.0:1788270052.682888:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.682902:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611840 00000100:00100000:0.0:1788270052.682904:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611840 00000100:00100000:0.0:1788270052.682923:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611712 00000100:00100000:0.0:1788270052.682925:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611712 00000100:00100000:0.0:1788270052.682946:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612224 00000100:00100000:0.0:1788270052.682947:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612224 00000100:00100000:3.0:1788270052.682952:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788270052.682961:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262611072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270052.682967:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788270052.682973:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262611840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270052.683007:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262611072:12345-0@lo:400:kworker.0 Request processed in 49us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270052.683015:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262611840:12345-0@lo:400:kworker.0 Request processed in 39us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270052.683018:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788270052.683027:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788270052.683054:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788270052.683062:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262611712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270052.683072:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788270052.683082:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262612224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270052.683093:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262611712:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270052.683099:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788270052.683116:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262612224:12345-0@lo:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270052.683121:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788270052.683139:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788270052.683199:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262c700 x1875136262611712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.683208:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262611712:0@lo:400:kworker.0 00010000:00080000:3.0:1788270052.683217:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262d180 x1875136262612224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.683223:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262612224:0@lo:400:kworker.0 00010000:00080000:3.0:1788270052.683231:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262fb80 x1875136262611840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.683236:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262611840:0@lo:400:kworker.0 00000100:00100000:3.0:1788270052.683244:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262611072:0@lo:400:kworker.0 00010000:00080000:3.0:1788270052.683277:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262d500 x1875136262610816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788270072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.683288:0:3606:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788270052.683294:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 7 00000100:00080000:3.0:1788270052.683300:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788270052.683304:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788270052.683307:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c275d9f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788270052.683325:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788270052.683330:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1875136262610816:0@lo:8:kworker.0 00000004:00080000:3.0:1788270052.683353:0:45802:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788270052.683414:0:45802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844390374617ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788270052.683419:0:45802:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788270052.683478:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788270052.683482:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1875136262611584:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788270052.683502:0:47281:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 844 last 0 00000020:00000080:2.0:1788270052.683524:0:47281:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc5f5d7a016e086fe 00002000:00100000:2.0:1788270052.683535:0:47281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98c142567000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788270052.683538:0:47281:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788270052.683540:0:47281:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788270052.683569:0:47281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788270052.683584:0:47281:0:(import.c:65:import_set_state_nolock()) ffff98c142560800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270052.683611:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1875136262611584:12345-0@lo:8:kworker.0 Request processed in 128us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.683621:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:0.0:1788270052.683652:0:45803:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0xa2:0x0] 00000100:00100000:2.0:1788270052.683666:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262612352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270052.683670:0:45803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45803:1875136262612480:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788270052.683707:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.683708:0:45803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.683732:0:45803:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270052.683748:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612480 00000100:00100000:0.0:1788270052.683750:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612480 00000100:00100000:2.0:1788270052.683751:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612352 00000100:00100000:2.0:1788270052.683757:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612352 00000100:00080000:0.0:1788270052.683760:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270052.683782:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788270052.683789:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:45803:x1875136262612480:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788270052.683794:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788270052.683803:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262612352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270052.683815:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788270052.683853:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262612352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.683860:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788270052.683887:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1451c0a80 x1875136262612352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270052.683900:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262612352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270052.683999:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262611456:0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.684026:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.684121:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262612096:0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.684141:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.684151:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270052.684154:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262611968:0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.684165:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.684190:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612096 00000100:00100000:1.0:1788270052.684194:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612096 00000100:00100000:1.0:1788270052.684220:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611968 00000100:00100000:1.0:1788270052.684223:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611968 00000100:00100000:1.0:1788270052.684238:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788270052.684245:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262612096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.684280:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262612096:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.684285:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788270052.684297:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788270052.684302:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262611968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.684331:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262611968:12345-0@lo:400:kworker.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.684336:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788270052.684361:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262f100 x1875136262611968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270052.684371:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262611968:0@lo:400:kworker.0 00010000:00080000:1.0:1788270052.684382:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262f480 x1875136262612096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270052.684391:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262612096:0@lo:400:kworker.0 00000100:00100000:1.0:1788270052.684424:0:48230:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00010000:00080000:3.0:1788270052.684428:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c14262ea00 x1875136262611584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788270077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270052.684432:0:48230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:3.0:1788270052.684443:0:3606:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 7 00000100:00080000:3.0:1788270052.684449:0:3606:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788270052.684453:0:3606:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788270052.684456:0:3606:0:(import.c:65:import_set_state_nolock()) ffff98c144088800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788270052.684466:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788270052.684470:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1875136262611584:0@lo:8:kworker.0 00000100:00080000:0.0:1788270052.684614:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788270052.684650:0:46521:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0xa2:0x0] 00000100:00100000:3.0:1788270052.684665:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262612608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270052.684666:0:46521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:46521:1875136262612736:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788270052.684707:0:46521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270052.684713:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.684719:0:46521:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512449c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788270052.684737:0:46520:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788270052.684787:0:46520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 844391747218ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788270052.684792:0:46520:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788270052.684940:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612608 00000100:00100000:2.0:1788270052.684946:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612608 00000100:00100000:2.0:1788270052.684978:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788270052.684984:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262612608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270052.684996:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788270052.685032:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262612608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.685076:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788270052.685083:0:47283:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788270052.685092:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262611456 00000100:00100000:3.0:1788270052.685097:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262611456 00010000:00080000:2.0:1788270052.685109:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1451c1f80 x1875136262612608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788270068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270052.685118:0:47283:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788270052.685124:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612736 00000100:00100000:2.0:1788270052.685125:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262612608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270052.685129:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612736 00000100:00100000:3.0:1788270052.685147:0:47283:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788270052.685155:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788270052.685162:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262611456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270052.685199:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262611456:12345-0@lo:400:kworker.0 Request processed in 37us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270052.685205:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788270052.685653:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270052.685674:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262611456:0@lo:400:kworker.0 00000004:00080000:3.0:1788270052.686181:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788270052.687313:0:47284:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788270052.687321:0:47284:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -31 00002000:02000040:2.0:1788270052.687326:0:47284:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:163 to 0x280000401:193) 00000100:00100000:3.0:1788270052.690576:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788270052.690592:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:46521:x1875136262612736:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788270052.697549:0:47281:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788270052.697563:0:47281:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -31 00002000:02000040:0.0:1788270052.697570:0:47281:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:163 to 0x2c0000401:193) 00002000:00010000:2.0:1788270052.701223:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.701236:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.701254:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.701260:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.701267:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.701284:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.701296:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.701314:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.701336:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.701353:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.701362:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.701378:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.701384:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.701395:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.701424:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.701433:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08705 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.701457:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.701459:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.701461:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.704966:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.704980:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.704997:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.705002:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.705009:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705022:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705032:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705062:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705086:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.705113:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.705120:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.705127:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.705132:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.705140:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.705155:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.705162:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0870c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.705181:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.705183:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.705184:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.705852:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.705859:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705869:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.705873:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.705878:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705888:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705897:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705905:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.705932:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.706072:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.706078:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.706090:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.706094:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788270052.706099:0:48231:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00010000:00010000:1.0:1788270052.706103:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788270052.706109:0:48231:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -31 00010000:00010000:1.0:1788270052.706118:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.706127:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e11d736c/0xc5f5d7a016e08713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.706143:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.706145:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.706147:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:02000040:3.0:1788270052.706208:0:48231:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:163 to 0x2c0000400:193) 00002000:00010000:2.0:1788270052.707660:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.707669:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.707682:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.707686:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.707692:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.707706:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.707715:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.707723:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.707743:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788270052.708140:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.708146:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708156:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.708160:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.708165:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708175:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708183:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708191:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708208:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.708225:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.708232:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708239:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.708244:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708259:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708274:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708282:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d26563c/0xc5f5d7a016e0871a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708378:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.708383:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708391:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ca00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.708395:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708412:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708425:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708432:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08721 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.708449:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.708451:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.708453:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.708550:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788270052.708644:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788270052.708692:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.708701:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.708711:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.708716:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.708721:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.708733:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.708742:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.708750:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.708764:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.708781:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.708788:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708798:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.708803:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708812:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708841:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708851:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08728 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.708867:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.708869:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.708872:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.712486:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788270052.712494:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.712500:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712504:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712527:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.712528:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.712536:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.712537:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.712549:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712550:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.712577:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712582:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.712592:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712596:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712616:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.712620:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.712651:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.712783:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.712795:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.712801:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712809:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.712814:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712828:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712845:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712851:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e0872f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712871:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.712874:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712881:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.712884:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.712891:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270052.713531:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.713539:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713548:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.713551:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.713556:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713567:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713575:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713581:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713596:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713598:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.713609:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e08736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713634:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.713638:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713645:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.713649:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713657:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713667:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713674:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085308ff0/0xc5f5d7a016e0873d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713689:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.713691:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.713694:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.713725:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.713731:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713739:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.713742:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.713746:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713754:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713782:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713790:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.713809:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.713814:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.713819:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713826:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.713831:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713839:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713850:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713858:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e08744 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713872:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.713873:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.713875:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.713908:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.713909:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.713916:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713924:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.713928:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.713932:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713943:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713949:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713961:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713977:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.713986:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.713990:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.713997:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.714000:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.714009:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270052.714018:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.714021:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.714031:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0874b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.714066:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.714068:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.714070:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.714125:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714137:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc1:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.714140:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.714145:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714157:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714166:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714175:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714189:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.714197:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.714201:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714208:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.714211:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714219:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714229:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714348:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08752 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714364:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.714367:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.714369:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.714432:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.714724:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.714732:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714741:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc0:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.714745:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.714750:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714759:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714766:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714773:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.714859:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788270052.715150:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788270052.715259:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.715265:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.715274:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.715278:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270052.715284:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.715292:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715304:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.715308:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.715313:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715326:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715336:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.715357:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270052.715369:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.715371:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715378:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.715382:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051ff7ef6/0xc5f5d7a016e08759 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715419:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbf:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.715420:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715424:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.715425:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.715429:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715432:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270052.715433:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.715445:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715449:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.715464:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.715466:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.715469:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.715478:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715481:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.715498:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715506:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.715519:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.715519:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715523:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715525:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.715542:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715550:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.715558:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715560:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788270052.715567:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.715570:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715574:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270052.715580:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715595:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.715602:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715609:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715612:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715628:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08767 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715637:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715644:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.715649:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e08760 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715651:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.715653:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715668:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.715672:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715681:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715682:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.715685:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.715690:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715697:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715705:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e0876e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.715722:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715725:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.715728:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.720103:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788270052.720103:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.720122:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720122:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.720132:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.720145:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720150:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.720151:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbe:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.720160:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.720161:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.720163:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.720173:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.720175:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720175:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.720178:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720206:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.720207:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.720210:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720229:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.720233:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.720239:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720243:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.720256:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.720271:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.720308:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.720511:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788270052.721235:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788270052.721246:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721258:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.721263:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721274:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721292:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721301:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e808776/0xc5f5d7a016e08775 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721330:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270052.721334:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721341:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.721345:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721353:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721369:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721377:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0f6855/0xc5f5d7a016e0877c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721390:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.721393:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721400:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.721413:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721422:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721432:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.721443:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.721446:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.721448:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.721454:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788270052.721461:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08783 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.721516:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.721574:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.721580:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.721589:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.721593:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.721597:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.721607:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.721614:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.721621:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.722164:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.722171:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.722180:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.722183:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.722187:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.722196:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.722210:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.722228:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270052.733080:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.733101:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.733117:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbd:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.733122:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.733128:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.733148:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.733158:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.733165:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733620:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788270052.733634:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788270052.733639:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733647:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.733651:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733658:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733670:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733676:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.733678:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733688:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.733691:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.733694:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.733703:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.733705:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733720:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.733733:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.733736:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08791 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.733739:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.733756:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.733759:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.733762:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.733764:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.733775:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.733785:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.733787:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.733790:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.733799:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.735740:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.735753:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735767:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.735772:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.735777:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735802:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735812:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735819:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735839:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.735849:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.735863:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735871:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.735875:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.735884:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.736147:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.736156:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0879f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.736171:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.736174:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.736176:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.736574:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788270052.736583:0:47284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009457bdda/0xc5f5d7a016e0878a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.736745:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.736751:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.736760:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.736763:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.736768:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.736777:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.736828:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788270052.736836:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08798 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.736981:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.737081:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.737087:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737096:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.737099:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.737104:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737113:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737121:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737129:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737143:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.737184:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737193:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737208:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.737230:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.737236:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.737243:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.737244:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.737251:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737252:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.737270:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.737276:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737280:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.737285:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737301:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.737305:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737315:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e087ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.737333:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.737335:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.737336:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.737374:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e087a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.737392:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.737393:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.737394:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.737663:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.737670:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737679:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.737683:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.737687:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737702:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737711:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737719:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737732:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.737740:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.737744:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737751:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.737755:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737763:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737774:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737782:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e087b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.737797:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.737799:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.737801:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.738292:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.738300:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.738309:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.738314:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.738318:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.738328:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.738336:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.738343:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.738361:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.738493:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.738499:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738507:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.738511:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738520:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738533:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738542:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e087bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738558:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.738559:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.738561:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.738603:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.738609:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738622:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.738625:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.738629:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738638:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738646:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738654:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.738673:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.738827:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.738833:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.738840:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.738843:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.738852:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.738863:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.738871:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c1e99e/0xc5f5d7a016e087c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.738892:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.738894:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.738896:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.739176:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.739183:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.739185:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.739197:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739198:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.739206:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.739216:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739225:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739239:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739247:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739262:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.739269:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.739271:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.739276:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.739278:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.739283:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739293:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.739300:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.739303:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739315:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.739319:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.739333:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739335:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739351:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e087d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.739366:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.739366:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.739374:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739380:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.739384:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739392:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739413:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739421:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c7f5606/0xc5f5d7a016e087c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739434:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.739436:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.739438:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.739579:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.739586:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739595:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbc:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.739599:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.739604:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739619:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739627:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739635:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.739649:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788270052.740119:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.740127:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740137:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.740140:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.740143:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740153:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740160:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740167:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740185:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788270052.740196:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270052.740202:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740209:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.740212:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740220:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740234:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740241:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e087d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740256:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.740260:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740265:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.740267:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740272:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740280:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740288:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df0b53a/0xc5f5d7a016e087de lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740303:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.740305:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.740307:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.740369:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.740375:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740384:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.740387:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.740391:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740400:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740426:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740433:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740466:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.740506:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.740510:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740515:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.740518:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740523:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740531:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740536:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d25cb32/0xc5f5d7a016e087e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740545:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.740546:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.740547:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.740579:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.740583:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740588:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.740591:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.740594:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740600:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740604:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740609:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740623:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.740628:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.740630:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740634:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.740636:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740640:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740645:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740649:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2498b49/0xc5f5d7a016e087ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740668:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.740669:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.740670:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.740748:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.740754:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740763:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.740766:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.740771:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.740846:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270052.740875:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.740879:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740885:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.740888:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.740891:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740896:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740901:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740905:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740913:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.740918:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.740920:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.740924:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.740926:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741109:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741118:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741133:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788270052.741345:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.741351:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741359:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.741362:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.741366:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741374:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741383:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741389:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741397:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788270052.741504:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741518:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741530:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f28482d/0xc5f5d7a016e087fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741551:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270052.741555:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741562:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.741566:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741573:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741584:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741592:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e087f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270052.741600:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.741609:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.741609:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741617:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.741622:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbb:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.741631:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.741632:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.741637:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741639:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.741645:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.741656:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.741661:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741663:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741674:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.741683:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.741687:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741690:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741705:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741713:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.741725:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741732:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f0fd33/0xc5f5d7a016e08801 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741738:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.741752:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.741761:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741763:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.741770:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.741773:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.741783:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.741786:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741795:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741807:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741815:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e08808 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741829:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.741833:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741840:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.741843:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741851:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741863:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741871:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d816518/0xc5f5d7a016e0880f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.741889:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.741891:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.741894:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.741953:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.741960:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.742255:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.742261:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742270:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xba:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.742272:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.742276:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742285:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742294:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742302:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742319:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788270052.742355:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.742362:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742371:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaf:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.742374:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.742379:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742388:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742397:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742413:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742439:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.742478:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.742484:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742491:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dae00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.742495:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742519:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742531:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742547:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b138ede/0xc5f5d7a016e08816 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.742562:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.742563:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.742567:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.742568:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742569:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.742578:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.742583:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.742591:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.742603:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.742605:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.742620:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d5324c/0xc5f5d7a016e0881d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742621:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742641:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb9:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.742644:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.742647:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.742649:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.742650:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.742654:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.742662:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742671:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742678:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.742695:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788270052.742728:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.742734:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742743:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xae:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.742745:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.742750:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742759:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742767:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742775:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742789:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.742795:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.742798:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742804:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.742808:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742815:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742825:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742831:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f305dc/0xc5f5d7a016e08824 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742843:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.742846:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742852:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.742855:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742862:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742871:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742877:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058754421/0xc5f5d7a016e0882b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.742888:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.742889:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.742891:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.742998:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.743131:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.743137:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.743146:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xad:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.743149:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.743154:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.743163:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.743171:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.743178:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.743194:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788270052.743208:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.743263:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743271:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb8:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.743275:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.743279:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743288:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743296:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743302:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743361:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788270052.743635:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.743642:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743652:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb7:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.743656:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.743660:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743669:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743678:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.743686:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.746214:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788270052.746425:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788270052.746435:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746456:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.746461:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746471:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746489:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746498:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd68bcb4/0xc5f5d7a016e08832 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746517:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.746522:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746528:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.746530:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746548:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746557:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746564:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e08839 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746580:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.746583:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746589:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.746592:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746599:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746608:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746614:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e08840 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.746625:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.746626:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.746628:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.746808:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.746816:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.746829:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb6:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.746833:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.746839:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.746850:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.746860:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.746868:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.746880:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.747147:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.747153:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747162:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.747166:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747175:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747187:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747196:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007667e6e7/0xc5f5d7a016e08847 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747211:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.747213:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.747215:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.747338:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.747346:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.747355:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xac:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.747359:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.747364:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.747374:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.747382:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.747390:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.747394:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.747414:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747424:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb5:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.747427:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.747432:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747442:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747450:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747458:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.747740:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.747766:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.747770:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.747776:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747777:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.747783:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747791:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.747795:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747803:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747815:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747823:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f8810a6/0xc5f5d7a016e08855 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.747836:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.747839:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.747843:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.747843:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.747849:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.748084:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.748100:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.748107:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f7bafd1/0xc5f5d7a016e0884e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.748119:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.748121:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.748123:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.748216:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.748224:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748233:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb4:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.748236:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.748241:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748251:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748260:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748268:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748280:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.748287:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.748290:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748296:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.748300:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748306:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748317:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748324:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e962c3/0xc5f5d7a016e0885c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748338:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.748340:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.748341:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.748633:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.748639:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748647:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb3:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.748650:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.748654:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748663:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748669:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748676:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.748710:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788270052.749021:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.749027:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749126:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb2:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.749129:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.749134:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749143:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749152:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749161:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749176:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.749184:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.749188:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.749194:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.749197:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.749201:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749203:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749218:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749230:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749238:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e08863 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749253:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.749255:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.749257:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.749308:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.749312:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.749320:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.749334:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.749341:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23fe3aa/0xc5f5d7a016e0886a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.749362:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.749363:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.749365:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.749468:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.749474:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.749757:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.749764:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749773:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb1:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.749776:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.749780:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749790:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749799:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749808:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749822:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.749830:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.749833:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749840:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.749843:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749852:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749863:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749871:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e08871 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.749884:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.749886:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.749888:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.750286:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.750296:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750306:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb0:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.750309:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.750315:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750325:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750333:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750339:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750360:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.750366:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.750372:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.750379:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.750383:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.750391:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.750414:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.750421:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08878 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.750441:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.750443:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.750445:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.750706:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.750714:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750725:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xab:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.750729:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.750733:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750745:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.750754:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.750754:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750766:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750768:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750788:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xaf:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.750793:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.750797:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.750799:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750807:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.750812:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750813:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750836:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750836:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.750842:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750852:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750877:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750884:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.750892:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750894:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.750901:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750906:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085308ff0/0xc5f5d7a016e0887f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750915:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.750922:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750931:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.750933:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.750935:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.750939:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.750950:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750959:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e08886 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.750975:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.750977:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.750979:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.751360:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.751367:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751375:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaa:0x0].0x0 since=844s v=(0 0) 00002000:00010000:2.0:1788270052.751380:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.751380:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.751389:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.751392:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.751416:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.751420:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.751424:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.751432:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.751440:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.751446:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.751464:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.751475:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751485:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751494:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751509:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788270052.751518:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788270052.751522:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751529:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5cc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.751532:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751540:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751551:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751559:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea933191/0xc5f5d7a016e08894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751584:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.751588:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751600:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.751604:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751612:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751621:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751628:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059344293/0xc5f5d7a016e0888d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.751644:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.751646:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.751648:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.751657:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.751821:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.751827:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.751835:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xae:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.751838:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.751843:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.751852:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.751861:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.751868:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.751888:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.752021:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.752027:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752035:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.752076:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752086:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752098:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752105:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e0889b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752119:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.752122:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.752125:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788270052.752202:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.752209:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752218:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa9:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.752221:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.752226:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752236:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752244:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752251:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752273:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.752367:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.752373:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752381:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.752385:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752394:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752417:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.752424:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.752425:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac486b1/0xc5f5d7a016e088a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752435:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752457:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xad:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.752461:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.752465:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.752466:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752469:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.752473:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.752482:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752491:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752504:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752543:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.752551:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.752554:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752561:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ac00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.752565:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752572:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752583:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752590:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d293660/0xc5f5d7a016e088a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.752603:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.752606:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.752608:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.752655:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.752661:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752670:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa8:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.752674:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.752679:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752689:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752698:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752706:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752719:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.752727:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.752731:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752743:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.752747:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752762:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752774:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752782:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eafe7c99/0xc5f5d7a016e088b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.752796:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.752798:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.752799:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.752901:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.752909:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.752917:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.752920:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.752924:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.752933:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.752941:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.752948:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.753010:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788270052.753173:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.753181:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753190:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xac:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.753194:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270052.753199:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753208:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753217:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753224:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753238:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.753245:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.753249:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753255:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.753259:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753268:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753280:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753287:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e088b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753304:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.753307:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753313:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19bc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.753317:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753324:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753334:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753341:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e088be lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.753353:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.753355:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.753358:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.753722:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.753730:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.753745:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.753749:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.753754:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.753765:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.753773:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.753834:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.753847:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788270052.754122:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.754128:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754137:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.754140:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.754145:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754154:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754168:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754175:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754301:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788270052.754413:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.754419:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754427:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xab:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.754431:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.754432:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.754436:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754440:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754452:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754454:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.754461:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754471:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754480:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754485:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754492:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754498:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038165e63/0xc5f5d7a016e088c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754523:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788270052.754529:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788270052.754535:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754547:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.754550:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754557:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754567:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754574:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b432da3f/0xc5f5d7a016e088cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754583:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.754586:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754594:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.754597:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754604:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754614:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754622:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1383ec9/0xc5f5d7a016e088d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.754634:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.754636:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.754638:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.754677:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.754683:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754691:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.754694:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.754698:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754707:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754714:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754722:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.754754:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788270052.755110:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.755117:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755125:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xae:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.755125:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.755131:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.755133:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755137:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755148:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.755157:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755157:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755177:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755178:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755191:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755200:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e088da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755213:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.755215:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.755217:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.755256:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.755265:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755271:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755278:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xaa:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.755287:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.755292:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755295:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.755307:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755316:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755324:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755334:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.755365:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.755370:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755378:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.755381:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755390:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755401:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755421:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e31275/0xc5f5d7a016e088e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755435:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.755438:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755445:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.755448:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755455:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755464:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755471:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2498b49/0xc5f5d7a016e088e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755493:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.755495:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.755497:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.755501:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.755511:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.755757:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.755764:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755773:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xad:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.755776:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.755798:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755808:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755816:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755827:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755841:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.755848:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788270052.755848:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.755857:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.755863:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755869:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa7:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.755875:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.755876:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.755882:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755896:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755903:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755910:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.755921:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.756111:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.756119:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756128:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.756133:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756146:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756161:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756168:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756170:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014cf1a77/0xc5f5d7a016e088f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756188:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756200:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.756204:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.756207:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.756208:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756217:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e088ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756235:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.756237:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.756239:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.756256:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.756264:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756272:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa9:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.756275:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.756280:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756288:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756296:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756303:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756319:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788270052.756602:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.756608:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756616:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xac:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.756619:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.756624:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756634:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756642:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756648:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756673:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788270052.756679:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788270052.756685:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756693:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.756697:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756705:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756719:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756726:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009457bdda/0xc5f5d7a016e088fd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756740:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.756744:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756755:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.756759:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756767:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756777:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756785:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058754421/0xc5f5d7a016e08904 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756800:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.756802:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.756805:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.756824:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.756834:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.756841:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756850:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa8:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.756853:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.756857:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756867:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756876:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756884:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.756907:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.756910:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.756916:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756925:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.756929:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756936:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756949:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756969:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e808776/0xc5f5d7a016e0890b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.756984:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.756986:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.756990:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.757123:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.757130:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757138:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa7:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.757141:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.757146:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757155:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270052.757159:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.757166:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.757169:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270052.757174:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.757188:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757188:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.757189:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xab:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.757198:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.757208:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757215:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa6:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.757224:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.757235:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757236:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757242:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.757252:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.757258:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757259:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757262:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757283:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.757287:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757291:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.757298:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757313:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757317:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.757327:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.757342:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757344:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788270052.757354:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067c1e99e/0xc5f5d7a016e08912 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757368:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788270052.757372:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757379:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.757383:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757396:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757417:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757424:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744edfc3/0xc5f5d7a016e08919 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757440:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.757445:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.757445:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.757445:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757455:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.757459:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757467:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757478:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757485:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113aeb5e/0xc5f5d7a016e08920 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757507:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.757510:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.757512:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.757709:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.757715:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757723:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaa:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.757726:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.757730:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757740:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757748:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757755:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.757805:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788270052.757912:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.757925:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757934:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.757938:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.757942:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757953:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757961:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757968:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.757993:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.758116:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.758121:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.758128:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.758132:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.758141:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.758155:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.758162:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e08927 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758163:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.758172:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270052.758173:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.758180:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.758184:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.758185:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.758188:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.758190:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.758197:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758220:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758235:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758245:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa6:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.758247:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d25cb32/0xc5f5d7a016e0892e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758252:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.758262:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758270:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.758274:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.758276:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758277:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.758287:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758295:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758320:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.758430:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.758436:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758445:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193a00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.758449:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270052.758452:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.758462:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758473:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758477:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.758492:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758502:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df0b53a/0xc5f5d7a016e08935 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758505:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.758516:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.758521:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.758524:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.758528:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.758530:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758544:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758552:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758568:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788270052.758689:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.758695:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758703:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa5:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.758706:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.758710:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758719:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758727:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758763:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.758781:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.759125:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.759131:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270052.759135:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270052.759147:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.759147:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759153:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759162:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa4:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.759168:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759168:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.759175:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759187:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759189:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759214:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759218:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7f5606/0xc5f5d7a016e0893c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759230:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759241:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788270052.759245:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.759247:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759256:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.759259:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759271:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759282:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759290:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f492d31/0xc5f5d7a016e08943 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759303:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.759307:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759315:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.759319:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759327:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759338:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.759343:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759347:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028735e95/0xc5f5d7a016e0894a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759362:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759364:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759367:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759374:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788270052.759391:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.759398:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.759417:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa9:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.759420:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.759425:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270052.759430:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.759435:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759438:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.759450:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759453:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3:0x0].0x0 since=844s v=(0 0) 00010000:00010000:1.0:1788270052.759461:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.759464:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759467:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759486:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.759490:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270052.759505:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759513:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759529:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788270052.759536:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270052.759540:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759548:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.759552:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759560:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759570:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759579:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f7bafd1/0xc5f5d7a016e08951 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759592:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270052.759596:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759603:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ac00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270052.759606:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759615:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759625:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759631:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759634:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d293660/0xc5f5d7a016e08958 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270052.759650:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759653:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270052.759656:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270052.759675:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270052.759682:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759690:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa3:0x0].0x0 since=844s v=(0 0) 00010000:00010000:0.0:1788270052.759694:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270052.759699:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788270052.759706:0:47284:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:162 00010000:00010000:0.0:1788270052.759708:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759717:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759724:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.759742:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788270052.759776:0:48231:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:162 00000100:00100000:1.0:1788270052.759801:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:45801:x1875136262611328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77225us (77644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.759812:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788270052.759833:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:46521:x1875136262612736:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69243us (75123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270052.759842:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270052.759874:0:45801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45801:1875136262611328:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788270052.759883:0:46521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:46521:1875136262612736:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788270052.759892:0:45801:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0xc1:0x0] from OST, last_created [0x280000401:0xc1:0x0]last_used is [0x280000401:0xa2:0x0] 00000004:00080000:0.0:1788270052.759896:0:46521:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0xc1:0x0] from OST, last_created [0x2c0000400:0xc1:0x0]last_used is [0x2c0000400:0xa2:0x0] 00000100:00100000:1.0:1788270052.759942:0:45801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45801:1875136262612992:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788270052.759943:0:46521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:46521:1875136262612864:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788270052.759992:0:46521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.760022:0:46521:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b74c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270052.760057:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612864 00000100:00100000:0.0:1788270052.760063:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612864 00010000:00010000:3.0:1788270052.760273:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.760280:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.760289:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.760293:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.760307:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.760319:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.760326:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc8381/0xc5f5d7a016e0895f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.760346:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.760348:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.760350:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270052.760679:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788270052.760758:0:45801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.760782:0:45801:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788270052.760795:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262612992 00000100:00100000:1.0:1788270052.760800:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262612992 00000100:00100000:1.0:1788270052.760820:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788270052.760826:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:45801:x1875136262612992:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788270052.761132:0:48230:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 194 00000100:00100000:1.0:1788270052.761235:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:46521:x1875136262612864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788270052.761255:0:47284:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 194 00002000:00010000:3.0:1788270052.764666:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.764680:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764698:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa8:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.764703:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.764709:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764723:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764734:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764743:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764764:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.764774:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.764842:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764910:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.764916:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764926:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764941:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764949:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df4d5f6/0xc5f5d7a016e08966 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.764976:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.764978:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.764980:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.767804:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.767816:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.767832:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa7:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.767837:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.767843:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.767856:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.767866:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.767873:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.767896:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788270052.769154:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.769169:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.769182:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa6:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.769186:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.769192:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.769204:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.769216:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.769225:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.769249:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788270052.769639:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788270052.769647:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769657:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.769662:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769671:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769701:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769708:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0896d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769731:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270052.769736:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769742:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.769746:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769754:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769768:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769776:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c443459c/0xc5f5d7a016e08974 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.769789:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.769791:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.769793:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788270052.771248:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771073 is committed 00000001:00100000:1.0:1788270052.771360:0:48095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788270052.771365:0:48095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788270052.771550:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:46521:x1875136262612864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 10797us (11553us total) trans 30064771073 rc 0/0 00000100:00100000:1.0:1788270052.771560:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:3.0:1788270052.772429:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270052.772444:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772462:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5:0x0].0x0 since=844s v=(0 0) 00010000:00010000:3.0:1788270052.772467:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270052.772473:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772486:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772498:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772507:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772532:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270052.772544:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788270052.772544:0:46521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 30064771073 gen 2 00010000:00010000:3.0:1788270052.772552:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270052.772559:0:46521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:46521:1875136262612864:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1788270052.772563:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ec00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270052.772570:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772580:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270052.772580:0:46521:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0xc1:0x0]-[0x2c0000400:0xe1:0x0] 00010000:00010000:3.0:1788270052.772603:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772612:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b3cf68/0xc5f5d7a016e0897b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.772630:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.772633:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270052.772636:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270052.772640:0:46521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:46521:1875136262613120:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788270052.772707:0:46521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.772735:0:46521:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b74c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788270052.772749:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788270052.773860:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.773870:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.773884:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.773888:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.773893:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.773904:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.773914:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.773922:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.773945:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270052.774078:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270052.774085:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.774095:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270052.774099:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.774110:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.774126:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.774133:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08982 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.774156:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.774159:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270052.774161:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788270052.774218:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771074 is committed 00000001:00100000:2.0:1788270052.774298:0:47278:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788270052.774329:0:45787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613120 00000100:00100000:1.0:1788270052.774346:0:45787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613120 00002000:00010000:2.0:1788270052.774369:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270052.774379:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.774388:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3:0x0].0x0 since=844s v=(0 0) 00010000:00010000:2.0:1788270052.774393:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270052.774397:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.774420:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270052.774425:0:45787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788270052.774441:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270052.774444:0:45787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:46521:x1875136262613120:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788270052.774463:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.774486:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270052.774495:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270052.774499:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.774507:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5dc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270052.774511:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.774520:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270052.775226:0:45787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:46521:x1875136262613120:12345-0@lo:900:osp-pre-1-1.0 Request processed in 784us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270052.775237:0:45787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270052.775300:0:45801:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771074 gen 2 00000100:00100000:1.0:1788270052.775310:0:45801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45801:1875136262612992:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788270052.775329:0:45801:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xc1:0x0]-[0x280000401:0xe1:0x0] 00010000:00080000:1.0:1788270052.775376:0:46521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1451c3b80 x1875136262613120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788270068 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270052.775389:0:46521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:46521:1875136262613120:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788270052.775801:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.775817:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddffa065/0xc5f5d7a016e08989 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.775844:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.775845:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270052.775847:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788270052.775910:0:47281:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:162 00000100:00100000:2.0:1788270052.775985:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:45803:x1875136262612480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92194us (92276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.775994:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788270052.776231:0:45803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45803:1875136262612480:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788270052.776246:0:45803:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0xc1:0x0] from OST, last_created [0x2c0000401:0xc1:0x0]last_used is [0x2c0000401:0xa2:0x0] 00000100:00100000:1.0:1788270052.776298:0:45803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45803:1875136262613248:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788270052.776347:0:45803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270052.776387:0:45803:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788270052.776415:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613248 00000100:00100000:2.0:1788270052.776425:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613248 00000100:00100000:2.0:1788270052.776472:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788270052.776481:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:45803:x1875136262613248:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788270052.776517:0:47283:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 194 00000100:00100000:0.0:1788270052.776737:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:45801:x1875136262612992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15908us (15977us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1788270052.776746:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788270052.780567:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:45803:x1875136262613248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4081us (4214us total) trans 30064771074 rc 0/0 00000100:00100000:2.0:1788270052.780581:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788270052.782378:0:45803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45803:1875136262613248:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788270052.782397:0:45803:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xc1:0x0]-[0x2c0000401:0xe1:0x0] 00010000:00010000:1.0:1788270052.804892:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788270052.868108:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788270052.868127:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c27f622800 from 30 10000000:01000000:2.0:1788270052.868132:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788270052.868177:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.868189:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.868201:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270052.868228:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788270052.868297:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270052.868332:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613376 00000100:00100000:2.0:1788270052.868339:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788270052.868340:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613376 00000100:00100000:3.0:1788270052.868385:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788270052.868392:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262613376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270052.868420:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270052.868436:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9ec00/0xc5f5d7a016e08997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08990 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.868460:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9ec00/0xc5f5d7a016e08997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08990 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.868469:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9ec00/0xc5f5d7a016e08997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08990 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.868476:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ec00, rc 0) 00000100:00100000:3.0:1788270052.868512:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262613376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270052.868517:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788270052.868535:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270052.868550:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08997 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.868560:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08997 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270052.868613:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788270052.868644:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270052.868701:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270052.868734:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613504 00000100:00100000:0.0:1788270052.868739:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613504 00000100:00100000:0.0:1788270052.868775:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788270052.868783:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262613504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788270052.868797:0:45768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788270052.868812:0:45768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788270052.868816:0:45768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 30 00000100:00100000:0.0:1788270052.868906:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262613504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270052.868914:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788270052.868920:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788270052.869267:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788270052.869275:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08997 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.869286:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c26ab5dc00/0xc5f5d7a016e08990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08997 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788270052.869295:0:45773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788270052.869297:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c265eb0800 from 30 10000000:01000000:2.0:1788270052.869300:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788270052.869319:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.869327:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270052.869335:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270052.869348:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788270052.869376:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270052.869413:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270052.869416:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613632 00000100:00100000:3.0:1788270052.869422:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613632 00000100:00100000:3.0:1788270052.869449:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788270052.869455:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262613632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270052.869462:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270052.869471:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9e200/0xc5f5d7a016e089a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0899e expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.869485:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9e200/0xc5f5d7a016e089a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0899e expref: 24 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.869494:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9e200/0xc5f5d7a016e089a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0899e expref: 24 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270052.869502:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e200, rc 0) 00000100:00100000:3.0:1788270052.869538:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262613632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270052.869544:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788270052.869570:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788270052.869583:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e089a5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.869592:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e089a5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270052.869634:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788270052.869664:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270052.869684:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b74f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270052.869705:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613760 00000100:00100000:2.0:1788270052.869711:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613760 00000100:00100000:2.0:1788270052.869744:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788270052.869751:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262613760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788270052.869762:0:45768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788270052.869774:0:45768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788270052.869777:0:45768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 30 00000100:00100000:2.0:1788270052.869856:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262613760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270052.869864:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788270052.869869:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262613760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788270052.869916:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788270052.869921:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e089a5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270052.869934:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c26ab5da00/0xc5f5d7a016e0899e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e089a5 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270053.828175:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788270054.755889:0:48455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788270054.852126:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270055.113812:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262613888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270055.113885:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270055.114011:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262613888 00000100:00100000:3.0:1788270055.114021:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262613888 00000100:00100000:3.0:1788270055.114108:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788270055.114119:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262613888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270055.114148:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270055.114195:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262613888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270055.114202:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788270055.114324:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270055.114360:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262613888:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788270055.281342:0:48507:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788270055.281584:0:48507:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788270055.621450:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270055.621473:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262614016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270055.621536:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270055.621612:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614016 00000100:00100000:0.0:1788270055.621621:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614016 00000100:00100000:0.0:1788270055.621677:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788270055.621687:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262614016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270055.621730:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1788270055.621791:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262614016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270055.621798:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788270055.621952:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262614016:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788270055.820553:0:48557:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788270055.820706:0:48557:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788270055.876130:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270055.951170:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270055.951450:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113344 00000100:00100000:3.0:1788270055.951460:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113344 00000100:00100000:3.0:1788270055.951504:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:3.0:1788270055.951513:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1875136253113344:12345-192.168.201.42@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788270055.951541:0:45770:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aa52f0bf-08b6-495d-a5ae-358be8153494@192.168.201.42@tcp t0 exp 0000000000000000 cur 847 last 0 00000020:00000080:3.0:1788270055.951573:0:45770:0:(genops.c:1385:class_connect()) connect: client aa52f0bf-08b6-495d-a5ae-358be8153494, cookie 0xc5f5d7a016e089ac 00000100:00080000:3.0:1788270055.951702:0:45770:0:(import.c:65:import_set_state_nolock()) ffff98c27c177800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788270055.951776:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+5:2399:x1875136253113344:12345-192.168.201.42@tcp:250:mount.lustre.0 Request processed in 263us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270055.951785:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788270055.953331:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270055.953432:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113472 00000100:00100000:0.0:1788270055.953439:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113472 00000100:00100000:0.0:1788270055.953558:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:0.0:1788270055.953566:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+5:33905:x1875136253113472:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788270055.953577:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270055.953590:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144193c00/0xc5f5d7a016e089b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101771 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270055.953611:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144193c00/0xc5f5d7a016e089b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101771 expref: 6 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270055.953619:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144193c00/0xc5f5d7a016e089b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101771 expref: 6 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270055.953626:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193c00, rc 0) 00000100:00100000:0.0:1788270055.953669:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+6:33905:x1875136253113472:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 104us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270055.953673:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:1.0:1788270055.958393:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270055.958448:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113600 00000100:00100000:3.0:1788270055.958458:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113600 00000100:00100000:3.0:1788270055.958512:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788270055.958523:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+6:33905:x1875136253113600:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788270055.958638:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+6:33905:x1875136253113600:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 117us (255us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788270055.958648:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:1.0:1788270055.961311:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270055.961425:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113728 00000100:00100000:0.0:1788270055.961435:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113728 00000100:00100000:0.0:1788270055.961555:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788270055.961564:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+6:33905:x1875136253113728:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788270055.961579:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270055.961595:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c144193a00/0xc5f5d7a016e089ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101778 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270055.961620:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144193a00/0xc5f5d7a016e089ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101778 expref: 7 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270055.961630:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c144193a00/0xc5f5d7a016e089ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101778 expref: 7 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270055.961639:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193a00, rc 0) 00000100:00100000:0.0:1788270055.961688:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+7:33905:x1875136253113728:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 125us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270055.961695:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:2.0:1788270055.963164:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270055.963212:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113856 00000100:00100000:3.0:1788270055.963220:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113856 00000100:00100000:3.0:1788270055.963258:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:3.0:1788270055.963268:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+7:33905:x1875136253113856:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788270055.963411:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33905:x1875136253113856:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270055.963418:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788270055.964367:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270055.964430:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253113984 00000100:00100000:0.0:1788270055.964434:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253113984 00000100:00100000:0.0:1788270055.964459:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788270055.964464:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33905:x1875136253113984:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788270055.964545:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33905:x1875136253113984:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270055.964550:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:1.0:1788270055.968867:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270055.968951:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114112 00000100:00100000:3.0:1788270055.968969:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114112 00000100:00100000:3.0:1788270055.969151:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788270055.969165:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33924:x1875136253114112:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788270055.969389:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33924:x1875136253114112:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 226us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270055.969399:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788270055.980882:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270055.980977:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114240 00000100:00100000:0.0:1788270055.980992:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114240 00000100:00100000:3.0:1788270055.981087:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:3.0:1788270055.981102:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33924:x1875136253114240:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788270055.981761:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33924:x1875136253114240:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 659us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270055.981775:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788270055.983835:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270055.984158:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114368 00000100:00100000:2.0:1788270055.984171:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114368 00000100:00100000:2.0:1788270055.984238:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:2.0:1788270055.984251:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33924:x1875136253114368:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788270055.984447:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33924:x1875136253114368:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 197us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270055.984457:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:1.0:1788270055.989151:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270055.989304:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114496 00000100:00100000:2.0:1788270055.989319:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114496 00000100:00100000:2.0:1788270055.989455:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:2.0:1788270055.989541:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+8:33905:x1875136253114496:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788270055.989563:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270055.989586:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5cc00/0xc5f5d7a016e089c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561017a9 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270055.989625:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5cc00/0xc5f5d7a016e089c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017a9 expref: 9 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270055.989638:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5cc00/0xc5f5d7a016e089c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017a9 expref: 9 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270055.989649:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5cc00, rc 0) 00000100:00100000:2.0:1788270055.989824:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+9:33905:x1875136253114496:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 288us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270055.989832:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788270055.997151:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270055.997257:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114624 00000100:00100000:2.0:1788270055.997276:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114624 00000100:00100000:2.0:1788270055.997382:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788270055.997395:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+9:33905:x1875136253114624:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788270055.997429:0:45771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788270055.997461:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788270055.997466:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788270055.997469:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788270055.997473:0:45771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788270055.997475:0:45771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 30 00000100:00100000:2.0:1788270056.000379:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+9:33905:x1875136253114624:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 2972us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.000400:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:0.0:1788270056.002959:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270056.003064:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114752 00000100:00100000:2.0:1788270056.003074:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114752 00000100:00100000:2.0:1788270056.003124:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:2.0:1788270056.003133:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+9:33905:x1875136253114752:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788270056.003148:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270056.003164:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561017b0 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270056.003190:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 10 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270056.003201:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 10 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270056.003211:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d800, rc 0) 00000100:00100000:2.0:1788270056.003267:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33905:x1875136253114752:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.003274:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788270056.004283:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270056.004369:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253114880 00000100:00100000:2.0:1788270056.004375:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253114880 00000100:00100000:2.0:1788270056.004407:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:2.0:1788270056.004415:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33905:x1875136253114880:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788270056.004547:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33905:x1875136253114880:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 131us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.004554:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:3.0:1788270056.006649:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270056.006738:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115008 00000100:00100000:2.0:1788270056.006744:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115008 00000100:00100000:2.0:1788270056.006781:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:2.0:1788270056.006790:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33905:x1875136253115008:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788270056.006911:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33905:x1875136253115008:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 121us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.006919:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:0.0:1788270056.008592:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270056.008747:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115136 00000100:00100000:2.0:1788270056.008753:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115136 00000100:00100000:2.0:1788270056.008857:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:2.0:1788270056.008867:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33929:x1875136253115136:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788270056.008963:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33929:x1875136253115136:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.008970:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:3.0:1788270056.014643:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270056.014768:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115264 00000100:00100000:2.0:1788270056.014778:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115264 00000100:00100000:2.0:1788270056.014844:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:2.0:1788270056.014856:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33929:x1875136253115264:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788270056.015026:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+10:33929:x1875136253115264:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 173us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.015035:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:3.0:1788270056.018331:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270056.018411:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270056.018501:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115392 00000100:00100000:1.0:1788270056.018510:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115392 00000100:00100000:1.0:1788270056.018545:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115648 00000100:00100000:1.0:1788270056.018547:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115648 00000100:00100000:1.0:1788270056.018576:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788270056.018584:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875136253115392:12345-192.168.201.42@tcp:38:mount.lustre.0 00000100:00100000:2.0:1788270056.018590:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788270056.018599:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875136253115648:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788270056.018620:0:45778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp t0 exp 0000000000000000 cur 847 last 0 00010000:00080000:1.0:1788270056.018627:0:48110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp t0 exp 0000000000000000 cur 847 last 0 00000020:00000080:2.0:1788270056.018687:0:45778:0:(genops.c:1385:class_connect()) connect: client bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49, cookie 0xc5f5d7a016e089cf 00000020:00000080:1.0:1788270056.018689:0:48110:0:(genops.c:1385:class_connect()) connect: client bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49, cookie 0xc5f5d7a016e089d6 00000004:00100000:2.0:1788270056.018716:0:45778:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788270056.018926:0:45778:0:(import.c:65:import_set_state_nolock()) ffff98c142563800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270056.018994:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2399:x1875136253115648:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 393us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.019002:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000004:00100000:1.0:1788270056.019251:0:48110:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788270056.019393:0:48110:0:(import.c:65:import_set_state_nolock()) ffff98c247f7a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788270056.019430:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2399:x1875136253115392:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 845us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270056.019437:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788270056.020714:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270056.020879:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115904 00000100:00100000:0.0:1788270056.020887:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115904 00000100:00100000:0.0:1788270056.020949:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788270056.020960:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253115904:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788270056.020987:0:45776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1788270056.021098:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253115904:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270056.021106:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00080000:1.0:1788270056.021230:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270056.021982:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270056.022058:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116032 00000100:00100000:3.0:1788270056.022064:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116032 00000100:00100000:3.0:1788270056.022104:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788270056.022113:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253116032:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788270056.022166:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253116032:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270056.022173:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788270056.022941:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270056.022988:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270056.023077:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115776 00000100:00100000:1.0:1788270056.023082:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115776 00000100:00100000:1.0:1788270056.023132:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253115520 00000100:00100000:1.0:1788270056.023136:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253115520 00000100:00100000:1.0:1788270056.023155:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788270056.023163:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:0:x1875136253115776:12345-192.168.201.42@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788270056.023182:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270056.023191:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000004:00000024:1.0:1788270056.023199:0:48110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446363136 avail 1300123648 00000100:00100000:0.0:1788270056.023205:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:0:x1875136253115520:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788270056.023222:0:46770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1788270056.023275:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:0:x1875136253115520:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270056.023290:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788270056.023724:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:0:x1875136253115776:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 561us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270056.023732:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788270056.024326:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270056.024379:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270056.024412:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270056.024484:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116160 00000100:00100000:3.0:1788270056.024490:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116160 00000100:00100000:3.0:1788270056.024518:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116288 00000100:00100000:3.0:1788270056.024520:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116288 00000100:00100000:3.0:1788270056.024535:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788270056.024541:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875136253116160:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788270056.024570:0:47284:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp t0 exp 0000000000000000 cur 847 last 0 00000020:00000080:3.0:1788270056.024604:0:47284:0:(genops.c:1385:class_connect()) connect: client bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49, cookie 0xc5f5d7a016e089dd 00002000:00100000:3.0:1788270056.024616:0:47284:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49/ffff98c27c174000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788270056.024627:0:47284:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788270056.024703:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788270056.024712:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875136253116288:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788270056.024731:0:47281:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp t0 exp 0000000000000000 cur 847 last 0 00000020:00000080:0.0:1788270056.024757:0:47281:0:(genops.c:1385:class_connect()) connect: client bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49, cookie 0xc5f5d7a016e089e4 00002000:00100000:0.0:1788270056.024763:0:47281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49/ffff98c27b77c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788270056.024785:0:47281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788270056.024839:0:47284:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788270056.024873:0:47284:0:(import.c:65:import_set_state_nolock()) ffff98c27c171800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1788270056.024921:0:47281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788270056.024927:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2399:x1875136253116160:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 382us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270056.024936:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00080000:0.0:1788270056.024939:0:47281:0:(import.c:65:import_set_state_nolock()) ffff98c27b77e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788270056.024968:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2399:x1875136253116288:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 255us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270056.024975:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788270056.025127:0:45787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116416 00000100:00100000:2.0:1788270056.025131:0:45787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116416 00000100:00100000:2.0:1788270056.025167:0:45787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788270056.025174:0:45787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253116416:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788270056.025227:0:45787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253116416:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 52us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270056.025234:0:45787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:1.0:1788270056.027100:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270056.027423:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116544 00000100:00100000:2.0:1788270056.027432:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116544 00000100:00100000:2.0:1788270056.027480:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788270056.027490:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253116544:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788270056.030551:0:45779:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2988us 00000004:00200000:1.0:1788270056.036448:0:45779:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788270056.036577:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33905:x1875136253116544:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 9083us (9476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270056.036592:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788270056.133837:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270056.133894:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116672 00000100:00100000:3.0:1788270056.133904:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116672 00000100:00100000:3.0:1788270056.133969:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788270056.133988:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:33952:x1875136253116672:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:3.0:1788270056.134006:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270056.134029:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e089eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561017e1 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270056.134125:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e089f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270056.134138:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e089f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270056.134153:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e089f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270056.134199:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270056.134202:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270056.134245:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e089f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270056.134272:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e089eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017e1 expref: 8 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270056.134286:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e089f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017e1 expref: 7 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270056.134295:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270056.134298:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270056.134301:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f800, rc 0) 00000100:00100000:3.0:1788270056.134420:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:33952:x1875136253116672:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 441us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270056.134427:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00010000:00010000:0.0:1788270056.902627:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270057.541581:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788270057.668665:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262614144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270057.668741:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270057.668919:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614144 00000100:00100000:3.0:1788270057.668928:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614144 00000100:00100000:3.0:1788270057.668988:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788270057.668998:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262614144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270057.669029:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446363136 avail 1300123648 00000100:00100000:3.0:1788270057.669102:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262614144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270057.669109:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788270057.669190:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262614144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270057.769305:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270057.769742:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116800 00000100:00100000:0.0:1788270057.769754:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116800 00000100:00100000:0.0:1788270057.769869:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788270057.769881:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34004:x1875136253116800:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:0.0:1788270057.769921:0:45776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1788270057.770074:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34004:x1875136253116800:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 158us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270057.770083:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788270057.772111:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270057.772546:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253116928 00000100:00100000:1.0:1788270057.772556:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253116928 00000100:00100000:1.0:1788270057.772617:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788270057.772627:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34004:x1875136253116928:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:1.0:1788270057.772776:0:48110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270057.772867:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34004:x1875136253116928:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 240us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270057.772875:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788270057.775538:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270057.775620:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117056 00000100:00100000:3.0:1788270057.775630:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117056 00000100:00100000:3.0:1788270057.775716:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788270057.775726:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34004:x1875136253117056:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:3.0:1788270057.775758:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270057.775847:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34004:x1875136253117056:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 123us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270057.775855:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00080000:2.0:1788270057.776567:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270057.778114:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270057.778218:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117184 00000100:00100000:2.0:1788270057.778227:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117184 00000100:00100000:2.0:1788270057.778294:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788270057.778304:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34004:x1875136253117184:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:2.0:1788270057.778347:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788270057.778429:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34004:x1875136253117184:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 127us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270057.778438:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00080000:1.0:1788270057.778545:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788270057.925384:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270057.942654:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270057.942752:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117312 00000100:00100000:2.0:1788270057.942762:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117312 00000100:00100000:2.0:1788270057.942821:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:2.0:1788270057.942830:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+10:34034:x1875136253117312:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788270057.942844:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270057.942859:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e089f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561017e8 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270057.942880:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e089f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017e8 expref: 11 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270057.942887:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5c000/0xc5f5d7a016e089f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017e8 expref: 11 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270057.942894:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c000, rc 0) 00000100:00100000:2.0:1788270057.942956:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34034:x1875136253117312:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 126us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270057.942964:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:3.0:1788270057.965494:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270057.965964:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117440 00000100:00100000:2.0:1788270057.965975:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117440 00000100:00100000:2.0:1788270057.966120:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:2.0:1788270057.966133:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34034:x1875136253117440:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788270057.966325:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34034:x1875136253117440:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 194us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270057.966333:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:3.0:1788270057.969840:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270057.969996:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117568 00000100:00100000:1.0:1788270057.970007:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117568 00000100:00100000:1.0:1788270057.970092:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788270057.970104:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34034:x1875136253117568:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788270057.970260:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34034:x1875136253117568:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 157us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270057.970268:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788270057.974515:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270057.974583:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117696 00000100:00100000:2.0:1788270057.974593:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117696 00000100:00100000:2.0:1788270057.974651:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:2.0:1788270057.974660:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34043:x1875136253117696:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788270057.974821:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34043:x1875136253117696:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 161us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270057.974829:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788270057.988126:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270057.988376:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117824 00000100:00100000:1.0:1788270057.988387:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117824 00000100:00100000:1.0:1788270057.988450:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:1.0:1788270057.988461:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34043:x1875136253117824:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788270057.988614:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34043:x1875136253117824:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 155us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270057.988623:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:3.0:1788270057.990208:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270057.990293:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253117952 00000100:00100000:0.0:1788270057.990302:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253117952 00000100:00100000:0.0:1788270057.990366:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:0.0:1788270057.990377:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34043:x1875136253117952:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788270057.990514:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34043:x1875136253117952:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270057.990522:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:3.0:1788270057.993931:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270057.994375:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118080 00000100:00100000:1.0:1788270057.994385:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118080 00000100:00100000:1.0:1788270057.994444:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788270057.994455:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+11:34034:x1875136253118080:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788270057.994471:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270057.994491:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27c19ae00/0xc5f5d7a016e08a00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101819 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270057.994519:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27c19ae00/0xc5f5d7a016e08a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101819 expref: 12 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270057.994530:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27c19ae00/0xc5f5d7a016e08a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101819 expref: 12 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270057.994539:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ae00, rc 0) 00000100:00100000:1.0:1788270057.994594:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+12:34034:x1875136253118080:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 141us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270057.994601:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:3.0:1788270057.999951:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270058.000263:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118208 00000100:00100000:2.0:1788270058.000273:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118208 00000100:00100000:2.0:1788270058.000340:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:2.0:1788270058.000350:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+12:34034:x1875136253118208:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788270058.000376:0:45770:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788270058.000400:0:45770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788270058.000404:0:45770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788270058.000408:0:45770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788270058.000411:0:45770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788270058.000414:0:45770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 30 00000100:00100000:2.0:1788270058.006171:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+12:34034:x1875136253118208:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 5812us (6219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.006186:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788270058.009999:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270058.010066:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118336 00000100:00100000:1.0:1788270058.010077:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118336 00000100:00100000:1.0:1788270058.010407:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:1.0:1788270058.010416:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+12:34034:x1875136253118336:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788270058.010447:0:45768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270058.010466:0:45768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101820 expref: -99 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270058.010490:0:45768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 13 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270058.010498:0:45768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 13 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270058.010505:0:45768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a800, rc 0) 00000100:00100000:1.0:1788270058.010551:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34034:x1875136253118336:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 137us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.010558:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788270058.011629:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270058.012062:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118464 00000100:00100000:2.0:1788270058.012069:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118464 00000100:00100000:2.0:1788270058.012114:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:2.0:1788270058.012124:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34034:x1875136253118464:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788270058.012263:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34034:x1875136253118464:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 140us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.012271:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:3.0:1788270058.013322:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270058.013402:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118592 00000100:00100000:1.0:1788270058.013407:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118592 00000100:00100000:1.0:1788270058.013455:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:1.0:1788270058.013464:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34034:x1875136253118592:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788270058.013578:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34034:x1875136253118592:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.013585:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788270058.015072:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270058.015350:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118720 00000100:00100000:2.0:1788270058.015358:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118720 00000100:00100000:2.0:1788270058.015401:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:2.0:1788270058.015412:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34047:x1875136253118720:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788270058.015536:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34047:x1875136253118720:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 125us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.015545:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:3.0:1788270058.021561:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270058.021679:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118848 00000100:00100000:1.0:1788270058.021690:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118848 00000100:00100000:1.0:1788270058.021752:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:1.0:1788270058.021762:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34047:x1875136253118848:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788270058.022018:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:34047:x1875136253118848:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 256us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.022027:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788270058.027645:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270058.027731:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270058.028865:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253118976 00000100:00100000:1.0:1788270058.028878:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253118976 00000100:00100000:1.0:1788270058.029023:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119232 00000100:00100000:1.0:1788270058.029027:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119232 00000100:00100000:1.0:1788270058.029073:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788270058.029083:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875136253118976:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788270058.029112:0:46770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:1.0:1788270058.029151:0:46770:0:(genops.c:1385:class_connect()) connect: client 04ecb0d1-118e-4eab-bf07-e32490d1fd1f, cookie 0xc5f5d7a016e08a0e 00000004:00100000:1.0:1788270058.029177:0:46770:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788270058.029266:0:46770:0:(import.c:65:import_set_state_nolock()) ffff98c143613000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788270058.029349:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2399:x1875136253118976:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 265us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.029356:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788270058.029373:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788270058.029378:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875136253119232:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788270058.029394:0:46770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:1.0:1788270058.029418:0:46770:0:(genops.c:1385:class_connect()) connect: client 04ecb0d1-118e-4eab-bf07-e32490d1fd1f, cookie 0xc5f5d7a016e08a15 00000004:00100000:1.0:1788270058.029431:0:46770:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788270058.029476:0:46770:0:(import.c:65:import_set_state_nolock()) ffff98c27c81d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788270058.029499:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2399:x1875136253119232:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 119us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.029505:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788270058.031490:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270058.031526:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270058.031553:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270058.031634:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119104 00000100:00100000:0.0:1788270058.031642:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119104 00000100:00100000:0.0:1788270058.031698:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119360 00000100:00100000:0.0:1788270058.031701:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119360 00000100:00100000:0.0:1788270058.031719:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119488 00000100:00100000:0.0:1788270058.031721:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119488 00000100:00100000:0.0:1788270058.031734:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788270058.031743:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:0:x1875136253119104:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788270058.031768:0:45777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1788270058.031819:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:0:x1875136253119104:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.031826:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788270058.031840:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788270058.031846:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:0:x1875136253119360:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788270058.031856:0:45777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:0.0:1788270058.031881:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:0:x1875136253119360:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.031887:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788270058.031898:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788270058.031904:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253119488:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788270058.031912:0:45777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1788270058.031930:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253119488:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.031936:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00080000:3.0:1788270058.032291:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270058.032296:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270058.038011:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270058.038139:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119616 00000100:00100000:0.0:1788270058.038150:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119616 00000100:00100000:0.0:1788270058.038212:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788270058.038222:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253119616:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788270058.038320:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253119616:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.038328:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788270058.040437:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270058.040477:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270058.040513:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270058.040599:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119744 00000100:00100000:2.0:1788270058.040607:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119744 00000100:00100000:2.0:1788270058.040643:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253119872 00000100:00100000:2.0:1788270058.040647:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253119872 00000100:00100000:2.0:1788270058.040668:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788270058.040675:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875136253119744:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788270058.040705:0:47283:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:2.0:1788270058.040737:0:47283:0:(genops.c:1385:class_connect()) connect: client 04ecb0d1-118e-4eab-bf07-e32490d1fd1f, cookie 0xc5f5d7a016e08a1c 00002000:00100000:2.0:1788270058.040749:0:47283:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 04ecb0d1-118e-4eab-bf07-e32490d1fd1f/ffff98c14379c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788270058.040760:0:47283:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788270058.040823:0:47283:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788270058.040852:0:47283:0:(import.c:65:import_set_state_nolock()) ffff98c14379d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270058.040904:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2399:x1875136253119744:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.040915:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788270058.040931:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788270058.040936:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875136253119872:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788270058.040951:0:47283:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:2.0:1788270058.040969:0:47283:0:(genops.c:1385:class_connect()) connect: client 04ecb0d1-118e-4eab-bf07-e32490d1fd1f, cookie 0xc5f5d7a016e08a23 00002000:00100000:2.0:1788270058.040975:0:47283:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 04ecb0d1-118e-4eab-bf07-e32490d1fd1f/ffff98c2491eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788270058.040981:0:47283:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788270058.041019:0:47283:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788270058.041033:0:47283:0:(import.c:65:import_set_state_nolock()) ffff98c2491ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788270058.041083:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2399:x1875136253119872:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 145us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.041090:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788270058.041683:0:45787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120000 00000100:00100000:1.0:1788270058.041690:0:45787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120000 00000100:00100000:1.0:1788270058.041733:0:45787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788270058.041741:0:45787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253120000:12345-192.168.201.42@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788270058.041779:0:45787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253120000:12345-192.168.201.42@tcp:900:mount.lustre.0 Request processed in 39us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.041787:0:45787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788270058.043553:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270058.043930:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120128 00000100:00100000:2.0:1788270058.043938:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120128 00000100:00100000:2.0:1788270058.043978:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788270058.043985:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253120128:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788270058.044075:0:45780:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788270058.044137:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34034:x1875136253120128:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 152us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.044143:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000001:00100000:1.0:1788270058.056754:0:48095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000001:00100000:1.0:1788270058.056773:0:48095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49 00000001:00080000:1.0:1788270058.056784:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771074 is committed 00000100:00100000:3.0:1788270058.151226:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270058.151362:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120256 00000100:00100000:0.0:1788270058.151374:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120256 00000100:00100000:0.0:1788270058.151443:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788270058.151455:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34070:x1875136253120256:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:0.0:1788270058.151477:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270058.151501:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101851 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270058.151574:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270058.151588:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270058.151601:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270058.151650:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270058.151655:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270058.151697:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270058.151724:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 8 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270058.151742:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 7 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270058.151751:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270058.151753:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270058.151757:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193400, rc 0) 00000100:00100000:0.0:1788270058.151824:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:34070:x1875136253120256:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 371us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.151831:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788270058.180456:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262614272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270058.180493:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262614400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270058.180526:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270058.180548:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270058.180580:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614272 00000100:00100000:2.0:1788270058.180581:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614400 00000100:00100000:3.0:1788270058.180587:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614272 00000100:00100000:2.0:1788270058.180587:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614400 00000100:00100000:2.0:1788270058.180635:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788270058.180644:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262614400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270058.180665:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788270058.180705:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262614400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.180712:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788270058.180817:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262614528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.180848:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.180873:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262615040:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.180898:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.180912:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262615552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.180937:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.180968:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788270058.180975:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262614656:0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.180994:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615552 00000100:00100000:2.0:1788270058.180996:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270058.180998:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615552 00000100:00100000:2.0:1788270058.181012:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262615168:0@lo:400:kworker.0 00000100:00100000:1.0:1788270058.181080:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615040 00000100:00100000:1.0:1788270058.181084:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615040 00000100:00100000:2.0:1788270058.181147:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181164:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262615680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181185:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181210:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262614784:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181233:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181249:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262615296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181268:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181284:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262615808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270058.181305:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181331:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788270058.181337:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262614912:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181359:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181374:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262615424:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181450:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270058.181474:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614784 00000100:00100000:2.0:1788270058.181478:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614784 00000100:00100000:2.0:1788270058.181507:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788270058.181514:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262614784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181569:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262614784:12345-0@lo:400:kworker.0 Request processed in 55us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.181575:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788270058.181607:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262614784:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.181628:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614912 00000100:00100000:2.0:1788270058.181630:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614912 00000100:00100000:3.0:1788270058.181935:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615808 00000100:00100000:3.0:1788270058.181945:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615808 00000100:00100000:3.0:1788270058.181961:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788270058.181968:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262614272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270058.181979:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270058.182014:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262614272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270058.182020:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788270058.182031:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788270058.182036:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262615808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270058.182076:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614656 00002000:00000024:3.0:1788270058.182079:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1788270058.182082:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614656 00000100:00100000:0.0:1788270058.182104:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615168 00000100:00100000:0.0:1788270058.182107:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615168 00000100:00100000:3.0:1788270058.182109:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262615808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270058.182114:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788270058.182123:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615680 00000100:00100000:0.0:1788270058.182126:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615680 00000100:00100000:0.0:1788270058.182140:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615296 00000100:00100000:0.0:1788270058.182142:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615296 00000100:00080000:3.0:1788270058.182151:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270058.182155:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615424 00000100:00080000:3.0:1788270058.182156:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270058.182160:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270058.182160:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615424 00000100:00080000:3.0:1788270058.182165:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270058.182182:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771074 gen 2 00000100:00100000:3.0:1788270058.182195:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262614400:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788270058.182205:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270058.182215:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262615808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270058.182223:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262614272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270058.182239:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788270058.182261:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788270058.182269:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262614656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.182321:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262614656:12345-0@lo:400:kworker.0 Request processed in 53us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.182330:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788270058.182344:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270058.182350:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262615168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.182378:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262615168:12345-0@lo:400:kworker.0 Request processed in 28us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.182383:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270058.182394:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788270058.182399:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270058.182440:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262615552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270058.182525:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262615552:12345-0@lo:400:kworker.0 Request processed in 280us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.182527:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262615680:12345-0@lo:400:kworker.0 Request processed in 124us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270058.182533:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788270058.182540:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788270058.182549:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788270058.182555:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262615296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.182561:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788270058.182571:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262615424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270058.182581:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262615296:12345-0@lo:400:kworker.0 Request processed in 26us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270058.182585:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788270058.182612:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262615424:12345-0@lo:400:kworker.0 Request processed in 42us (1160us total) trans 0 rc 0/0 00010000:00080000:3.0:1788270058.182613:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c276266d80 x1875136262615424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270058.182629:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788270058.182631:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262615424:0@lo:400:kworker.0 00000100:00100000:3.0:1788270058.182646:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262615296:0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.182675:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262614656:0@lo:400:kworker.0 00000100:00100000:3.0:1788270058.182716:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262614528 00000100:00100000:3.0:1788270058.182721:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262614528 00000100:00100000:3.0:1788270058.182748:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788270058.182757:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262614528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.182757:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262615168:0@lo:400:kworker.0 00010000:00080000:0.0:1788270058.182779:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c276265880 x1875136262615680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270058.182791:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262614528:12345-0@lo:400:kworker.0 Request processed in 36us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270058.182792:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262615680:0@lo:400:kworker.0 00000100:00100000:3.0:1788270058.182802:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788270058.182810:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262614528:0@lo:400:kworker.0 00000100:00100000:0.0:1788270058.182827:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262615552:0@lo:400:kworker.0 00000100:00100000:1.0:1788270058.183453:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788270058.183463:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262615040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270058.183524:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262615040:12345-0@lo:400:kworker.0 Request processed in 63us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270058.183531:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788270058.183543:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262615040:0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.184132:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788270058.184142:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262614912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270058.184206:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262614912:12345-0@lo:400:kworker.0 Request processed in 66us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270058.184213:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788270058.184331:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262614912:0@lo:400:kworker.0 00010000:00010000:1.0:1788270058.948906:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270059.141826:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788270059.207076:0:47278:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000001:00100000:3.0:1788270059.207090:0:47278:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49 00000001:02000400:2.0:1788270059.901699:0:48654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788270059.972199:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270060.229578:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270060.229602:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262615936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270060.229685:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270060.232074:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262615936 00000100:00100000:3.0:1788270060.232089:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262615936 00000100:00100000:3.0:1788270060.232164:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788270060.232178:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262615936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270060.232212:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270060.232299:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262615936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270060.232306:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270060.232413:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262615936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270060.232490:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270060.741799:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270060.741828:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262616064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270060.741904:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270060.741980:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262616064 00000100:00100000:1.0:1788270060.741989:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262616064 00000100:00100000:1.0:1788270060.742063:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788270060.742074:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262616064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270060.742109:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446203392 avail 1299963904 00000100:00100000:1.0:1788270060.742160:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262616064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270060.742167:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788270060.742336:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262616064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270061.001471:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270062.022274:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788270062.026648:0:48802:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3aa0f260 20000000:00000080:0.0:1788270062.026672:0:48802:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c27c127000 uarg=0000000000000000 20000000:01000000:0.0:1788270062.026726:0:48802:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788270062.026735:0:48802:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788270062.026741:0:48802:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788270062.027493:0:48803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788270062.027697:0:48802:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788270062.035148:0:48802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788270062.035182:0:48802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035205:0:48802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 23 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035215:0:48802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 23 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035222:0:48802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 23 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035229:0:48802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035304:0:48802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035319:0:48802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 12 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035327:0:48802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035384:0:48802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 12 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035404:0:48802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 12 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.035422:0:48802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616192:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270062.035561:0:48802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035572:0:48802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.035582:0:48802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616320:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270062.035622:0:48802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035632:0:48802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 23 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.035644:0:48802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616448:0@lo:104: 00000100:00100000:0.0:1788270062.035696:0:48802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270062.035982:0:48802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 23 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.035992:0:48802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 23 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.036000:0:48802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616576:0@lo:104: 00000100:00100000:0.0:1788270062.036022:0:48802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270062.036401:0:48802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 23 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.036411:0:48802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 23 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.036420:0:48802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616704:0@lo:104: 00000100:00100000:0.0:1788270062.036448:0:48802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270062.036533:0:48802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 23 pid: 45768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.036542:0:48802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 23 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.036551:0:48802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616832:0@lo:104: 00000100:00100000:0.0:1788270062.036574:0:48802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270062.036892:0:48113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262616448 00000100:00100000:2.0:1788270062.036893:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262616576 00000100:00100000:2.0:1788270062.036904:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262616576 00000100:00100000:1.0:1788270062.036904:0:48113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262616448 00000100:00100000:1.0:1788270062.036964:0:48113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262616704 00000100:00100000:1.0:1788270062.036968:0:48113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262616704 00000100:00100000:2.0:1788270062.036970:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788270062.036986:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+5:48802:x1875136262616448:12345-0@lo:104: 00000100:00100000:1.0:1788270062.036993:0:48113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788270062.037005:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270062.037005:0:48113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5051c9b2-4d56-4172-904c-6f13b6100451+5:48802:x1875136262616576:12345-0@lo:104: 00010000:00010000:1.0:1788270062.037016:0:48113:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037098:0:48113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788270062.037105:0:48113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5051c9b2-4d56-4172-904c-6f13b6100451+5:48802:x1875136262616576:12345-0@lo:104: Request processed in 104us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270062.037112:0:48113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788270062.037133:0:48113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270062.037140:0:48113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5051c9b2-4d56-4172-904c-6f13b6100451+4:48802:x1875136262616704:12345-0@lo:104: 00010000:00010000:1.0:1788270062.037147:0:48113:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037181:0:48113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788270062.037186:0:48113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5051c9b2-4d56-4172-904c-6f13b6100451+4:48802:x1875136262616704:12345-0@lo:104: Request processed in 47us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270062.037192:0:48113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788270062.037212:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788270062.037218:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037231:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788270062.037236:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037257:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788270062.037264:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788270062.037270:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788270062.037305:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037312:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788270062.037336:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037344:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef200/0xc5f5d7a016e08537 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0853e expref: -99 pid: 47277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037359:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270062.037362:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037368:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c24a9ef600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788270062.037371:0:45765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.037379:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788270062.037382:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270062.037384:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262616960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788270062.037391:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5051c9b2-4d56-4172-904c-6f13b6100451+3:48802:x1875136262616448:12345-0@lo:104: Request processed in 407us (1693us total) trans 0 rc 0/0 10000000:00010000:1.0:1788270062.037393:0:45765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788270062.037406:0:45765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788270062.037407:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788270062.037423:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788270062.037423:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037429:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788270062.037442:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270062.037446:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.037450:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037457:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c24a9ef600/0xc5f5d7a016e084f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084ff expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.037461:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270062.037464:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788270062.037471:0:47309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037471:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270062.037473:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262616960 00010000:00010000:1.0:1788270062.037474:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270062.037477:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270062.037478:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262616960 00010000:00010000:2.0:1788270062.037487:0:47309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788270062.037495:0:47309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.037500:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 24 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270062.037500:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262617088:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788270062.037504:0:47309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788270062.037531:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788270062.037537:0:47309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.037550:0:47309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788270062.037558:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788270062.037560:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270062.037568:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262617216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270062.037570:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c143b9ee00/0xc5f5d7a016e086a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e086aa expref: -99 pid: 48094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.037584:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270062.037586:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270062.037588:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270062.037609:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270062.037649:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262617088 00000100:00100000:1.0:1788270062.037654:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262617088 00010000:00010000:1.0:1788270062.037667:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 25 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270062.037694:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262617216 00000100:00100000:1.0:1788270062.037697:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262617216 00010000:00010000:1.0:1788270062.037710:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 26 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270062.037711:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788270062.037718:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5051c9b2-4d56-4172-904c-6f13b6100451+26:3607:x1875136262617088:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788270062.037721:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788270062.037726:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5051c9b2-4d56-4172-904c-6f13b6100451+26:3610:x1875136262616960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270062.037731:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270062.037732:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270062.037737:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 26 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.037738:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 26 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.037749:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 26 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270062.037868:0:45761:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1788270062.037870:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 26 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270062.037880:0:45761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1788270062.037893:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270062.037928:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5051c9b2-4d56-4172-904c-6f13b6100451+26:3610:x1875136262616960:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270062.037936:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788270062.037954:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270062.037961:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5051c9b2-4d56-4172-904c-6f13b6100451+25:3607:x1875136262617216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788270062.037969:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270062.037974:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 25 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037983:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 25 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.037993:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270062.038028:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5051c9b2-4d56-4172-904c-6f13b6100451+25:3607:x1875136262617216:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270062.038035:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788270062.038102:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262616960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270062.038130:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270062.038133:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262617216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270062.038167:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262617088:12345-0@lo:103:ldlm_bl.0 Request processed in 449us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.038174:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788270062.038352:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262617088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788270062.038681:0:48802:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:0.0:1788270062.038698:0:48802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616192:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270062.038710:0:48802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c144192000/0xc5f5d7a016e086aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e086a3 expref: 23 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.038720:0:48802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616448:0@lo:104: 00010000:00010000:0.0:1788270062.038729:0:48802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c144193200/0xc5f5d7a016e0853e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e08537 expref: 22 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.038740:0:48802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616576:0@lo:104: 00010000:00010000:0.0:1788270062.038747:0:48802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1410f1c00/0xc5f5d7a016e084ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e084f8 expref: 21 pid: 45771 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.038754:0:48802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616704:0@lo:104: 00000100:00100000:1.0:1788270062.038801:0:48113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262616832 00000100:00100000:1.0:1788270062.038807:0:48113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262616832 00000100:00100000:1.0:1788270062.038848:0:48113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788270062.038856:0:48113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5051c9b2-4d56-4172-904c-6f13b6100451+3:48802:x1875136262616832:12345-0@lo:104: 00010000:00010000:1.0:1788270062.038869:0:48113:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.038921:0:48113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788270062.038927:0:48113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5051c9b2-4d56-4172-904c-6f13b6100451+3:48802:x1875136262616832:12345-0@lo:104: Request processed in 72us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.038931:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270062.038933:0:48113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788270062.038949:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788270062.038951:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120384 00010000:00010000:1.0:1788270062.038953:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270062.038954:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120384 00010000:00010000:1.0:1788270062.038961:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788270062.038964:0:45764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.038972:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 13 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.038972:0:45764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788270062.038985:0:45764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270062.038992:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 10000000:01000000:1.0:1788270062.038992:0:45764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788270062.038998:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253120384:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270062.039006:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270062.039011:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 13 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.039016:0:45764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.039022:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 13 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.039022:0:45764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788270062.039057:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.039061:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c27c19a800/0xc5f5d7a016e08a07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101820 expref: 13 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.039066:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff98c240030000/0xc5f5d7a016e084ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e084f1 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.039073:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270062.039081:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270062.039082:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270062.039083:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270062.039105:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262617344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270062.039111:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa52f0bf-08b6-495d-a5ae-358be8153494+12:2400:x1875136253120384:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 114us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.039118:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788270062.039137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270062.039210:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262617344 00000100:00100000:3.0:1788270062.039215:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262617344 00010000:00010000:3.0:1788270062.039229:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 21 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270062.039260:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788270062.039267:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+21:3609:x1875136262617344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270062.039275:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270062.039279:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 21 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.039287:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 21 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.039298:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270062.039330:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5051c9b2-4d56-4172-904c-6f13b6100451+21:3609:x1875136262617344:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.039337:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788270062.039342:0:48802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1410f0400/0xc5f5d7a016e084f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e084ea expref: 21 pid: 45768 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.039351:0:48802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616832:0@lo:104: 00000100:00100000:1.0:1788270062.039659:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262617344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788270062.039939:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.039959:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120512 00000100:00100000:3.0:1788270062.039963:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120512 00010000:00010000:3.0:1788270062.039981:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.039992:0:48802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:48802:1875136262616320:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270062.040008:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788270062.040014:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa52f0bf-08b6-495d-a5ae-358be8153494+12:2401:x1875136253120512:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270062.040022:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270062.040026:0:48802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040027:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040208:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040217:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26ab5d800/0xc5f5d7a016e089c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017b0 expref: 12 pid: 45770 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040226:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040232:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040260:0:45762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040267:0:45762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040275:0:45762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040288:0:45762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040295:0:45762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270062.040300:0:45762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040306:0:45762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040320:0:45762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.040329:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270062.040338:0:48802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.040345:0:48802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.040351:0:48802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c144192400/0xc5f5d7a016e08a38 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 48802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270062.040371:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:2401:x1875136253120512:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 357us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.040378:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000001:00100000:3.0:1788270062.277883:0:46509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000001:00100000:3.0:1788270062.277900:0:46509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49 00000001:00100000:2.0:1788270062.278430:0:45756:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000001:00100000:2.0:1788270062.278438:0:45756:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49 00000100:00100000:1.0:1788270062.746274:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.746515:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120640 00000100:00100000:3.0:1788270062.746530:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120640 00000100:00100000:3.0:1788270062.746713:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788270062.746726:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34531:x1875136253120640:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270062.746753:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.746779:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101858 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.746866:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.746883:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.746899:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.746915:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.746923:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.746929:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747026:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e08a54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747034:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e08a54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747077:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e08a54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270062.747115:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270062.747119:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270062.747173:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e08a54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747190:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747197:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747203:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747209:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.747213:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747221:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747244:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270062.747247:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.747251:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747258:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08a46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747274:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747280:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747285:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747292:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.747295:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747301:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747309:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98c1429f8900) 00010000:00010000:3.0:1788270062.747311:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.747314:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747319:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747364:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101858 expref: 8 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747379:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e08a54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101858 expref: 7 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.747387:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c1429f8e00) 00010000:00010000:3.0:1788270062.747389:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270062.747391:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fa00, rc 0) 00000100:00100000:3.0:1788270062.747477:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34531:x1875136253120640:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 753us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.747484:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00080000:0.0:1788270062.747864:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270062.751216:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.751482:0:45787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253120768 00000100:00100000:2.0:1788270062.751496:0:45787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253120768 00000100:00100000:2.0:1788270062.751596:0:45787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788270062.751608:0:45787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34531:x1875136253120768:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788270062.751716:0:45787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34531:x1875136253120768:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 Request processed in 109us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270062.751724:0:45787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788270062.757033:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.757188:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121024 00000100:00100000:0.0:1788270062.757202:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121024 00000100:00100000:0.0:1788270062.757288:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788270062.757300:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34531:x1875136253121024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270062.757329:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270062.757367:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610185f expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757454:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757467:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757476:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757487:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757491:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757496:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757603:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e08a70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757608:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e08a70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757611:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e08a70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270062.757619:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788270062.757709:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757714:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757719:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757723:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.757727:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757732:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757742:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c1429f8e00) 00010000:00010000:0.0:1788270062.757745:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.757751:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757756:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757773:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757779:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757786:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757796:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.757799:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757803:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757809:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c2515e9c00) 00010000:00010000:0.0:1788270062.757810:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.757812:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.757816:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08a69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.760960:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610185f expref: 10 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.760991:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e08a70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610185f expref: 9 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.761001:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:0.0:1788270062.761005:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.761009:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192a00, rc 0) 00000100:00100000:0.0:1788270062.761154:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:34531:x1875136253121024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3856us (4132us total) trans 30064771077 rc 0/0 00000100:00100000:0.0:1788270062.761161:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788270062.769557:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.770913:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121152 00000100:00100000:0.0:1788270062.770930:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121152 00000100:00100000:0.0:1788270062.771007:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788270062.771020:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:34531:x1875136253121152:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788270062.771160:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:34531:x1875136253121152:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 143us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270062.771167:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788270062.775770:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.775875:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121280 00000100:00100000:3.0:1788270062.775887:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121280 00000100:00100000:3.0:1788270062.775964:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788270062.775975:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:34531:x1875136253121280:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788270062.776129:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788270062.776967:0:45776:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 939us 00000100:00100000:3.0:1788270062.790977:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:34531:x1875136253121280:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 14989us (15206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.790995:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788270062.792775:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262617472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270062.792861:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270062.793434:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262617472 00000100:00100000:1.0:1788270062.793445:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262617472 00000100:00100000:1.0:1788270062.793504:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788270062.793514:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262617472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270062.793558:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270062.793629:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262617472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270062.793637:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788270062.793713:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262617472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270062.803278:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.803654:0:45785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121408 00000100:00100000:0.0:1788270062.803668:0:45785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121408 00000100:00100000:0.0:1788270062.803780:0:45785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788270062.803792:0:45785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:34540:x1875136253121408:12345-192.168.201.42@tcp:700:mkdir.0 00000100:00100000:0.0:1788270062.803907:0:45785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:34540:x1875136253121408:12345-192.168.201.42@tcp:700:mkdir.0 Request processed in 116us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270062.803915:0:45785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788270062.805568:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.805787:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121664 00000100:00100000:3.0:1788270062.805798:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121664 00000100:00100000:0.0:1788270062.805977:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788270062.805987:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:34540:x1875136253121664:12345-192.168.201.42@tcp:36:mkdir.0 00010000:00010000:0.0:1788270062.806079:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270062.806112:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e089f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561017e1 expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.806133:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270062.806138:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270062.806215:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.806244:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.806255:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.806298:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.806315:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 5 pid: 48110 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270062.806332:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262617600:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270062.806601:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270062.808629:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262617600:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270062.808678:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270062.808793:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.808901:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121792 00000100:00100000:2.0:1788270062.808910:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121792 00010000:00010000:2.0:1788270062.808973:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 6 pid: 48110 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270062.809010:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788270062.809021:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253121792:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270062.809084:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270062.809093:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 6 pid: 48110 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.809107:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 6 pid: 48110 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.809132:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08a31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101851 expref: 6 pid: 48110 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.809156:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270062.809161:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.809171:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.809179:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.809209:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270062.809259:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.809278:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270062.809288:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253121792:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 263us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270062.809299:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:3.0:1788270062.809311:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.809322:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.809330:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788270062.809492:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788270062.811016:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811031:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811078:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270062.811098:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6197d4f reply state 0000000037363254 transno 30064771078 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811110:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811118:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.811122:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270062.811126:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788270062.811134:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788270062.811143:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811151:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811158:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811165:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.811170:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811178:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811188:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270062.811190:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.811193:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811198:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08a7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270062.811213:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6197d4f reply state 0000000037363254 transno 30064771078 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811218:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.811222:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:3.0:1788270062.811224:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270062.811225:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788270062.811503:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:34540:x1875136253121664:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 5515us (5941us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1788270062.811511:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788270062.823015:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.823122:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253121920 00000100:00100000:0.0:1788270062.823133:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253121920 00000100:00100000:0.0:1788270062.823193:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788270062.823202:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:34541:x1875136253121920:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270062.823238:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270062.823273:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101866 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.823488:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e08a9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.823510:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e08a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.823531:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e08a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270062.823587:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270062.823592:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270062.823615:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e08a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.823654:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101866 expref: 12 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.823679:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e08a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101866 expref: 11 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.823689:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:0.0:1788270062.823692:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270062.823696:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192e00, rc 0) 00000100:00100000:0.0:1788270062.823772:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:34541:x1875136253121920:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 570us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270062.823779:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788270062.826325:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.826773:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253122048 00000100:00100000:3.0:1788270062.826786:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253122048 00000100:00100000:3.0:1788270062.826853:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788270062.826863:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:34541:x1875136253122048:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270062.826887:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.826910:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610186d expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.826985:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.826999:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.827011:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.827025:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.827032:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.827072:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827335:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ab6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827346:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827354:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270062.827408:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270062.827412:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270062.827436:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827449:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827457:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827465:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827472:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.827477:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827485:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827498:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:2.0:1788270062.827514:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.827623:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827633:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e600/0xc5f5d7a016e08aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827649:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827656:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827663:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827667:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.827671:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827677:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827685:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:2.0:1788270062.827689:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.827692:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827703:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08aaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827733:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610186d expref: 13 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827748:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ab6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610186d expref: 12 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.827756:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.827759:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270062.827762:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:2.0:1788270062.827847:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:34541:x1875136253122048:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 985us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270062.827854:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788270062.831668:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270062.831820:0:45788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253122176 00000100:00100000:1.0:1788270062.831831:0:45788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253122176 00000100:00100000:1.0:1788270062.831887:0:45788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788270062.831894:0:45788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:34541:x1875136253122176:12345-192.168.201.42@tcp:900:lfs.0 00000100:00100000:1.0:1788270062.831976:0:45788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:34541:x1875136253122176:12345-192.168.201.42@tcp:900:lfs.0 Request processed in 81us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270062.831985:0:45788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788270062.836432:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.836760:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253122432 00000100:00100000:2.0:1788270062.836773:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253122432 00000100:00100000:2.0:1788270062.836872:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:2.0:1788270062.836882:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:34541:x1875136253122432:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270062.836907:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270062.836931:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101874 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270062.837083:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788270062.837205:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08abd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101874 expref: 14 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.837224:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:2.0:1788270062.837238:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270062.837244:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101874 expref: 14 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.837261:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270062.837334:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34541:x1875136253122432:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 452us (917us total) trans 30064771079 rc 301/301 00000100:00100000:2.0:1788270062.837343:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788270062.839189:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.839247:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253122688 00000100:00100000:3.0:1788270062.839259:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253122688 00000100:00100000:3.0:1788270062.839317:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788270062.839326:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34541:x1875136253122688:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:3.0:1788270062.839387:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270062.839419:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ab6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610186d expref: 13 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.839440:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.839445:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270062.839468:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.839480:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.839488:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270062.841991:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000603cb72c reply state 000000003aa39c1a transno 30064771080 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.842026:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.842132:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.842137:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788270062.842143:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788270062.842154:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788270062.842292:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34541:x1875136253122688:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 2962us (3106us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788270062.842301:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788270062.846553:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.846612:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253122944 00000100:00100000:2.0:1788270062.846625:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253122944 00000100:00100000:2.0:1788270062.846703:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:2.0:1788270062.846715:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34541:x1875136253122944:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788270062.847008:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34541:x1875136253122944:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 296us (470us total) trans 30064771081 rc 0/0 00000100:00100000:2.0:1788270062.847014:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788270062.849174:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.849291:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253123200 00000100:00100000:2.0:1788270062.849300:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253123200 00000100:00100000:2.0:1788270062.849407:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:2.0:1788270062.849418:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34541:x1875136253123200:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270062.849444:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270062.849467:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08ad2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610187b expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849572:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849590:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849603:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849617:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849625:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849633:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270062.849759:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788270062.849832:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849837:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849842:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849846:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.849850:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849855:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849869:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:2.0:1788270062.849871:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.849874:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849879:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08ad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849889:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849892:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849896:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849900:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.849901:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849904:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849908:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:2.0:1788270062.849909:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.849911:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849914:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08ae0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849943:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08ad2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610187b expref: 17 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849952:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:2.0:1788270062.849953:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270062.849955:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08ad2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610187b expref: 17 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.849961:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270062.850021:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:34541:x1875136253123200:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 605us (853us total) trans 30064771082 rc 301/301 00000100:00100000:2.0:1788270062.850028:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788270062.852424:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.852696:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253123328 00000100:00100000:2.0:1788270062.852706:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253123328 00000100:00100000:2.0:1788270062.852764:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788270062.852771:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:34541:x1875136253123328:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270062.852794:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270062.852813:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08aee lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101882 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.852905:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08af5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.852918:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08af5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.852928:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08af5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270062.852949:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270062.852952:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270062.852968:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08af5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.852990:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08aee lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101882 expref: 18 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.853005:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08af5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101882 expref: 17 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.853012:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.853015:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270062.853018:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c200, rc 0) 00000100:00100000:2.0:1788270062.853107:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34541:x1875136253123328:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 335us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270062.853113:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:0.0:1788270062.857732:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.859308:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253123456 00000100:00100000:2.0:1788270062.859324:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253123456 00000100:00100000:2.0:1788270062.859527:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788270062.859541:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34541:x1875136253123456:12345-192.168.201.42@tcp:37:lfs.0 00000100:00100000:2.0:1788270062.864818:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34541:x1875136253123456:12345-192.168.201.42@tcp:37:lfs.0 Request processed in 4679us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270062.864836:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:1.0:1788270062.867556:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.867735:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253123712 00000100:00100000:0.0:1788270062.867748:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253123712 00000100:00100000:0.0:1788270062.867851:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788270062.867864:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144b19050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34541:x1875136253123712:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270062.868167:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144b19050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:34541:x1875136253123712:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 306us (623us total) trans 30064771083 rc 0/0 00000100:00100000:0.0:1788270062.868175:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788270062.884919:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.885031:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253123840 00000100:00100000:3.0:1788270062.885108:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253123840 00000100:00100000:3.0:1788270062.885204:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788270062.885215:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:34542:x1875136253123840:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270062.885260:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.885284:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08afc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101889 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885366:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885379:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885389:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885397:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885404:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885408:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885488:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b11 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885494:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b11 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885497:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b11 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270062.885542:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270062.885547:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270062.885596:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b11 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885607:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885612:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885617:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885621:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.885624:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885630:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885650:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:3.0:1788270062.885652:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.885656:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885660:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885670:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885674:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885678:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885681:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.885682:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885685:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885689:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:3.0:1788270062.885690:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.885692:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885698:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885718:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08afc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101889 expref: 20 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885728:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b11 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101889 expref: 19 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.885733:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.885734:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788270062.885736:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f000, rc 0) 00000100:00100000:3.0:1788270062.885804:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34542:x1875136253123840:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 591us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.885808:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788270062.888844:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270062.888898:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.889183:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253124096 00000100:00100000:2.0:1788270062.889195:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253124096 00000100:00100000:2.0:1788270062.889312:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788270062.889324:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34542:x1875136253124096:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270062.889366:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270062.889370:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270062.889404:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08af5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101882 expref: 19 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889427:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.889431:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270062.889447:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08b18 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101890 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889570:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889598:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889608:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889624:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889632:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.889647:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890249:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08b2d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890261:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08b2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890269:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08b2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270062.890279:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788270062.890310:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890317:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890324:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890330:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.890335:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890343:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890351:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.890354:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.890358:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890365:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b1f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270062.890374:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d5197d0 reply state 00000000f6238db7 transno 30064771084 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890386:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890392:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff98c1429fe100) 00010000:00010000:2.0:1788270062.890394:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270062.890397:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270062.890427:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08b18 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101890 expref: 21 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890440:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08b2d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101890 expref: 20 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.890447:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff98c1429fea00) 00010000:00010000:2.0:1788270062.890449:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788270062.890451:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5de00, rc 0) 00000100:00100000:2.0:1788270062.890526:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253124096:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1204us (1692us total) trans 30064771084 rc 0/0 00000100:00100000:2.0:1788270062.890534:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788270062.890933:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253124224 00000100:00100000:3.0:1788270062.890941:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253124224 00000100:00100000:3.0:1788270062.890990:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788270062.891000:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253124224:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270062.891013:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270062.891028:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b11 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101889 expref: 21 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.891064:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.891069:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270062.891094:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253124224:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 96us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.891102:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788270062.903757:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.903882:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253124480 00000100:00100000:2.0:1788270062.903896:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253124480 00000100:00100000:2.0:1788270062.903967:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788270062.903978:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34542:x1875136253124480:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788270062.905075:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253124480:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 1062us (1296us total) trans 30064771085 rc 0/0 00000100:00100000:2.0:1788270062.905088:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788270062.908959:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.909120:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253124608 00000100:00100000:0.0:1788270062.909136:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253124608 00000100:00100000:0.0:1788270062.909266:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788270062.909279:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253124608:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270062.909312:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270062.909353:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101897 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909444:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909462:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909479:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909492:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909501:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909508:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909645:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08b50 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909655:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08b50 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909661:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08b50 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270062.909703:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270062.909707:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270062.909732:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08b50 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909746:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909754:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909761:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909767:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.909772:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909781:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909795:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:0.0:1788270062.909798:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.909804:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909810:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08b42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909826:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909833:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909839:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909844:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.909847:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909852:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909858:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:0.0:1788270062.909860:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.909862:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909869:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909891:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101897 expref: 23 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909900:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08b50 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101897 expref: 22 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.909905:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270062.909907:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788270062.909909:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193400, rc 0) 00000100:00100000:0.0:1788270062.909980:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253124608:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 704us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270062.909985:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:1.0:1788270062.912188:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.912293:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253124736 00000100:00100000:2.0:1788270062.912307:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253124736 00000100:00100000:2.0:1788270062.912391:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:2.0:1788270062.912402:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253124736:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270062.912436:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270062.912460:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b57 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610189e expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912540:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912555:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912568:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912586:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912593:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912601:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912658:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912665:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912673:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912680:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.912686:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912694:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912708:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.912711:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.912717:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912723:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08b5e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912737:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912744:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912750:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912755:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.912757:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912764:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912775:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff98c1429fe800) 00010000:00010000:2.0:1788270062.912778:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.912781:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912788:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08b65 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912823:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b57 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610189e expref: 23 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912833:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.912836:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.912840:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08b57 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610189e expref: 23 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.912851:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270062.912917:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253124736:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 518us (740us total) trans 0 rc 301/301 00000100:00100000:2.0:1788270062.912925:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:2.0:1788270062.916691:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.916848:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253124992 00000100:00100000:3.0:1788270062.916861:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253124992 00000100:00100000:3.0:1788270062.916987:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788270062.917000:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253124992:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270062.917026:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.917095:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b6c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018a5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917244:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917263:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917277:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917294:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917301:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917308:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917929:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b81 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917946:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.917955:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270062.917968:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3:0x0]: returning size 0 00010000:00010000:3.0:1788270062.917996:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918005:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918012:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918019:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.918024:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918032:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918075:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.918079:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.918084:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918091:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08b73 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270062.918105:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090672243 reply state 00000000151d6e2c transno 30064771086 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918118:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918125:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff98c1429f8400) 00010000:00010000:3.0:1788270062.918128:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270062.918131:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270062.918165:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08b6c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018a5 expref: 25 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918180:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b81 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018a5 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.918189:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff98c1429f8b00) 00010000:00010000:3.0:1788270062.918192:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788270062.918195:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f600, rc 0) 00000100:00100000:3.0:1788270062.918289:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253124992:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1291us (1613us total) trans 30064771086 rc 0/0 00000100:00100000:3.0:1788270062.918299:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788270062.922892:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.922976:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253125248 00000100:00100000:0.0:1788270062.922988:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253125248 00000100:00100000:0.0:1788270062.923100:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:0.0:1788270062.923114:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253125248:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788270062.923522:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.923546:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.923561:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270062.923624:0:46770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771087 00000004:00010000:0.0:1788270062.923658:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038f466b7 reply state 0000000087c2bdfc transno 30064771088 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.923673:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.923682:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff98c1429f8b00) 00010000:00010000:0.0:1788270062.923686:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270062.923691:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270062.923825:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253125248:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 713us (944us total) trans 30064771088 rc 0/0 00000100:00100000:0.0:1788270062.923833:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000020:00080000:0.0:1788270062.923839:0:46770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788270062.930189:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270062.930297:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253125504 00000100:00100000:1.0:1788270062.930309:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253125504 00000100:00100000:1.0:1788270062.930546:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788270062.930559:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253125504:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788270062.930942:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34542:x1875136253125504:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 385us (764us total) trans 30064771089 rc 0/0 00000100:00100000:1.0:1788270062.930954:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788270062.935372:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.935502:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253125760 00000100:00100000:0.0:1788270062.935514:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253125760 00000100:00100000:0.0:1788270062.935602:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788270062.935614:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34542:x1875136253125760:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788270062.935699:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270062.935738:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08b81 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018a5 expref: 29 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935763:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff98c1429f8b00) 00010000:00010000:0.0:1788270062.935769:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270062.935802:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935822:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935833:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935844:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935851:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935857:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935966:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935976:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.935983:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937252:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937269:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937282:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937291:0:45778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937296:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937300:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937348:0:45778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270062.937373:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937379:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937385:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937391:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270062.937396:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937405:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937418:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff98c1429f8b00) 00010000:00010000:1.0:1788270062.937421:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788270062.937426:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937433:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08ba4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937453:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937458:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937461:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937464:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270062.937466:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937469:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937474:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270062.937475:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270062.937478:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937482:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08b96 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270062.937493:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c69c9de reply state 00000000e6bbba66 transno 30064771090 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937506:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.937512:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff98c1429f8400) 00010000:00010000:1.0:1788270062.937515:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270062.937518:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270062.937629:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:34542:x1875136253125760:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 2015us (2270us total) trans 30064771090 rc 0/0 00000100:00100000:1.0:1788270062.937636:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00010000:00010000:0.0:1788270062.937883:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270062.937890:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.937897:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19bc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270062.937900:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.937911:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.937922:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff98c1429f8b00) 00010000:00010000:0.0:1788270062.937924:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270062.937927:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.937933:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e08bab lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.937946:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270062.937948:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270062.937949:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270062.942416:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.942528:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253125888 00000100:00100000:3.0:1788270062.942540:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253125888 00000100:00100000:3.0:1788270062.942613:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788270062.942636:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:34542:x1875136253125888:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270062.942668:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.942694:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08bb2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018ac expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942764:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942779:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942789:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942801:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942806:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942810:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942848:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942853:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942857:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942862:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.942866:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942871:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942880:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.942883:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.942887:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942891:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08bb9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942901:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942905:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942908:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942911:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.942913:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942916:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942920:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff98c1429f8200) 00010000:00010000:3.0:1788270062.942921:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.942922:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942925:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08bc0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942952:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08bb2 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018ac expref: 31 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942960:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.942962:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.942964:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08bb2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018ac expref: 31 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.942970:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f000, rc 0) 00000100:00100000:3.0:1788270062.943029:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:34542:x1875136253125888:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 408us (631us total) trans 0 rc 301/301 00000100:00100000:3.0:1788270062.943035:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788270062.947507:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.947605:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253126144 00000100:00100000:3.0:1788270062.947617:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253126144 00000100:00100000:3.0:1788270062.947692:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788270062.947703:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:34542:x1875136253126144:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270062.947729:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.947759:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08bc7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018b3 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.947894:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.947914:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.947927:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.947944:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.947953:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.947960:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948795:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08bdc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948810:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08bdc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948823:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08bdc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270062.948835:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788270062.948866:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948874:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948882:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948889:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270062.948894:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948904:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948918:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270062.948921:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270062.948926:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948932:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08bce lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270062.948947:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f85a5b7b reply state 000000000d77ae7a transno 30064771091 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948963:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.948969:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff98c1429f8100) 00010000:00010000:2.0:1788270062.948972:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270062.948975:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270062.949007:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08bc7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018b3 expref: 33 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.949022:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08bdc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018b3 expref: 32 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.949029:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:2.0:1788270062.949031:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788270062.949034:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c200, rc 0) 00000100:00100000:2.0:1788270062.949212:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34542:x1875136253126144:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1509us (1717us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1788270062.949221:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788270062.953298:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.953440:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253126400 00000100:00100000:2.0:1788270062.953452:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253126400 00000100:00100000:2.0:1788270062.953513:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788270062.953529:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34542:x1875136253126400:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270062.953802:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.953816:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.953830:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270062.953867:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771092 00000004:00010000:2.0:1788270062.953881:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f15c709 reply state 000000009e67d245 transno 30064771093 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.953890:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.953896:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:2.0:1788270062.953898:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270062.953901:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270062.954034:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34542:x1875136253126400:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 513us (746us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1788270062.954063:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000020:00080000:2.0:1788270062.954067:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270062.956347:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270062.956391:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253126656 00000100:00100000:2.0:1788270062.956403:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253126656 00000100:00100000:2.0:1788270062.956508:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788270062.956532:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34542:x1875136253126656:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788270062.956814:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:34542:x1875136253126656:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 296us (484us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1788270062.956821:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788270062.963661:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270062.963846:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253126912 00000100:00100000:1.0:1788270062.963858:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253126912 00000100:00100000:1.0:1788270062.963939:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:1.0:1788270062.963952:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:34542:x1875136253126912:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270062.963982:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270062.964010:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e08bf1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018ba expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.964505:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e08bf8 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.964539:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e08bf8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.964552:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e08bf8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270062.964566:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1788270062.964705:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e08bf1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018ba expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.964728:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e08bf8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018ba expref: 39 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270062.964738:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:1.0:1788270062.964741:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788270062.964745:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a600, rc 0) 00000100:00100000:1.0:1788270062.964825:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34542:x1875136253126912:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 875us (1189us total) trans 30064771095 rc 0/0 00000100:00100000:1.0:1788270062.964834:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788270062.970836:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270062.971447:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253127168 00000100:00100000:1.0:1788270062.971461:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253127168 00000100:00100000:1.0:1788270062.971534:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788270062.971546:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34542:x1875136253127168:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788270062.971882:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34542:x1875136253127168:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 337us (1060us total) trans 30064771096 rc 0/0 00000100:00100000:1.0:1788270062.971891:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788270062.975660:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.975769:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253127424 00000100:00100000:0.0:1788270062.975780:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253127424 00000100:00100000:0.0:1788270062.975865:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788270062.975874:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34542:x1875136253127424:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788270062.975940:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788270062.975971:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e08bf8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018ba expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.975993:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08bdc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018b3 expref: 39 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976002:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:0.0:1788270062.976007:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270062.976031:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976130:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976139:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976150:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976154:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976158:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976258:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976265:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976272:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976505:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976513:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976518:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976634:0:45777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976642:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976649:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976702:0:45777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270062.976724:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976731:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976737:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976743:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.976749:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976758:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976767:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:0.0:1788270062.976769:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788270062.976772:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976779:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c14 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976792:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976796:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976799:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976803:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.976804:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976807:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976811:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270062.976812:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.976814:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976816:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c06 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270062.976821:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018eefb61 reply state 0000000073726dc9 transno 30064771097 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976830:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.976834:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff98c1429f8100) 00010000:00010000:0.0:1788270062.976835:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270062.976837:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270062.976917:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34542:x1875136253127424:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 1042us (1271us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1788270062.976925:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00010000:00010000:2.0:1788270062.977183:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270062.977191:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.977198:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270062.977203:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.977209:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.977220:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:2.0:1788270062.977232:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788270062.977236:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.977242:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c1b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270062.977253:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270062.977255:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270062.977256:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270062.981405:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.981535:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253127552 00000100:00100000:3.0:1788270062.981548:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253127552 00000100:00100000:3.0:1788270062.981613:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788270062.981638:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34542:x1875136253127552:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270062.981668:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.981693:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08c22 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018c1 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981770:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981786:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981799:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981814:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981821:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981827:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981874:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981881:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981889:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981895:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.981899:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981907:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981920:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.981922:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.981926:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981932:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08c29 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981945:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981951:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981957:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981964:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270062.981966:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981972:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981978:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c1429f8200) 00010000:00010000:3.0:1788270062.981980:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.981982:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.981988:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c30 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.982019:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08c22 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c1 expref: 41 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.982029:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270062.982031:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270062.982034:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08c22 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c1 expref: 41 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.982080:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f000, rc 0) 00000100:00100000:3.0:1788270062.982143:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34542:x1875136253127552:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 522us (750us total) trans 0 rc 301/301 00000100:00100000:3.0:1788270062.982151:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788270062.987614:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.988326:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253127808 00000100:00100000:0.0:1788270062.988340:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253127808 00000100:00100000:0.0:1788270062.988458:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:0.0:1788270062.988471:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34542:x1875136253127808:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270062.988498:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270062.988537:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08c37 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018c8 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.988695:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.988710:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.988719:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.988731:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.988736:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.988741:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989202:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989208:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989214:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270062.989222:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788270062.989263:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989272:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989279:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989286:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270062.989291:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989298:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989308:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270062.989311:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270062.989314:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989319:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c3e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270062.989333:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004da1e5f8 reply state 000000005efd467c transno 30064771098 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989346:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989352:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c2515e9500) 00010000:00010000:0.0:1788270062.989354:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270062.989357:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270062.989388:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08c37 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 43 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989404:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 42 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.989411:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270062.989414:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270062.989416:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0a00, rc 0) 00000100:00100000:0.0:1788270062.989499:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:34542:x1875136253127808:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1029us (1897us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1788270062.989506:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788270062.992692:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270062.992780:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253128064 00000100:00100000:0.0:1788270062.992791:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253128064 00000100:00100000:0.0:1788270062.992850:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:0.0:1788270062.992862:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:34542:x1875136253128064:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788270062.993160:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.993176:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.993185:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270062.993241:0:45777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771099 00000004:00010000:0.0:1788270062.993263:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008261db49 reply state 00000000dcfcefa1 transno 30064771100 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.993277:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270062.993285:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270062.993289:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270062.993293:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270062.993405:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34542:x1875136253128064:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 544us (727us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1788270062.993413:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000020:00080000:0.0:1788270062.993418:0:45777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270062.998663:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270062.998738:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253128192 00000100:00100000:3.0:1788270062.998751:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253128192 00000100:00100000:3.0:1788270062.998825:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788270062.998837:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34543:x1875136253128192:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270062.998864:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270062.998890:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018cf expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.998972:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.998990:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.999004:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270062.999083:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270062.999088:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270062.999114:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.999143:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018cf expref: 7 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.999165:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018cf expref: 6 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270062.999176:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:3.0:1788270062.999179:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270062.999184:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e800, rc 0) 00000100:00100000:3.0:1788270062.999271:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34543:x1875136253128192:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 435us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270062.999279:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:1.0:1788270063.002187:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.002263:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253128320 00000100:00100000:0.0:1788270063.002276:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253128320 00000100:00100000:0.0:1788270063.002343:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788270063.002355:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34543:x1875136253128320:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270063.002379:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270063.002404:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08c6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018d6 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002484:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002497:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002507:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002515:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002530:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002535:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002916:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e08c84 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002924:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e08c84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002929:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e08c84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270063.002964:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270063.002967:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270063.002984:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e08c84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.002998:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003002:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003007:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003011:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.003015:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003019:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003028:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:0.0:1788270063.003030:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270063.003034:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003059:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e08c76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003074:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003080:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003084:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003088:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.003090:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003094:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003098:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:0.0:1788270063.003100:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270063.003102:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003105:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e08c7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003125:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e08c6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018d6 expref: 8 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003135:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e08c84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018d6 expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.003140:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270063.003141:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788270063.003143:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0e00, rc 0) 00000100:00100000:0.0:1788270063.003203:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:34543:x1875136253128320:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 852us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.003210:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788270063.006015:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.006096:0:45788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253128448 00000100:00100000:2.0:1788270063.006108:0:45788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253128448 00000100:00100000:2.0:1788270063.006171:0:45788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788270063.006183:0:45788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34543:x1875136253128448:12345-192.168.201.42@tcp:900:mmap_sanity.0 00000100:00100000:2.0:1788270063.006274:0:45788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34543:x1875136253128448:12345-192.168.201.42@tcp:900:mmap_sanity.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.006283:0:45788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00080000:0.0:1788270063.006359:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270063.008109:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.008148:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253128704 00000100:00100000:0.0:1788270063.008157:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253128704 00000100:00100000:0.0:1788270063.008207:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788270063.008213:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:34543:x1875136253128704:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270063.008241:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270063.008268:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c8b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018dd expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008354:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008371:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008384:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008397:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008405:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008411:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008564:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e08ca0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008572:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e08ca0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008580:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e08ca0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270063.008588:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:0.0:1788270063.008678:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008686:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008694:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008700:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.008706:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008712:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008723:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270063.008725:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270063.008728:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008733:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e08c92 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008744:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008750:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008754:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008757:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.008759:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008762:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008765:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c2515e9500) 00010000:00010000:0.0:1788270063.008766:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270063.008768:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008771:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e08c99 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008800:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e08c8b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018dd expref: 10 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008808:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e08ca0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018dd expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.008813:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270063.008814:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270063.008816:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fa00, rc 0) 00000100:00100000:0.0:1788270063.008868:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34543:x1875136253128704:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 654us (764us total) trans 30064771101 rc 0/0 00000100:00100000:0.0:1788270063.008876:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788270063.012612:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.015702:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253128960 00000100:00100000:3.0:1788270063.015722:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253128960 00000100:00100000:2.0:1788270063.015921:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788270063.015933:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34543:x1875136253128960:12345-192.168.201.42@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1788270063.015954:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270063.015987:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e08ca0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018dd expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.016007:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:2.0:1788270063.016011:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270063.016212:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253128960:12345-192.168.201.42@tcp:103:mmap_sanity.0 Request processed in 281us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.016218:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:1.0:1788270063.018607:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.018656:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129088 00000100:00100000:2.0:1788270063.018668:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129088 00000100:00100000:2.0:1788270063.018727:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:2.0:1788270063.018737:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253129088:12345-192.168.201.42@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788270063.018856:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.018873:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.018880:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.018912:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.018923:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 45 pid: 46770 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.018940:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262617728:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270063.019025:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270063.022400:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262617728:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270063.022442:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270063.027319:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.027722:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129216 00000100:00100000:2.0:1788270063.027735:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129216 00010000:00010000:2.0:1788270063.027792:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 46 pid: 46770 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.027881:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788270063.027893:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:2401:x1875136253129216:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270063.027911:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270063.027920:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 46 pid: 46770 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.027935:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 46 pid: 46770 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.027964:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e08c4c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018c8 expref: 46 pid: 46770 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.027985:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:2.0:1788270063.027991:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.028003:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.028012:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.028140:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270063.028206:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2401:x1875136253129216:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 314us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.028215:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00010000:00010000:1.0:1788270063.028313:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270063.028323:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270063.029319:0:45778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788270063.029452:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 64 off8576 00000040:00080000:1.0:1788270063.029731:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].1, 136 off8328 00000100:00100000:1.0:1788270063.029823:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253129088:12345-192.168.201.42@tcp:58:mmap_sanity.0 Request processed in 11083us (11222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270063.029835:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788270063.031979:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.032067:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129344 00000100:00100000:0.0:1788270063.032079:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129344 00000100:00100000:0.0:1788270063.032149:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:0.0:1788270063.032161:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253129344:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270063.032187:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270063.032210:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018e4 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.032280:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.032289:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 9 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.032306:0:46770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.032323:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 9 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.032338:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270063.032342:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270063.032345:0:46770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 9 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.032359:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e600, rc 0) 00000100:00100000:0.0:1788270063.032423:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34543:x1875136253129344:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 264us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.032431:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00010000:00010000:3.0:1788270063.046429:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270063.106610:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.106652:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270063.106684:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129472 00000100:00100000:1.0:1788270063.106697:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129472 00000100:00100000:3.0:1788270063.106700:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.106731:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.106753:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.106780:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:2.0:1788270063.106829:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129856 00000100:00100000:0.0:1788270063.106829:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129600 00000100:00100000:2.0:1788270063.106834:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129856 00000100:00100000:0.0:1788270063.106842:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129600 00000100:00100000:0.0:1788270063.106874:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129728 00000100:00100000:0.0:1788270063.106876:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129728 00000100:00100000:2.0:1788270063.106885:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788270063.106892:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253130112 00000100:00100000:2.0:1788270063.106894:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2403:x1875136253129856:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270063.106894:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253130112 00000100:00100000:0.0:1788270063.106906:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788270063.106912:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2403:x1875136253129600:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270063.107149:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788270063.107159:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253129728:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270063.107261:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2403:x1875136253129856:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 368us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.107270:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788270063.107303:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788270063.107311:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:2403:x1875136253130112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270063.107337:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:2403:x1875136253130112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270063.107337:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.107343:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788270063.108029:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:2402:x1875136253129472:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270063.108270:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253129728:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1112us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270063.108279:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788270063.108419:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2403:x1875136253129600:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1505us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.108427:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788270063.108450:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253129984 00000100:00100000:0.0:1788270063.108456:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253129984 00000100:00080000:2.0:1788270063.108460:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270063.108479:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270063.108497:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788270063.108505:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253129984:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270063.108977:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.109101:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253129984:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 595us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.109109:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788270063.109122:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253130368 00000100:00100000:0.0:1788270063.109126:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253130368 00000100:00100000:0.0:1788270063.109157:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788270063.109164:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253130368:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270063.109282:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:2402:x1875136253129472:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2492us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.109290:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00080000:3.0:1788270063.109438:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270063.109545:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.109868:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.109887:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253130496 00000100:00100000:2.0:1788270063.109892:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253130496 00000100:00100000:2.0:1788270063.109932:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788270063.109940:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253130496:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270063.109983:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253130496:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.109990:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00080000:2.0:1788270063.110034:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270063.110177:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253130368:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1011us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.110184:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788270063.110924:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253130240 00000100:00100000:3.0:1788270063.110931:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253130240 00000100:00100000:3.0:1788270063.111115:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788270063.111124:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253130240:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270063.111177:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253130240:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 56us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.111183:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000040:00080000:2.0:1788270063.236360:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270063.236372:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270063.236407:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 2 count 2 00000040:00080000:2.0:1788270063.236420:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270063.236744:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262617856:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788270063.236867:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270063.244720:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262617856:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788270063.245071:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.245192:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253130624 00000100:00100000:3.0:1788270063.245200:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253130624 00000100:00100000:3.0:1788270063.245283:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:3.0:1788270063.245293:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34544:x1875136253130624:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270063.245328:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270063.245657:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34544:x1875136253130624:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 364us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.245665:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788270063.249666:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.250642:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253130752 00000100:00100000:2.0:1788270063.250658:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253130752 00000100:00100000:2.0:1788270063.250806:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788270063.250819:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34544:x1875136253130752:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270063.250936:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.250956:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.250968:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.250985:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.250990:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.250994:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251016:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251022:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251025:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270063.251092:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:2.0:1788270063.251098:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270063.251117:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251128:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251135:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251142:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251152:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270063.251157:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251165:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251180:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:2.0:1788270063.251183:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270063.251189:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251195:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08cbc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251209:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251216:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251233:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251238:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270063.251241:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251246:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251257:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9ebbb977 (ffff98c1429fe000) 00010000:00010000:2.0:1788270063.251260:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270063.251263:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251269:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08cc3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251284:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251291:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251297:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251302:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ca00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270063.251305:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251310:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251317:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:2.0:1788270063.251319:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270063.251321:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.251327:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ca00/0xc5f5d7a016e08cca lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.251445:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34544:x1875136253130752:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 627us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.251453:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:1.0:1788270063.255456:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.255551:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253131008 00000100:00100000:3.0:1788270063.255574:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253131008 00000100:00100000:3.0:1788270063.255647:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788270063.255660:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34544:x1875136253131008:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270063.255697:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270063.255724:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018eb expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.255864:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.255883:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.255896:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270063.255909:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:3.0:1788270063.256010:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256019:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256032:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256064:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.256070:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256079:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256095:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:3.0:1788270063.256098:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270063.256105:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256111:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08cd8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256157:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cd1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018eb expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256168:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:3.0:1788270063.256171:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270063.256176:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018eb expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.256186:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f000, rc 0) 00000100:00100000:3.0:1788270063.256270:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34544:x1875136253131008:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 612us (828us total) trans 30064771102 rc 301/301 00000100:00100000:3.0:1788270063.256281:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788270063.259308:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.259406:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253131136 00000100:00100000:3.0:1788270063.259419:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253131136 00000100:00100000:3.0:1788270063.259496:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788270063.259508:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34544:x1875136253131136:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270063.259573:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270063.259818:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34544:x1875136253131136:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 312us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.259827:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788270063.263812:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.263867:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253131392 00000100:00100000:2.0:1788270063.263880:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253131392 00000100:00100000:2.0:1788270063.263970:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788270063.263983:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34544:x1875136253131392:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270063.264006:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270063.264032:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08ce6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018f2 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270063.265114:0:45778:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xa3:0x0], count =31 00000004:00080000:2.0:1788270063.265122:0:45778:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xa3:0x0]+31 in llog 00000004:00080000:2.0:1788270063.265148:0:45778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc2:0x0], index 0: 0 00010000:00010000:2.0:1788270063.265329:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ced lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.265347:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ced lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.265361:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ced lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.265812:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08ce6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f2 expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.265830:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ced lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f2 expref: 48 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.265842:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270063.265844:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270063.265847:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ce00, rc 0) 00000100:00100000:2.0:1788270063.265981:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:34544:x1875136253131392:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2000us (2179us total) trans 30064771103 rc 0/0 00000100:00100000:2.0:1788270063.265989:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788270063.268974:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.269319:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253131648 00000100:00100000:3.0:1788270063.269398:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253131648 00000100:00100000:3.0:1788270063.269502:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:3.0:1788270063.269514:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:34544:x1875136253131648:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788270063.269601:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270063.269636:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ced lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f2 expref: 48 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269656:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270063.269676:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270063.269705:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269722:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269733:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269753:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269761:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269767:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269820:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269829:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269836:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269842:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.269847:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269855:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269864:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270063.269867:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.269871:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269878:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f000/0xc5f5d7a016e08cfb lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269888:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269894:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269899:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269905:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.269908:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269914:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269922:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xa0ad4d86 (ffff98c1429f8200) 00010000:00010000:3.0:1788270063.269924:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.269927:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.269933:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d02 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa0ad4d86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.270034:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:34544:x1875136253131648:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 521us (1073us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788270063.270061:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788270063.272595:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.272693:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253131776 00000100:00100000:0.0:1788270063.272705:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253131776 00000100:00100000:0.0:1788270063.272777:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:0.0:1788270063.272789:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:34544:x1875136253131776:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270063.272813:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270063.272843:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e08d09 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561018f9 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.272894:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.272909:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.272922:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.273094:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e08d09 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 49 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.273115:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 48 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.273125:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:0.0:1788270063.273128:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270063.273132:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fc00, rc 0) 00000100:00100000:0.0:1788270063.273435:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:34544:x1875136253131776:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 648us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.273444:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788270063.276599:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.276695:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253132032 00000100:00100000:2.0:1788270063.276708:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253132032 00000100:00100000:2.0:1788270063.276782:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:2.0:1788270063.276793:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:34544:x1875136253132032:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270063.276897:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.276917:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.276931:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270063.277195:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].2, 88 off8344 00000004:00080000:2.0:1788270063.277206:0:45778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 854984165842ns, next at 855984163319ns, rc = 0 00000004:00010000:2.0:1788270063.277276:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e296a494 reply state 00000000957e2f13 transno 30064771104 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.277291:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.277305:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:2.0:1788270063.277308:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270063.277312:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270063.277439:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:34544:x1875136253132032:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 646us (851us total) trans 30064771104 rc 0/0 00000100:00100000:2.0:1788270063.277447:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:1.0:1788270063.282356:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.282443:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253132160 00000100:00100000:3.0:1788270063.282457:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253132160 00000100:00100000:3.0:1788270063.282622:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270063.282637:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:34544:x1875136253132160:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270063.282670:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270063.282697:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101900 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.282787:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.282803:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.282826:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:3.0:1788270063.282829:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270063.282834:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fc00, rc 0) 00000100:00100000:3.0:1788270063.282944:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:34544:x1875136253132160:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 311us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.282953:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788270063.287893:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.288161:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253132288 00000100:00100000:3.0:1788270063.288174:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253132288 00000100:00100000:3.0:1788270063.288365:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788270063.288379:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253132288:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788270063.288699:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253132288:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 322us (820us total) trans 30064771075 rc 0/0 00000100:00100000:3.0:1788270063.288708:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:1.0:1788270063.291949:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.292081:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253132544 00000100:00100000:2.0:1788270063.292094:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253132544 00000100:00100000:2.0:1788270063.292287:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788270063.292297:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:34544:x1875136253132544:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270063.292603:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:34544:x1875136253132544:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 307us (664us total) trans 30064771105 rc 0/0 00000100:00100000:2.0:1788270063.292610:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788270063.295325:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.295411:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253132800 00000100:00100000:2.0:1788270063.295490:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253132800 00000100:00100000:2.0:1788270063.295653:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788270063.295665:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:34544:x1875136253132800:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270063.295804:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:34544:x1875136253132800:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 141us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.295813:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:3.0:1788270063.298467:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.298735:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253132928 00000100:00100000:2.0:1788270063.298749:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253132928 00000100:00100000:2.0:1788270063.298883:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788270063.298895:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:34544:x1875136253132928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270063.298915:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270063.298937:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08d25 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101907 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.299007:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08d2c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.299021:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08d2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.299035:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08d2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270063.299101:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270063.299119:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08d2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.299144:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08d25 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101907 expref: 54 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.299162:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08d2c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101907 expref: 53 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.299171:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:2.0:1788270063.299174:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270063.299177:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ce00, rc 0) 00000100:00100000:2.0:1788270063.299249:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:34544:x1875136253132928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 356us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.299256:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788270063.300838:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262617984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270063.300889:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.300926:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270063.300930:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262618112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270063.300944:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.300968:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262617984 00000100:00100000:2.0:1788270063.300972:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262617984 00000100:00100000:2.0:1788270063.300997:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618112 00000100:00100000:2.0:1788270063.300999:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618112 00000100:00100000:2.0:1788270063.301010:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788270063.301015:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262617984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270063.301033:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788270063.301076:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262617984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.301080:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788270063.301089:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788270063.301094:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262618112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270063.301111:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1788270063.301139:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262618112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.301145:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788270063.301162:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270063.301166:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270063.301203:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262618112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270063.301229:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262617984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270063.301371:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262618368:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301406:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.301433:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788270063.301441:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262618240:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301467:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.301494:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262618752:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301515:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.301542:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618368 00000100:00100000:2.0:1788270063.301546:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618368 00000100:00100000:2.0:1788270063.301569:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618752 00000100:00100000:2.0:1788270063.301572:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618752 00000100:00100000:2.0:1788270063.301584:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788270063.301589:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262618368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301627:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262618368:12345-0@lo:400:kworker.0 Request processed in 37us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.301634:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788270063.301652:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788270063.301652:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262618496:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301664:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262618752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301715:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262618752:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.301721:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788270063.301729:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.301747:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618240 00000100:00100000:2.0:1788270063.301753:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618240 00000100:00100000:2.0:1788270063.301788:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788270063.301799:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:3610:x1875136262618240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301848:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+20:3610:x1875136262618240:12345-0@lo:400:kworker.0 Request processed in 53us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.301854:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788270063.301899:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262618880:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301927:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.301949:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262618240:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301958:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262618752:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301965:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262618368:0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.301989:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618880 00000100:00100000:2.0:1788270063.301992:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618880 00000100:00100000:2.0:1788270063.302020:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788270063.302025:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262618880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.302080:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262618880:12345-0@lo:400:kworker.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.302085:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788270063.302102:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270063.302118:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262618880:0@lo:400:kworker.0 00000100:00100000:0.0:1788270063.302334:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262618624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270063.302364:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262619008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270063.302405:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.302461:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262619008 00000100:00100000:2.0:1788270063.302469:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262619008 00000100:00100000:0.0:1788270063.302475:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270063.302552:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618624 00000100:00100000:1.0:1788270063.302562:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618624 00000100:00100000:1.0:1788270063.302591:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788270063.302598:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262618624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270063.302610:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1788270063.302642:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262618624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270063.302648:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788270063.303008:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270063.303066:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262618624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270063.303104:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788270063.303105:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262618496 00000100:00100000:0.0:1788270063.303111:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262618496 00000100:00100000:2.0:1788270063.303123:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262619008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270063.303145:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788270063.303155:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262618496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270063.303183:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262619008:12345-0@lo:400:kworker.0 Request processed in 71us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.303190:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788270063.303212:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262618496:12345-0@lo:400:kworker.0 Request processed in 60us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270063.303231:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788270063.303270:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262619008:0@lo:400:kworker.0 00000100:00100000:0.0:1788270063.303282:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262618496:0@lo:400:kworker.0 00000100:00100000:0.0:1788270063.304538:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.304833:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262619264:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.304896:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270063.304935:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270063.304941:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262619392:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.304964:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270063.304992:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262619136:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305018:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270063.305037:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262619648:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305086:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270063.305106:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270063.305112:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262619520:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305139:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270063.305183:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262619264 00000100:00100000:3.0:1788270063.305192:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262619264 00000100:00100000:3.0:1788270063.305250:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262619392 00000100:00100000:3.0:1788270063.305254:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262619392 00000100:00100000:3.0:1788270063.305271:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262619136 00000100:00100000:3.0:1788270063.305274:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262619136 00000100:00100000:3.0:1788270063.305285:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262619648 00000100:00100000:3.0:1788270063.305288:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262619648 00000100:00100000:3.0:1788270063.305301:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262619520 00000100:00100000:3.0:1788270063.305303:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262619520 00000100:00100000:3.0:1788270063.305322:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788270063.305332:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262619264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305386:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262619264:12345-0@lo:400:kworker.0 Request processed in 56us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.305394:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788270063.305413:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788270063.305419:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262619392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305446:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262619392:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.305452:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788270063.305464:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788270063.305470:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262619136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305500:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262619136:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.305729:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788270063.305816:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788270063.305823:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262619648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305851:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262619648:12345-0@lo:400:kworker.0 Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.305856:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788270063.305868:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788270063.305874:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262619520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305898:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262619520:12345-0@lo:400:kworker.0 Request processed in 25us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.305904:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788270063.305944:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27f291880 x1875136262619392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270063.305960:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262619392:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.305973:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262619264:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.306005:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262619520:0@lo:400:kworker.0 00000100:00100000:3.0:1788270063.306017:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262619136:0@lo:400:kworker.0 00010000:00080000:3.0:1788270063.306027:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27d7dc700 x1875136262619648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270063.306035:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262619648:0@lo:400:kworker.0 00000100:00080000:3.0:1788270063.306077:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270063.306082:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270063.308537:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133056 00000100:00100000:1.0:1788270063.308552:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133056 00000100:00100000:2.0:1788270063.310610:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788270063.310633:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253133056:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270063.310652:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270063.310681:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610190e expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270063.310707:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d5ef, blocks: 0x0 00010000:00010000:2.0:1788270063.310727:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=855s v=(0 0) 00010000:00010000:2.0:1788270063.310732:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270063.310741:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 7 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.310759:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 7 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.310772:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ca00, rc 0) 00000100:00100000:2.0:1788270063.310840:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253133056:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 218us (6307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.310847:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:1.0:1788270063.316648:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.316740:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133312 00000100:00100000:3.0:1788270063.316758:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133312 00000100:00100000:3.0:1788270063.316840:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:3.0:1788270063.316853:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:34544:x1875136253133312:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788270063.316996:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:34544:x1875136253133312:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 145us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.317004:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:0.0:1788270063.336512:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.337886:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133440 00000100:00100000:2.0:1788270063.337901:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133440 00000100:00100000:2.0:1788270063.337983:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788270063.337994:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34544:x1875136253133440:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270063.338012:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270063.338034:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101915 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.338092:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.338108:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270063.338117:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270063.338123:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 8 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.338158:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.338171:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.338186:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262619776:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270063.338296:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495180 going to sleep for 11 seconds 00000100:00100000:2.0:1788270063.342334:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262619776:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270063.342370:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 8 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.342482:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270063.342561:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:34544:x1875136253133440:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 4567us (6063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.342571:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788270063.352120:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.353087:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133568 00000100:00100000:3.0:1788270063.353107:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133568 00010000:00010000:3.0:1788270063.353186:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.353251:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788270063.353263:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253133568:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270063.353282:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270063.353309:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.353327:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.353356:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18d9164/0xc5f5d7a016e08d33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610190e expref: 8 pid: 48230 timeout: 955 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.353379:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270063.353384:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270063.353396:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.353408:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.353458:0:45761:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.353476:0:45761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:45761:1875136262619904:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270063.353587:0:45761:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270063.357930:0:45761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:45761:1875136262619904:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270063.357968:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270063.359850:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253133568:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 6575us (7726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.359871:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:0.0:1788270063.371635:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.374382:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133696 00000100:00100000:2.0:1788270063.374397:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133696 00002000:00100000:2.0:1788270063.374451:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc2:0x0] (0->409599) req@ffff98c144380a80 x1875136253133696/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788270063.374465:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144380a80 with x1875136253133696 ext(0->409599) 00002000:00010000:2.0:1788270063.374471:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c144380a80 00000100:00100000:2.0:1788270063.374517:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788270063.374527:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253133696:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270063.388829:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253133696:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 14292us (17198us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788270063.388842:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:2.0:1788270063.388856:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc2:0x0] (0->409599) req@ffff98c144380a80 x1875136253133696/t30064771076(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:479/0 lens 488/448 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788270063.388866:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144380a80 with x1875136253133696 ext(0->409599) 00002000:00010000:2.0:1788270063.388872:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c144380a80 00000100:00100000:1.0:1788270063.392085:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.392233:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133824 00000100:00100000:0.0:1788270063.392248:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133824 00000100:00100000:0.0:1788270063.392331:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:0.0:1788270063.392344:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:34544:x1875136253133824:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788270063.394842:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771105 is committed 00000004:00080000:2.0:1788270063.394862:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788270063.394890:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771101 is committed 00010000:00010000:3.0:1788270063.394986:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395019:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395031:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395091:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395098:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395107:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395130:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f8900) 00010000:00010000:3.0:1788270063.395134:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395141:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395148:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fe00/0xc5f5d7a016e08a85 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395177:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395185:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395191:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395197:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395201:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.395213:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34544:x1875136253133824:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 2862us (3178us total) trans 0 rc 0/0 00010000:00010000:3.0:1788270063.395232:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.395246:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00010000:00010000:3.0:1788270063.395249:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270063.395255:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395259:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395266:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e000/0xc5f5d7a016e08a8c lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395281:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395288:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395295:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395300:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395303:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395310:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395321:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270063.395324:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788270063.395327:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395337:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e400/0xc5f5d7a016e08acb lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395356:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395363:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395369:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395373:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395375:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395381:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395388:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff98c1429fe100) 00010000:00010000:3.0:1788270063.395390:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395393:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395399:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d600/0xc5f5d7a016e08b26 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395418:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395426:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395433:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395439:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395442:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395449:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395457:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff98c1429f8400) 00010000:00010000:3.0:1788270063.395459:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395462:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395467:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08b7a lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395479:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395486:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395492:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395497:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395500:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395510:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395518:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff98c1429f8b00) 00010000:00010000:3.0:1788270063.395521:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395523:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395598:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e08b8f lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395621:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395627:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395633:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395639:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395642:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395648:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395656:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff98c1429f8400) 00010000:00010000:3.0:1788270063.395658:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395661:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395668:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e08b9d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395682:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395688:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395694:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395698:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395701:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395706:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395714:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff98c1429f8100) 00010000:00010000:3.0:1788270063.395716:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395720:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395726:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08bd5 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395751:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395757:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395764:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395769:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395772:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395778:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395786:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff98c1429fe800) 00010000:00010000:3.0:1788270063.395789:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395791:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395797:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d800/0xc5f5d7a016e08bea lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395811:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395818:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395825:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395830:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395833:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395844:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395851:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff98c1429f8100) 00010000:00010000:3.0:1788270063.395854:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395856:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395863:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e08c0d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395877:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395883:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395889:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395894:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395897:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395903:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395909:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c2515e9500) 00010000:00010000:3.0:1788270063.395912:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395914:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395921:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e08c45 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395935:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395940:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395945:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395951:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.395953:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395959:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395966:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:3.0:1788270063.395968:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270063.395971:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395977:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e08c5a lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395988:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.395994:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.396001:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.396006:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270063.396008:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.396014:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.396021:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:3.0:1788270063.396024:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788270063.396027:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.396033:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08d17 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.396329:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270063.396351:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262620032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788270063.396412:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270063.396499:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262620032 00000100:00100000:2.0:1788270063.396507:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262620032 00000100:00100000:2.0:1788270063.396552:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788270063.396561:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262620032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788270063.396688:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:2.0:1788270063.396692:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788270063 00002000:00010000:2.0:1788270063.396694:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788270063.396696:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb ctime from disk: 1788270063 -> 1788270063 00002000:00010000:2.0:1788270063.396699:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb blocks from disk: 0 -> 800 00000100:00100000:2.0:1788270063.396738:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262620032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (326us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1788270063.396745:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1788270063.396839:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c1d8380/2, rc 0, transno 30064771077 00000100:00100000:0.0:1788270063.396845:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262620032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788270063.404601:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.404685:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253133952 00000100:00100000:2.0:1788270063.404695:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253133952 00000100:00100000:2.0:1788270063.404763:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788270063.404774:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253133952:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788270063.406396:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771077 is committed 00000001:00080000:0.0:1788270063.406417:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771076 is committed 00000100:00100000:2.0:1788270063.406578:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253133952:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1799us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.406589:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788270063.410569:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.410677:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253134208 00000100:00100000:0.0:1788270063.410694:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253134208 00000100:00100000:0.0:1788270063.410779:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788270063.410792:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34544:x1875136253134208:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270063.410874:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270063.410911:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08d2c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101907 expref: 13 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.410936:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:0.0:1788270063.410941:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270063.410982:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.410997:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.411007:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270063.412618:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c0f25be reply state 0000000080ab493b transno 30064771106 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.412639:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.412646:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:0.0:1788270063.412648:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270063.412651:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270063.412776:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34544:x1875136253134208:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1987us (2217us total) trans 30064771106 rc 0/0 00000100:00100000:0.0:1788270063.412783:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:1.0:1788270063.415631:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.415749:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253134336 00000100:00100000:2.0:1788270063.415759:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253134336 00000100:00100000:2.0:1788270063.415811:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788270063.415822:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253134336:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788270063.415968:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:2.0:1788270063.415972:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb mtime from disk: 1788270063 -> 1788270063 00002000:00010000:2.0:1788270063.415974:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb atime from disk: 0 -> 1788270063 00002000:00010000:2.0:1788270063.415977:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb ctime from disk: 1788270063 -> 1788270063 00002000:00010000:2.0:1788270063.415979:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc2:0x0] updating lvb blocks from disk: 800 -> 800 00000100:00100000:2.0:1788270063.416034:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253134336:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 214us (413us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1788270063.416149:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:1.0:1788270063.420954:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.421072:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253134592 00000100:00100000:3.0:1788270063.421082:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253134592 00000100:00100000:3.0:1788270063.421143:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:3.0:1788270063.421153:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34544:x1875136253134592:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788270063.421233:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.421250:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 14 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.421260:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.421294:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 14 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.421308:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 14 pid: 48110 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.421322:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262620160:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270063.421440:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270063.430014:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.430115:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262620160:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270063.430145:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.430245:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253134720 00000100:00100000:2.0:1788270063.430253:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253134720 00010000:00010000:2.0:1788270063.430290:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 15 pid: 48110 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.430335:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788270063.430346:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253134720:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270063.430360:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270063.430368:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 15 pid: 48110 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.430393:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 15 pid: 48110 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.430417:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d10 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018f9 expref: 15 pid: 48110 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.430434:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:2.0:1788270063.430439:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.430449:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.430457:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.430486:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270063.430542:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253134720:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 198us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.430549:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00010000:00010000:0.0:1788270063.431284:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431300:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431360:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431368:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431375:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431380:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.431385:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431394:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431411:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:0.0:1788270063.431413:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788270063.431418:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.431423:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08d48 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.431516:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34544:x1875136253134592:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 10361us (10568us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788270063.431526:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:0.0:1788270063.434569:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270063.434726:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253134848 00000100:00100000:1.0:1788270063.434739:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253134848 00000100:00100000:1.0:1788270063.434814:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788270063.434826:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253134848:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788270063.434891:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270063.434917:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270063.434926:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270063.434931:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270063.434936:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270063.434983:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270063.434999:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270063.435019:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:47281:1875136262620288:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270063.435152:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788270063.438011:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.438130:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253134976 00000100:00100000:3.0:1788270063.438140:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253134976 00010000:00010000:3.0:1788270063.438182:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 8 pid: 47284 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.438236:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788270063.438248:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253134976:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270063.438263:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270063.438286:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 8 pid: 47284 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.438301:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 8 pid: 47284 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.438332:0:46531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270063.438337:0:46531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270063.438344:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.438355:0:46531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.438391:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270063.438447:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253134976:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 201us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.438455:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00010000:00010000:2.0:1788270063.438661:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101915 expref: 7 pid: 47284 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.438677:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:47281:1875136262620288:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270063.438699:0:47281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438710:0:47281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438717:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438736:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438743:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438751:0:47281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438758:0:47281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19bc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270063.438763:0:47281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438771:0:47281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438783:0:47281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.438790:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452b6f7c/0xc5f5d7a016e08d4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.438849:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253134848:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 4024us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.438857:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788270063.442832:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.442938:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253135232 00000100:00100000:0.0:1788270063.442956:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253135232 00000100:00100000:0.0:1788270063.443080:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788270063.443093:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34544:x1875136253135232:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788270063.443200:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443234:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443249:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443503:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443517:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 14 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443529:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443575:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 14 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.443598:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 14 pid: 45777 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.443615:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262620416:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270063.443721:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:2.0:1788270063.446870:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262620416:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270063.446901:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270063.451334:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.451462:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253135360 00000100:00100000:3.0:1788270063.451472:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253135360 00010000:00010000:3.0:1788270063.451638:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 15 pid: 45777 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.451684:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788270063.451694:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253135360:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270063.451708:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270063.451716:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 15 pid: 45777 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.451728:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 15 pid: 45777 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.451756:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fc00/0xc5f5d7a016e08d1e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101900 expref: 15 pid: 45777 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.451773:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:3.0:1788270063.451779:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.451788:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.451796:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.451826:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270063.451864:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.451875:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270063.451929:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253135360:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 235us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.451937:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000001:00080000:0.0:1788270063.451984:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771107 00000001:00080000:0.0:1788270063.452177:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771108 00000001:00080000:0.0:1788270063.452214:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771109 00000100:00100000:0.0:1788270063.452308:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262620544:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270063.452354:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270063.452637:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249a23540 going to sleep for 11 seconds 00000100:00100000:2.0:1788270063.452673:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262620544 00000100:00100000:2.0:1788270063.452678:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262620544 00000100:00100000:2.0:1788270063.452712:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788270063.452720:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262620544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270063.452791:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262620544:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.452798:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788270063.452866:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771077 gen 2 00000004:00080000:0.0:1788270063.452872:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c1d8380, transno 30064771077 00000100:00100000:0.0:1788270063.452894:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262620544:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788270063.453062:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771110 00000100:00100000:0.0:1788270063.453101:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262620672:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270063.453130:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270063.453191:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132540 going to sleep for 11 seconds 00000100:00100000:2.0:1788270063.454018:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262620672 00000100:00100000:2.0:1788270063.454025:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262620672 00000100:00100000:2.0:1788270063.454137:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788270063.454148:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262620672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270063.454280:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262620672:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (1149us total) trans 30064771079 rc 0/0 00000100:00100000:2.0:1788270063.454288:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788270063.454445:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262620672:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788270063.454478:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454488:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454495:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454502:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.454506:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454512:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454528:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:0.0:1788270063.454531:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270063.454535:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454541:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08d5d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454593:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454600:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454611:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454617:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.454620:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454625:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454637:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270063.454642:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270063.454651:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454670:0:45776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454683:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.454784:0:45776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.454805:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262620800:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788270063.454992:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132540 going to sleep for 11 seconds 00000100:00100000:1.0:1788270063.460360:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270063.460425:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262620800:192.168.201.42@tcp:105: 00010000:00010000:0.0:1788270063.460449:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460460:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08cae lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.460466:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253135488 00000100:00100000:2.0:1788270063.460474:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253135488 00010000:00010000:0.0:1788270063.460488:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460502:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460513:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.460521:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00010000:00010000:0.0:1788270063.460523:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.460530:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144b19c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253135488:12345-192.168.201.42@tcp:49:mmap_sanity.0 00010000:00010000:0.0:1788270063.460533:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460541:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460547:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.460550:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460568:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460583:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270063.460586:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270063.460590:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460596:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08d64 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460605:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460612:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460618:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460623:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270063.460626:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460632:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270063.460633:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144b19c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253135488:12345-192.168.201.42@tcp:49:mmap_sanity.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.460646:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00010000:00010000:0.0:1788270063.460648:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270063.460651:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270063.460654:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.460660:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08d56 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270063.460779:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34544:x1875136253135232:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 17689us (17958us total) trans 30064771111 rc 0/0 00000100:00100000:0.0:1788270063.460787:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000020:00080000:0.0:1788270063.460791:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788270063.460943:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270063.460947:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270063.460964:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 2 count 2 00000040:00080000:2.0:1788270063.460969:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270063.462460:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270063.462650:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.462751:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253135616 00000100:00100000:2.0:1788270063.462760:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253135616 00000100:00100000:2.0:1788270063.462809:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788270063.462818:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34543:x1875136253135616:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270063.462832:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270063.462852:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610191c expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270063.462876:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a96d5ef, atime: 0x6a96d5ef, ctime: 0x6a96d5ef, blocks: 0x320 00010000:00010000:2.0:1788270063.462894:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=855s v=(0 0) 00010000:00010000:2.0:1788270063.462900:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270063.462909:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.462931:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270063.462944:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270063.463032:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34543:x1875136253135616:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 214us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270063.463058:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788270063.463177:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253135872 00000100:00100000:3.0:1788270063.463182:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253135872 00000100:00100000:3.0:1788270063.463239:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:3.0:1788270063.463247:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34544:x1875136253135872:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788270063.463644:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788270063.463671:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771112 00010000:00010000:3.0:1788270063.463697:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.463709:0:45779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.463722:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.463730:0:45779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.463737:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.463743:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.463767:0:45779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788270063.463812:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34544:x1875136253135872:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 565us (1162us total) trans 30064771113 rc 0/0 00000100:00100000:3.0:1788270063.463819:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000020:00080000:3.0:1788270063.463822:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270063.463980:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270063.463988:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.463997:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270063.464001:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.464010:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.464022:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:0.0:1788270063.464025:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270063.464029:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.464036:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08d72 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270063.464076:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270063.464078:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270063.464080:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270063.466610:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.466715:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136000 00000100:00100000:2.0:1788270063.466725:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136000 00002000:00100000:2.0:1788270063.466766:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (0->4095) req@ffff98c27d7dc700 x1875136253136000/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.466778:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dc700 with x1875136253136000 ext(0->4095) 00002000:00010000:2.0:1788270063.466784:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27d7dc700 00000100:00100000:2.0:1788270063.466811:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788270063.466820:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253136000:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.467000:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253136000:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 181us (400us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788270063.467008:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00002000:00100000:2.0:1788270063.467015:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (0->4095) req@ffff98c27d7dc700 x1875136253136000/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/4536 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.467023:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dc700 with x1875136253136000 ext(0->4095) 00002000:00010000:2.0:1788270063.467026:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27d7dc700 00000100:00100000:1.0:1788270063.472594:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.472700:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136128 00000100:00100000:2.0:1788270063.472710:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136128 00002000:00100000:2.0:1788270063.472757:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc2:0x0] (4096->8191) req@ffff98c27c1d9500 x1875136253136128/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.472769:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d9500 with x1875136253136128 ext(4096->8191) 00002000:00010000:2.0:1788270063.472775:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d9500 00000100:00100000:2.0:1788270063.472807:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:2.0:1788270063.472816:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253136128:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.472960:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253136128:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 144us (374us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788270063.472967:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00002000:00100000:2.0:1788270063.472973:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc2:0x0] (4096->8191) req@ffff98c27c1d9500 x1875136253136128/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/4536 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.472981:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d9500 with x1875136253136128 ext(4096->8191) 00002000:00010000:2.0:1788270063.472984:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d9500 00000100:00100000:1.0:1788270063.476387:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.476492:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136256 00000100:00100000:2.0:1788270063.476501:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136256 00002000:00100000:2.0:1788270063.476554:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (8192->12287) req@ffff98c27c1db480 x1875136253136256/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.476578:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1db480 with x1875136253136256 ext(8192->12287) 00002000:00010000:2.0:1788270063.476584:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1db480 00000100:00100000:2.0:1788270063.476614:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788270063.476623:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253136256:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.477334:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253136256:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 709us (954us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788270063.477347:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00002000:00100000:2.0:1788270063.477355:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (8192->12287) req@ffff98c27c1db480 x1875136253136256/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/4536 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.477365:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1db480 with x1875136253136256 ext(8192->12287) 00002000:00010000:2.0:1788270063.477368:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1db480 00000100:00100000:0.0:1788270063.481775:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270063.481850:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136384 00000100:00100000:1.0:1788270063.481858:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136384 00002000:00100000:1.0:1788270063.481890:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (12288->69631) req@ffff98c1451c1f80 x1875136253136384/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270063.481899:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c1f80 with x1875136253136384 ext(12288->69631) 00002000:00010000:1.0:1788270063.481903:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c1f80 00000100:00100000:1.0:1788270063.481929:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788270063.481935:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253136384:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.486812:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253136384:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 4864us (5033us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1788270063.486826:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00002000:00100000:2.0:1788270063.486839:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (12288->69631) req@ffff98c1451c1f80 x1875136253136384/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.486851:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c1f80 with x1875136253136384 ext(12288->69631) 00002000:00010000:2.0:1788270063.486858:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c1f80 00000100:00100000:0.0:1788270063.495944:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.496099:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136512 00000100:00100000:2.0:1788270063.496110:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136512 00002000:00100000:2.0:1788270063.496157:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (69632->106495) req@ffff98c1451c2a00 x1875136253136512/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.496170:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c2a00 with x1875136253136512 ext(69632->106495) 00002000:00010000:2.0:1788270063.496176:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c2a00 00000100:00100000:2.0:1788270063.496226:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788270063.496238:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253136512:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.502698:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253136512:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 6453us (6751us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.502712:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00002000:00100000:2.0:1788270063.502728:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (69632->106495) req@ffff98c1451c2a00 x1875136253136512/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.502740:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c2a00 with x1875136253136512 ext(69632->106495) 00002000:00010000:2.0:1788270063.502747:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c2a00 00000100:00100000:1.0:1788270063.516161:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.516580:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136640 00000100:00100000:2.0:1788270063.516591:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136640 00002000:00100000:2.0:1788270063.516639:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (106496->143359) req@ffff98c27c1d8700 x1875136253136640/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.516650:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d8700 with x1875136253136640 ext(106496->143359) 00002000:00010000:2.0:1788270063.516656:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d8700 00000100:00100000:2.0:1788270063.516688:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788270063.516697:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253136640:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.519596:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253136640:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 2883us (3428us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.519609:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00002000:00100000:2.0:1788270063.519621:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (106496->143359) req@ffff98c27c1d8700 x1875136253136640/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.519632:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d8700 with x1875136253136640 ext(106496->143359) 00002000:00010000:2.0:1788270063.519638:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d8700 00000100:00100000:1.0:1788270063.525388:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.525506:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136768 00000100:00100000:2.0:1788270063.525518:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136768 00002000:00100000:2.0:1788270063.525568:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (143360->180223) req@ffff98c27c1dad80 x1875136253136768/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.525580:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1dad80 with x1875136253136768 ext(143360->180223) 00002000:00010000:2.0:1788270063.525587:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1dad80 00000100:00100000:2.0:1788270063.525619:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788270063.525629:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253136768:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.529940:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253136768:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 4297us (4549us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.529954:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00002000:00100000:2.0:1788270063.529968:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (143360->180223) req@ffff98c27c1dad80 x1875136253136768/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.529977:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1dad80 with x1875136253136768 ext(143360->180223) 00002000:00010000:2.0:1788270063.529985:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1dad80 00000100:00100000:0.0:1788270063.537096:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.537362:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253136896 00000100:00100000:2.0:1788270063.537376:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253136896 00002000:00100000:2.0:1788270063.537509:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (180224->217087) req@ffff98c1451c0700 x1875136253136896/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.537522:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c0700 with x1875136253136896 ext(180224->217087) 00002000:00010000:2.0:1788270063.537530:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c0700 00000100:00100000:2.0:1788270063.537581:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788270063.537593:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253136896:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.543329:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253136896:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 5721us (6274us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.543346:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00002000:00100000:2.0:1788270063.543363:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (180224->217087) req@ffff98c1451c0700 x1875136253136896/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.543382:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c0700 with x1875136253136896 ext(180224->217087) 00002000:00010000:2.0:1788270063.543391:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c0700 00000100:00100000:1.0:1788270063.549113:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.549331:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137024 00000100:00100000:2.0:1788270063.549344:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137024 00002000:00100000:2.0:1788270063.549403:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (217088->253951) req@ffff98c27c1d8a80 x1875136253137024/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.549414:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d8a80 with x1875136253137024 ext(217088->253951) 00002000:00010000:2.0:1788270063.549422:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d8a80 00000100:00100000:2.0:1788270063.549455:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788270063.549463:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253137024:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.554411:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253137024:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 4928us (5291us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.554429:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00002000:00100000:2.0:1788270063.554446:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (217088->253951) req@ffff98c27c1d8a80 x1875136253137024/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.554459:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d8a80 with x1875136253137024 ext(217088->253951) 00002000:00010000:2.0:1788270063.554468:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d8a80 00000100:00100000:0.0:1788270063.560306:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.563333:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137152 00000100:00100000:2.0:1788270063.563354:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137152 00002000:00100000:2.0:1788270063.563435:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (253952->290815) req@ffff98c1428fd880 x1875136253137152/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.563448:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fd880 with x1875136253137152 ext(253952->290815) 00002000:00010000:2.0:1788270063.563457:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428fd880 00000100:00100000:2.0:1788270063.563505:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:2.0:1788270063.563518:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253137152:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.569984:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253137152:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 6450us (9673us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.570002:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00002000:00100000:2.0:1788270063.570017:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (253952->290815) req@ffff98c1428fd880 x1875136253137152/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.570030:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fd880 with x1875136253137152 ext(253952->290815) 00002000:00010000:2.0:1788270063.570076:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428fd880 00000100:00100000:1.0:1788270063.575570:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.575732:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137280 00000100:00100000:2.0:1788270063.575746:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137280 00002000:00100000:2.0:1788270063.575809:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (290816->327679) req@ffff98c27c1daa00 x1875136253137280/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.575821:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1daa00 with x1875136253137280 ext(290816->327679) 00002000:00010000:2.0:1788270063.575828:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1daa00 00000100:00100000:2.0:1788270063.575866:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788270063.575878:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253137280:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.582017:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253137280:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 6124us (6457us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.582035:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00002000:00100000:2.0:1788270063.582093:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (290816->327679) req@ffff98c27c1daa00 x1875136253137280/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.582113:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1daa00 with x1875136253137280 ext(290816->327679) 00002000:00010000:2.0:1788270063.582122:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1daa00 00000100:00100000:0.0:1788270063.588705:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.588948:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137408 00000100:00100000:2.0:1788270063.588962:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137408 00002000:00100000:2.0:1788270063.589342:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (327680->364543) req@ffff98c1428fea00 x1875136253137408/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.589356:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fea00 with x1875136253137408 ext(327680->364543) 00002000:00010000:2.0:1788270063.589363:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428fea00 00000100:00100000:2.0:1788270063.589398:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788270063.589408:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253137408:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.594533:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2403:x1875136253137408:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 5111us (5827us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.594548:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00002000:00100000:2.0:1788270063.594570:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (327680->364543) req@ffff98c1428fea00 x1875136253137408/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.594583:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fea00 with x1875136253137408 ext(327680->364543) 00002000:00010000:2.0:1788270063.594591:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428fea00 00000100:00100000:1.0:1788270063.600131:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.600365:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137536 00000100:00100000:2.0:1788270063.600380:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137536 00002000:00100000:2.0:1788270063.600436:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (364544->401407) req@ffff98c27c1da300 x1875136253137536/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.600449:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1da300 with x1875136253137536 ext(364544->401407) 00002000:00010000:2.0:1788270063.600456:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1da300 00000100:00100000:2.0:1788270063.600489:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788270063.600500:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253137536:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.603920:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253137536:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 3405us (3785us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270063.603936:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00002000:00100000:2.0:1788270063.603950:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc2:0x0] (364544->401407) req@ffff98c27c1da300 x1875136253137536/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/440 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.603962:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1da300 with x1875136253137536 ext(364544->401407) 00002000:00010000:2.0:1788270063.603970:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1da300 00000100:00100000:0.0:1788270063.607557:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.607672:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137664 00000100:00100000:2.0:1788270063.607685:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137664 00002000:00100000:2.0:1788270063.607746:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (401408->409599) req@ffff98c1428fc000 x1875136253137664/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/0 e 0 to 0 dl 1788270074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.607756:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fc000 with x1875136253137664 ext(401408->409599) 00002000:00010000:2.0:1788270063.607761:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428fc000 00000100:00100000:2.0:1788270063.607792:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788270063.607803:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253137664:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270063.608010:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253137664:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 208us (466us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1788270063.608019:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00002000:00100000:2.0:1788270063.608026:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc2:0x0] (401408->409599) req@ffff98c1428fc000 x1875136253137664/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:479/0 lens 488/8632 e 0 to 0 dl 1788270074 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270063.608120:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fc000 with x1875136253137664 ext(401408->409599) 00002000:00010000:2.0:1788270063.608124:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428fc000 00000100:00100000:0.0:1788270063.610897:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.611021:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253137920 00000100:00100000:2.0:1788270063.611033:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253137920 00000100:00100000:2.0:1788270063.611128:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788270063.611140:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34543:x1875136253137920:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788270063.611510:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34543:x1875136253137920:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 371us (623us total) trans 30064771114 rc 0/0 00000100:00100000:2.0:1788270063.611519:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000040:00080000:3.0:1788270063.684712:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788270063.746957:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.747071:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138048 00000100:00100000:3.0:1788270063.747084:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138048 00000100:00100000:3.0:1788270063.747158:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:3.0:1788270063.747180:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+11:33919:x1875136253138048:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270063.747204:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270063.747243:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9fc00/0xc5f5d7a016e08d79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101923 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.747635:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9fc00/0xc5f5d7a016e08d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101923 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.747655:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9fc00/0xc5f5d7a016e08d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101923 expref: 12 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.747665:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fc00, rc 0) 00000100:00100000:3.0:1788270063.747792:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+12:33919:x1875136253138048:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 623us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.747801:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:0.0:1788270063.753797:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270063.753924:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138176 00000100:00100000:2.0:1788270063.753937:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138176 00000100:00100000:3.0:1788270063.754502:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:3.0:1788270063.754518:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+12:33919:x1875136253138176:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270063.754865:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+12:33919:x1875136253138176:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 351us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.754874:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788270063.757275:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.757350:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138304 00000100:00100000:3.0:1788270063.757361:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138304 00000100:00100000:3.0:1788270063.757426:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:3.0:1788270063.757438:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+12:33919:x1875136253138304:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788270063.757830:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+12:33919:x1875136253138304:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 394us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.757839:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:2.0:1788270063.765599:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.765795:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138432 00000100:00100000:3.0:1788270063.765809:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138432 00000100:00100000:3.0:1788270063.765883:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:3.0:1788270063.765895:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+12:33919:x1875136253138432:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270063.765916:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270063.765950:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9e400/0xc5f5d7a016e08d80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610192a expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.765985:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9e400/0xc5f5d7a016e08d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610192a expref: 13 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.765997:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9e400/0xc5f5d7a016e08d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610192a expref: 13 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270063.766009:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e400, rc 0) 00000100:00100000:3.0:1788270063.766111:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:33919:x1875136253138432:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 217us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.766118:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:0.0:1788270063.773779:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270063.774607:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138560 00000100:00100000:3.0:1788270063.774621:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138560 00000100:00100000:3.0:1788270063.774692:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:3.0:1788270063.774706:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:33919:x1875136253138560:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270063.774896:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:33919:x1875136253138560:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 191us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270063.774905:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:0.0:1788270063.778076:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270063.778161:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138688 00000100:00100000:1.0:1788270063.778173:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138688 00000100:00100000:1.0:1788270063.778242:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:1.0:1788270063.778252:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:33919:x1875136253138688:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788270063.778444:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:33919:x1875136253138688:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 192us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270063.778457:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 10000000:01000000:2.0:1788270064.004383:0:45773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788270064.004393:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c2491ea000 from 13 10000000:01000000:2.0:1788270064.004401:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788270064.004474:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.004495:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.004510:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270064.004545:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262620928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788270064.004649:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270064.004714:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270064.004807:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262620928 00000100:00100000:3.0:1788270064.005220:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262620928 00000100:00100000:3.0:1788270064.005294:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788270064.005306:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+20:45773:x1875136262620928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270064.005323:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270064.005342:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c143b9e000/0xc5f5d7a016e08d8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08d87 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.005381:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c143b9e000/0xc5f5d7a016e08d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08d87 expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.005395:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c143b9e000/0xc5f5d7a016e08d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08d87 expref: 21 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.005406:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e000, rc 0) 00000100:00100000:3.0:1788270064.007301:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262620928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1986us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270064.007315:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788270064.008984:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262620928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788270064.009018:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08d8e expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270064.009033:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08d8e expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270064.009287:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.009361:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270064.009494:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270064.010027:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621056 00000100:00100000:2.0:1788270064.010036:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621056 00000100:00100000:2.0:1788270064.010247:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788270064.010259:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262621056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788270064.010440:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262621056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270064.010449:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788270064.010531:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.010573:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.010619:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270064.010798:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788270064.010965:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621184 00000100:00100000:3.0:1788270064.010972:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621184 00000100:00100000:3.0:1788270064.011001:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788270064.011008:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262621184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.011563:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262621184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 553us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270064.011572:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788270064.011720:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788270064.013094:0:48817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788270064.013432:0:45773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788270064.013461:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788270064.013474:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08d8e expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.013487:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c26ab5d800/0xc5f5d7a016e08d87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08d8e expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270064.013499:0:45773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788270064.013502:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27a608000 from 13 10000000:01000000:3.0:1788270064.013506:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270064.013553:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.013561:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.013573:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270064.013599:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.013671:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270064.014794:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:2.0:1788270064.014952:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621312 00000100:00100000:2.0:1788270064.014962:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621312 00000100:00100000:2.0:1788270064.015081:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788270064.015093:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+21:45773:x1875136262621312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270064.015122:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270064.015142:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e08d9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08d95 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.015386:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e08d9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08d95 expref: 22 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.015400:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5d600/0xc5f5d7a016e08d9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08d95 expref: 22 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.015412:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d600, rc 0) 00000100:00100000:2.0:1788270064.015498:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262621312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 407us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270064.015506:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788270064.015611:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270064.015631:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08d9c expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.015641:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08d9c expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270064.015728:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.015767:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270064.019890:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270064.020034:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621440 00000100:00100000:1.0:1788270064.020074:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621440 00000100:00100000:1.0:1788270064.020363:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788270064.020375:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262621440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.020633:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262621440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (4864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270064.020643:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788270064.020898:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.020963:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.021034:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270064.021499:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270064.021549:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621568 00000100:00100000:1.0:1788270064.021555:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621568 00000100:00100000:0.0:1788270064.021711:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788270064.021720:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262621568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788270064.021952:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262621568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270064.021961:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788270064.022083:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788270064.023416:0:48818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788270064.023641:0:45773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788270064.023668:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788270064.023681:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08d9c expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.023696:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9fe00/0xc5f5d7a016e08d95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08d9c expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270064.023709:0:45773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788270064.023713:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c27f622800 from 13 10000000:01000000:3.0:1788270064.023717:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270064.023760:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.023769:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.023781:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270064.023808:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.024003:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270064.024084:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:0.0:1788270064.024181:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621696 00000100:00100000:0.0:1788270064.024190:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621696 00000100:00100000:0.0:1788270064.024255:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788270064.024265:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+22:45773:x1875136262621696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788270064.024280:0:45770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270064.024297:0:45770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26bf9f400/0xc5f5d7a016e08daa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08da3 expref: -99 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270064.024326:0:45770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26bf9f400/0xc5f5d7a016e08daa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08da3 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270064.024338:0:45770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26bf9f400/0xc5f5d7a016e08daa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08da3 expref: 23 pid: 45770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270064.024348:0:45770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f400, rc 0) 00000100:00100000:0.0:1788270064.024402:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262621696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270064.024411:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788270064.024690:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788270064.024707:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08daa expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.024716:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08daa expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270064.024780:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.024806:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270064.024893:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295780 going to sleep for 11 seconds 00000100:00100000:0.0:1788270064.024944:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621824 00000100:00100000:0.0:1788270064.024949:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621824 00000100:00100000:0.0:1788270064.024982:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788270064.024990:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262621824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788270064.025157:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262621824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270064.025164:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788270064.025341:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.025373:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.025427:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270064.025456:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270064.025506:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262621952 00000100:00100000:2.0:1788270064.025510:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262621952 00000100:00100000:2.0:1788270064.025534:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788270064.025541:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262621952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788270064.025638:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262621952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270064.025645:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788270064.025789:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262621952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788270064.026754:0:48819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788270064.027001:0:45773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788270064.027022:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788270064.027034:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08daa expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.027064:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9f000/0xc5f5d7a016e08da3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08daa expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788270064.027075:0:45773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788270064.027078:0:45773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c265eb0800 from 13 10000000:01000000:3.0:1788270064.027081:0:45773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788270064.027126:0:45773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.027135:0:45773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270064.027147:0:45773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270064.027168:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262622080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.027234:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270064.027274:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270064.027435:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262622080 00000100:00100000:2.0:1788270064.027442:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262622080 00000100:00100000:2.0:1788270064.027488:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788270064.027497:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+23:45773:x1875136262622080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788270064.027511:0:45771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270064.027526:0:45771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e08db8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e08db1 expref: -99 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.027552:0:45771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e08db8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e08db1 expref: 24 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.027563:0:45771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26ab5ca00/0xc5f5d7a016e08db8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e08db1 expref: 24 pid: 45771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.027574:0:45771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ca00, rc 0) 00000100:00100000:2.0:1788270064.027624:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262622080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270064.027631:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788270064.027706:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262622080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788270064.027720:0:45773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08db8 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270064.027728:0:45773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e08db8 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270064.027783:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262622208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.027887:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270064.027917:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270064.027969:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262622208 00000100:00100000:3.0:1788270064.027975:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262622208 00000100:00100000:3.0:1788270064.028012:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788270064.028020:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262622208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788270064.028182:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262622208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270064.028190:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788270064.028357:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262622208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.028389:0:45773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262622336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.028444:0:45773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270064.028472:0:45773:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270064.028486:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262622336 00000100:00100000:1.0:1788270064.028490:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262622336 00000100:00100000:1.0:1788270064.028513:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788270064.028521:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262622336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788270064.028596:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:45773:x1875136262622336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270064.028603:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788270064.028643:0:45773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5051c9b2-4d56-4172-904c-6f13b6100451:45773:1875136262622336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788270064.031375:0:48820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788270064.031642:0:45773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788270064.031675:0:45773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788270064.031690:0:45773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08db8 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.031705:0:45773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff98c143b9e600/0xc5f5d7a016e08db1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e08db8 expref: -99 pid: 45773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270064.069535:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270065.002112:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.002374:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253138944 00000100:00100000:1.0:1788270065.002385:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253138944 00000100:00100000:1.0:1788270065.002526:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788270065.002539:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34542:x1875136253138944:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788270065.002794:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34542:x1875136253138944:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 257us (690us total) trans 30064771115 rc 0/0 00000100:00100000:1.0:1788270065.002802:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00080000:3.0:1788270065.002998:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270065.008858:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.011180:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253139072 00000100:00100000:1.0:1788270065.011207:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253139072 00000100:00100000:1.0:1788270065.011281:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788270065.011293:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34542:x1875136253139072:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270065.011317:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270065.011339:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e08dbf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101931 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011406:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011420:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011432:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011449:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011456:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011463:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011540:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011549:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011568:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270065.011608:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:1.0:1788270065.011612:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270065.011631:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011642:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011649:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011660:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011667:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011673:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270065.011677:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011696:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011709:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270065.011712:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270065.011716:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011723:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08dc6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011737:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011743:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011749:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011755:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270065.011758:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011764:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011771:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c143878000) 00010000:00010000:1.0:1788270065.011773:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270065.011776:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011782:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08dcd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011810:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e08dbf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101931 expref: 22 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011824:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101931 expref: 21 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.011831:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:1.0:1788270065.011834:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270065.011836:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a800, rc 0) 00000100:00100000:1.0:1788270065.012220:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253139072:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 929us (3370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270065.012228:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:0.0:1788270065.016523:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.016573:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253139328 00000100:00100000:3.0:1788270065.016584:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253139328 00000100:00100000:3.0:1788270065.016639:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:3.0:1788270065.016650:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253139328:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788270065.016702:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270065.016727:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e08dd4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101931 expref: 21 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016747:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:3.0:1788270065.016753:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270065.016778:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016792:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016802:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016815:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016822:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016829:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016902:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016911:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.016919:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270065.017232:0:48110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].3, 64 off8408 00000004:00080000:3.0:1788270065.017243:0:48110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 856724203250ns, next at 857724199532ns, rc = 0 00010000:00010000:3.0:1788270065.017290:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017299:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017307:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017315:0:48110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017321:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017328:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017356:0:48110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270065.017376:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017383:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017391:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017398:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.017399:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270065.017402:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.017407:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017412:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.017420:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270065.017427:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270065.017428:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017434:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788270065.017440:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.017442:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017449:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08de9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017463:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017476:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.017481:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270065.017487:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270065.017492:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017494:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017509:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.017509:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08df0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017515:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017532:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.017538:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270065.017541:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270065.017543:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270065.017543:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270065.017548:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270065.017552:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017558:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ddb lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270065.017568:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1c63532 reply state 00000000b1a50474 transno 30064771116 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017578:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.017585:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c1429f8400) 00010000:00010000:3.0:1788270065.017587:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270065.017589:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270065.017663:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253139328:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 1014us (1148us total) trans 30064771116 rc 0/0 00000100:00100000:3.0:1788270065.017671:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788270065.023769:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.024247:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253139456 00000100:00100000:2.0:1788270065.024258:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253139456 00000100:00100000:2.0:1788270065.024317:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:2.0:1788270065.024327:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253139456:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270065.024348:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270065.024367:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08df7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101938 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024419:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024430:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024439:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024448:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024452:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024456:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024492:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024500:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024507:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024512:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.024516:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024524:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024536:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270065.024538:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.024541:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024545:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08dfe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024553:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024557:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024560:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024563:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.024565:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024569:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024573:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c1429fa700) 00010000:00010000:2.0:1788270065.024574:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.024575:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024578:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e05 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024601:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08df7 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101938 expref: 23 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024607:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270065.024608:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.024610:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08df7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101938 expref: 23 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.024615:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d200, rc 0) 00000100:00100000:2.0:1788270065.024668:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253139456:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 342us (907us total) trans 0 rc 301/301 00000100:00100000:2.0:1788270065.024675:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:0.0:1788270065.026489:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.026866:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253139584 00000100:00100000:1.0:1788270065.026874:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253139584 00000100:00100000:1.0:1788270065.026927:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788270065.026948:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253139584:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270065.026965:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270065.026981:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e08e0c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610193f expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027036:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027066:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027076:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027091:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027098:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027105:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027135:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027142:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027149:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027155:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270065.027160:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027167:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027178:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270065.027181:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270065.027185:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027202:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08e13 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027216:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027222:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027228:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027233:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270065.027236:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027242:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027249:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c143878000) 00010000:00010000:1.0:1788270065.027251:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270065.027255:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027260:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e08e1a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027302:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e08e0c lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610193f expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027312:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270065.027315:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270065.027319:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e08e0c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610193f expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.027327:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b600, rc 0) 00000100:00100000:1.0:1788270065.027379:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253139584:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 434us (896us total) trans 0 rc 301/301 00000100:00100000:1.0:1788270065.027386:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:0.0:1788270065.033569:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.033828:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253139840 00000100:00100000:3.0:1788270065.033838:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253139840 00000100:00100000:3.0:1788270065.033938:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:3.0:1788270065.033950:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253139840:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270065.033970:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270065.033989:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08e21 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101946 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034119:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034134:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034146:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034161:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034169:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034176:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034594:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034604:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034616:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270065.034626:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788270065.034650:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034657:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034663:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034668:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270065.034673:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034679:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034691:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270065.034694:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270065.034699:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034704:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08e28 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270065.034714:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eae0fd9b reply state 0000000078c19339 transno 30064771117 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034729:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034735:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c1429f8b00) 00010000:00010000:3.0:1788270065.034737:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270065.034739:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270065.034765:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08e21 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 25 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034779:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 24 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.034786:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:3.0:1788270065.034788:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788270065.034790:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f400, rc 0) 00000100:00100000:3.0:1788270065.034854:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253139840:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 906us (1294us total) trans 30064771117 rc 0/0 00000100:00100000:3.0:1788270065.034861:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:0.0:1788270065.040152:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.040251:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253140096 00000100:00100000:2.0:1788270065.040262:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253140096 00000100:00100000:2.0:1788270065.040332:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:2.0:1788270065.040344:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253140096:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270065.040561:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.040577:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.040588:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270065.040628:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771118 00000004:00010000:2.0:1788270065.040661:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a155032 reply state 0000000053322ab3 transno 30064771119 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.040674:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.040682:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:2.0:1788270065.040685:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270065.040688:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270065.040761:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253140096:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 420us (620us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1788270065.040766:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000020:00080000:2.0:1788270065.040770:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270065.042655:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.042886:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253140352 00000100:00100000:0.0:1788270065.042894:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253140352 00000100:00100000:0.0:1788270065.043033:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:0.0:1788270065.043069:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253140352:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270065.043096:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270065.043113:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08e4b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610194d expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043208:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043234:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043244:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043260:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043267:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043279:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043664:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043673:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043680:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270065.043690:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 0 00010000:00010000:0.0:1788270065.043714:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043721:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043728:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043734:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.043739:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043745:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043755:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270065.043758:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270065.043762:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043767:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e52 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270065.043777:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af86406e reply state 000000009d7073cf transno 30064771120 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043785:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043790:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c1429f1f00) 00010000:00010000:0.0:1788270065.043792:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270065.043794:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270065.043817:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08e4b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043829:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.043836:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:0.0:1788270065.043838:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270065.043840:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f800, rc 0) 00000100:00100000:0.0:1788270065.043888:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:34542:x1875136253140352:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 846us (1236us total) trans 30064771120 rc 0/0 00000100:00100000:0.0:1788270065.043895:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:0.0:1788270065.049421:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.049494:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253140608 00000100:00100000:3.0:1788270065.049504:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253140608 00000100:00100000:3.0:1788270065.049565:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:3.0:1788270065.049576:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:34542:x1875136253140608:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788270065.049793:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.049810:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.049826:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270065.049867:0:48110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771121 00000004:00010000:3.0:1788270065.049888:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bafc16e4 reply state 000000007f493478 transno 30064771122 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.049901:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.049909:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:3.0:1788270065.049912:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270065.049914:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270065.049992:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:34542:x1875136253140608:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 417us (580us total) trans 30064771122 rc 0/0 00000100:00100000:3.0:1788270065.049999:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000020:00080000:3.0:1788270065.050004:0:48110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270065.056867:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.056959:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253140864 00000100:00100000:2.0:1788270065.056968:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253140864 00000100:00100000:2.0:1788270065.057082:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:2.0:1788270065.057094:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34548:x1875136253140864:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270065.057116:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270065.057137:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e75 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101954 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057250:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057265:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057276:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057288:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057296:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057304:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057410:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08e8a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057419:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08e8a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057427:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08e8a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270065.057436:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:2.0:1788270065.057507:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057519:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057526:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057532:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.057537:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057544:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057556:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270065.057558:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.057563:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057569:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08e7c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057580:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057586:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057591:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057596:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.057600:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057605:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057612:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c1429f1f00) 00010000:00010000:2.0:1788270065.057614:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.057617:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057623:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08e83 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057658:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08e75 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101954 expref: 12 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057670:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08e8a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101954 expref: 11 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.057676:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:2.0:1788270065.057678:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270065.057681:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:2.0:1788270065.057732:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+11:34548:x1875136253140864:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 640us (874us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1788270065.057740:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00080000:3.0:1788270065.057840:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270065.062549:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.062913:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253141120 00000100:00100000:0.0:1788270065.062923:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253141120 00000100:00100000:0.0:1788270065.062983:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:0.0:1788270065.062995:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+11:34548:x1875136253141120:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270065.063021:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270065.063071:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08e98 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610195b expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063163:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063178:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063203:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063215:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063223:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063230:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063332:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08ead lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063341:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08ead lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063347:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08ead lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270065.063360:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:0.0:1788270065.063432:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063439:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063446:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063452:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.063457:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063465:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063476:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270065.063480:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270065.063484:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063490:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08e9f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063503:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063509:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063520:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063525:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.063527:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063534:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063541:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c1429f8b00) 00010000:00010000:0.0:1788270065.063544:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270065.063547:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063553:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08ea6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063766:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08e98 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610195b expref: 14 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063782:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08ead lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610195b expref: 13 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.063790:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:0.0:1788270065.063792:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270065.063795:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e400, rc 0) 00000100:00100000:0.0:1788270065.063854:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+13:34548:x1875136253141120:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 863us (1316us total) trans 30064771124 rc 0/0 00000100:00100000:0.0:1788270065.063869:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:1.0:1788270065.067279:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.067893:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253141376 00000100:00100000:3.0:1788270065.067903:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253141376 00000100:00100000:3.0:1788270065.067955:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788270065.067963:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+13:34548:x1875136253141376:12345-192.168.201.42@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788270065.067973:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270065.067993:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08e8a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101954 expref: 13 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.068006:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:3.0:1788270065.068010:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270065.068083:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+12:34548:x1875136253141376:12345-192.168.201.42@tcp:103:mmap_sanity.0 Request processed in 120us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270065.068090:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788270065.071293:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.071394:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253141504 00000100:00100000:2.0:1788270065.071403:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253141504 00000100:00100000:2.0:1788270065.071473:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:2.0:1788270065.071484:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+12:34548:x1875136253141504:12345-192.168.201.42@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788270065.071582:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.071599:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 33 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.071609:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.071653:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 33 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.071667:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 33 pid: 45778 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.071681:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262622464:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270065.071755:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1424950c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270065.075016:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262622464:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270065.075071:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270065.079418:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.079529:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253141632 00000100:00100000:3.0:1788270065.079539:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253141632 00010000:00010000:3.0:1788270065.079588:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 34 pid: 45778 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.079642:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788270065.079705:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:2401:x1875136253141632:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270065.079722:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270065.079740:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 34 pid: 45778 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.079755:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 34 pid: 45778 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.079783:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e08e60 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610194d expref: 34 pid: 45778 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.079804:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:3.0:1788270065.079810:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.079820:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.079828:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.079860:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270065.079888:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.079899:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.079921:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:2401:x1875136253141632:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 268us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270065.079929:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000040:00080000:2.0:1788270065.080005:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].2, 136 off8464 00000100:00100000:2.0:1788270065.080103:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+12:34548:x1875136253141504:12345-192.168.201.42@tcp:58:mmap_sanity.0 Request processed in 8620us (8817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.080112:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:1.0:1788270065.081551:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.081626:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253141760 00000100:00100000:0.0:1788270065.081634:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253141760 00000100:00100000:0.0:1788270065.081677:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:0.0:1788270065.081686:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+12:34548:x1875136253141760:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270065.081703:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270065.081719:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101962 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.081765:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.081776:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 13 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.081803:0:45777:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.081816:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 13 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.081831:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:0.0:1788270065.081834:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270065.081838:0:45777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 13 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.081846:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f000, rc 0) 00000100:00100000:0.0:1788270065.081890:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+13:34548:x1875136253141760:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 201us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.081898:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00010000:00010000:0.0:1788270065.092301:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270065.348607:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270065.348631:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262622592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270065.348696:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270065.348825:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262622592 00000100:00100000:2.0:1788270065.348833:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262622592 00000100:00100000:2.0:1788270065.348934:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788270065.348944:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262622592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270065.348972:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 425984 granted 25157312 pending 0 free 3923087360 avail 3691565056 00000100:00100000:2.0:1788270065.349021:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262622592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.349029:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788270065.349093:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262622592:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788270065.349144:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788270065.540253:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270065.540262:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270065.540287:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 3 count 3 00000040:00080000:2.0:1788270065.540309:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270065.540456:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262622720:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788270065.540863:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1424950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270065.543598:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.543788:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262622720:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270065.545409:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253141888 00000100:00100000:0.0:1788270065.545421:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253141888 00000100:00100000:0.0:1788270065.545495:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788270065.545507:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34549:x1875136253141888:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788270065.545541:0:45778:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788270065.545666:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34549:x1875136253141888:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 161us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.545674:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788270065.556598:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.556682:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253142016 00000100:00100000:2.0:1788270065.556692:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253142016 00000100:00100000:2.0:1788270065.556825:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788270065.556837:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34549:x1875136253142016:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.556908:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.556924:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.556940:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.556956:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.556963:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.556970:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.556993:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557002:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557009:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270065.557083:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:2.0:1788270065.557087:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270065.557099:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557107:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557111:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557118:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557123:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.557126:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557130:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557138:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:2.0:1788270065.557140:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.557142:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557145:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08ec9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557154:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557158:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557161:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557164:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.557166:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557171:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557175:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x20b1fb9b (ffff98c1429fa700) 00010000:00010000:2.0:1788270065.557176:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.557200:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557206:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ed0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557220:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557226:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557231:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557236:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.557239:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557245:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557252:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:2.0:1788270065.557254:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.557257:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.557266:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08ed7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.557340:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34549:x1875136253142016:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 505us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.557348:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788270065.560682:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.560763:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253142272 00000100:00100000:3.0:1788270065.560773:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253142272 00000100:00100000:3.0:1788270065.560839:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:3.0:1788270065.560849:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34549:x1875136253142272:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270065.560869:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270065.560889:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ede lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101969 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.560988:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561003:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561013:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270065.561024:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:3.0:1788270065.561137:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561146:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561157:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561163:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270065.561167:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561175:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561214:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:3.0:1788270065.561217:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270065.561221:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561228:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08ee5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561265:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ede lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101969 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561276:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:3.0:1788270065.561278:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270065.561282:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08ede lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101969 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.561291:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f800, rc 0) 00000100:00100000:3.0:1788270065.561350:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:34549:x1875136253142272:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 503us (678us total) trans 30064771125 rc 301/301 00000100:00100000:3.0:1788270065.561361:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:1.0:1788270065.565306:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.565355:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253142400 00000100:00100000:0.0:1788270065.565366:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253142400 00000100:00100000:0.0:1788270065.565428:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:0.0:1788270065.565439:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:34549:x1875136253142400:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788270065.565474:0:45778:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788270065.565599:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:34549:x1875136253142400:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 162us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.565608:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:1.0:1788270065.567810:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.568261:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253142656 00000100:00100000:2.0:1788270065.568270:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253142656 00000100:00100000:2.0:1788270065.568324:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:2.0:1788270065.568333:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:34549:x1875136253142656:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.568350:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270065.568371:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ef3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101970 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270065.568731:0:46770:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0xa3:0x0], count =31 00000004:00080000:2.0:1788270065.568738:0:46770:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0xa3:0x0]+31 in llog 00000004:00080000:2.0:1788270065.568753:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc2:0x0], index 1: 0 00010000:00010000:2.0:1788270065.568884:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08efa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.568898:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08efa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.568910:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08efa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.568962:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08ef3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101970 expref: 37 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.568980:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08efa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101970 expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.568988:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429fa700) 00010000:00010000:2.0:1788270065.568992:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270065.568995:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:2.0:1788270065.569091:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34549:x1875136253142656:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 758us (1295us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1788270065.569098:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:2.0:1788270065.573165:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.573229:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253142912 00000100:00100000:0.0:1788270065.573240:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253142912 00000100:00100000:0.0:1788270065.573340:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:0.0:1788270065.573351:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34549:x1875136253142912:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270065.573417:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270065.573442:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08efa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101970 expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573461:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429fa700) 00010000:00010000:0.0:1788270065.573471:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270065.573503:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573518:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573527:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573541:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573548:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573554:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573603:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573610:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573616:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573623:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.573628:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573634:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573643:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270065.573645:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270065.573649:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573655:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e08f08 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573665:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573671:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573677:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573682:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270065.573685:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573691:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573702:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xa5013edf (ffff98c1429f1200) 00010000:00010000:0.0:1788270065.573704:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270065.573707:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.573712:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f0f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa5013edf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.573793:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34549:x1875136253142912:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 443us (634us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270065.573800:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:1.0:1788270065.578605:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.578683:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253143040 00000100:00100000:0.0:1788270065.578704:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253143040 00000100:00100000:0.0:1788270065.578769:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:0.0:1788270065.578779:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34549:x1875136253143040:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270065.578798:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270065.578821:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e08f16 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101977 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.578867:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.578881:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.578892:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.579006:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e08f16 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 37 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.579025:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 36 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.579033:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:0.0:1788270065.579036:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270065.579064:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270065.579567:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34549:x1875136253143040:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 349us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.579576:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:1.0:1788270065.585268:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.585466:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253143296 00000100:00100000:3.0:1788270065.585477:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253143296 00000100:00100000:2.0:1788270065.585563:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:2.0:1788270065.585577:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34549:x1875136253143296:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.585662:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.585680:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.585704:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270065.585870:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].2, 88 off8344 00000004:00080000:2.0:1788270065.585880:0:45777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 857292840103ns, next at 858292837691ns, rc = 0 00000004:00010000:2.0:1788270065.585926:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7a19a83 reply state 00000000430b94b2 transno 30064771127 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.585939:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.585946:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:2.0:1788270065.585949:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270065.585952:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270065.586078:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34549:x1875136253143296:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 467us (782us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1788270065.586086:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:1.0:1788270065.587557:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.587635:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253143424 00000100:00100000:0.0:1788270065.587644:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253143424 00000100:00100000:0.0:1788270065.587695:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:0.0:1788270065.587704:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34549:x1875136253143424:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270065.587723:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270065.587736:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610197e expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.587791:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.587804:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.587822:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:0.0:1788270065.587825:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270065.587829:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fc00, rc 0) 00000100:00100000:0.0:1788270065.587876:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34549:x1875136253143424:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 173us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.587881:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:1.0:1788270065.589711:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.589776:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253143552 00000100:00100000:2.0:1788270065.589785:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253143552 00000100:00100000:2.0:1788270065.589850:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788270065.589861:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2400:x1875136253143552:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788270065.590140:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270065.590173:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253143552:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 314us (466us total) trans 30064771075 rc 0/0 00000100:00100000:2.0:1788270065.590190:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788270065.592700:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.592795:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253143808 00000100:00100000:2.0:1788270065.592804:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253143808 00000100:00100000:2.0:1788270065.592918:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788270065.592928:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34549:x1875136253143808:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270065.593361:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34549:x1875136253143808:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 435us (667us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1788270065.593368:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788270065.595684:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.595739:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144064 00000100:00100000:0.0:1788270065.595747:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144064 00000100:00100000:0.0:1788270065.595791:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788270065.595800:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34549:x1875136253144064:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788270065.595894:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34549:x1875136253144064:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.595901:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:1.0:1788270065.597143:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.597371:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144192 00000100:00100000:2.0:1788270065.597378:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144192 00000100:00100000:2.0:1788270065.597437:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:2.0:1788270065.597448:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34549:x1875136253144192:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.597472:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270065.597493:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08f32 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101985 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.597570:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08f39 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.597585:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08f39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.597598:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08f39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270065.597641:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270065.597662:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08f39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.597688:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08f32 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101985 expref: 42 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.597703:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08f39 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101985 expref: 41 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.597709:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:2.0:1788270065.597711:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270065.597713:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:2.0:1788270065.597763:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34549:x1875136253144192:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 314us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.597771:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:1.0:1788270065.602320:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.602376:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144320 00000100:00100000:2.0:1788270065.602387:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144320 00000100:00100000:2.0:1788270065.602450:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788270065.602462:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253144320:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.602479:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270065.602498:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610198c expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270065.602522:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d5f1, blocks: 0x0 00010000:00010000:2.0:1788270065.602541:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=857s v=(0 0) 00010000:00010000:2.0:1788270065.602545:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270065.602555:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 7 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.602574:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 7 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.602587:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:2.0:1788270065.602649:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253144320:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 189us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.602657:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788270065.610550:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.610689:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144576 00000100:00100000:2.0:1788270065.610699:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144576 00000100:00100000:2.0:1788270065.610758:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:2.0:1788270065.610977:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34549:x1875136253144576:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270065.611137:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34549:x1875136253144576:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 369us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.611145:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:1.0:1788270065.619244:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.622313:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144704 00000100:00100000:0.0:1788270065.622327:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144704 00000100:00100000:0.0:1788270065.622396:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788270065.622406:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34549:x1875136253144704:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270065.622421:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270065.622438:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101993 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.622470:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 8 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.622479:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270065.622483:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270065.622488:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 8 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.622529:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 8 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.622543:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 8 pid: 47281 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.622556:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262622848:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270065.622636:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270065.627448:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.627512:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144832 00000100:00100000:2.0:1788270065.627519:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144832 00010000:00010000:2.0:1788270065.627552:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 9 pid: 47281 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.627597:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788270065.627607:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253144832:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270065.627620:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270065.627636:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 9 pid: 47281 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.627647:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 9 pid: 47281 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.627665:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270065.627669:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270065.627675:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 9 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.627681:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 9 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.627708:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 9 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.627719:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262622976:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270065.627787:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788270065.627993:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004316307a/0xc5f5d7a016e08f40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610198c expref: 9 pid: 47281 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.628004:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262622848:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270065.628023:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 8 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.628030:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f600, rc 0) 00000100:00100000:0.0:1788270065.628119:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:34549:x1875136253144704:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 5714us (8885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.628124:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788270065.634090:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262622976:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270065.634118:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270065.634221:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253144832:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 6614us (6778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.634233:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:1.0:1788270065.636272:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.636326:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253144960 00000100:00100000:2.0:1788270065.636335:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253144960 00002000:00100000:2.0:1788270065.636383:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->409599) req@ffff98c27c2c6a00 x1875136253144960/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788270065.636392:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c6a00 with x1875136253144960 ext(0->409599) 00002000:00010000:2.0:1788270065.636396:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c6a00 00000100:00100000:2.0:1788270065.636447:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788270065.636455:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253144960:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270065.645921:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253144960:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 9457us (9646us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788270065.645932:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00002000:00100000:2.0:1788270065.645943:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->409599) req@ffff98c27c2c6a00 x1875136253144960/t30064771076(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:481/0 lens 488/448 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788270065.645950:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c6a00 with x1875136253144960 ext(0->409599) 00002000:00010000:2.0:1788270065.645955:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c6a00 00000100:00100000:0.0:1788270065.647523:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.647605:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253145088 00000100:00100000:1.0:1788270065.647612:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253145088 00000100:00100000:1.0:1788270065.647655:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:1.0:1788270065.647662:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34549:x1875136253145088:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788270065.649618:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771128 is committed 00000004:00080000:0.0:1788270065.649630:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788270065.649657:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771124 is committed 00010000:00010000:2.0:1788270065.649674:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270065.649676:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:2.0:1788270065.649690:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649700:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788270065.649705:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c249a239c0 refcount 2 committed 0 result 0 batchid 25769803836 00010000:00010000:2.0:1788270065.649708:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e200 already unused, calling callback (ffffffffc1aac4f0) 00000020:00080000:0.0:1788270065.649712:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c1449c4900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c249a23540 00010000:00010000:2.0:1788270065.649715:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788270065.649717:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c1449c4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c247997800 00010000:00010000:2.0:1788270065.649729:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649747:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff98c2515e9f00) 00010000:00010000:2.0:1788270065.649751:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.649756:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788270065.649762:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803836 committed batchid 21474836492 00010000:00010000:2.0:1788270065.649763:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e08d41 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649794:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649802:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649809:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649814:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.649818:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788270065.649825:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836492 00010000:00010000:2.0:1788270065.649833:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649842:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff98c1429f8400) 00010000:00010000:2.0:1788270065.649844:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.649847:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649851:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e08de2 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649862:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649866:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649869:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649872:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.649874:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649877:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649881:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c1429f8b00) 00010000:00010000:2.0:1788270065.649882:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.649883:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649887:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08e2f lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649895:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649898:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649902:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649905:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.649906:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649909:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649913:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:2.0:1788270065.649914:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.649915:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649918:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08e44 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649926:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649931:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649938:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649943:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.649945:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649952:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649959:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c1429f1f00) 00010000:00010000:2.0:1788270065.649962:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.649965:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649971:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e08e59 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649984:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649991:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.649996:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.650002:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.650004:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.650015:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.650022:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:2.0:1788270065.650024:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.650027:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.650033:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08e6e lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.650169:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262623104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788270065.650268:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:34549:x1875136253145088:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 2604us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270065.650280:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:0.0:1788270065.650280:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270065.650340:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262623104 00000100:00100000:0.0:1788270065.650346:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262623104 00000100:00100000:0.0:1788270065.650396:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788270065.650406:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262623104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788270065.650428:0:47283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:194 count 1 00010000:00010000:0.0:1788270065.650449:0:47283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.650469:0:47283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 5 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.650478:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788270065.650484:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270065.650489:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 4/0,1 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.650509:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262623232:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788270065.650525:0:47283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 5 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.650541:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270065.650547:0:47283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 5 pid: 48231 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.650561:0:47283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:47283:1875136262623360:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270065.650591:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262623232 00000100:00100000:3.0:1788270065.650596:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262623232 00000100:00100000:0.0:1788270065.650612:0:47283:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270065.650633:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788270065.650640:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262623232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788270065.650724:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:3.0:1788270065.650781:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788270065 00002000:00010000:3.0:1788270065.650784:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270065.650795:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb ctime from disk: 1788270065 -> 1788270065 00002000:00010000:3.0:1788270065.650797:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb blocks from disk: 0 -> 800 00000100:00100000:3.0:1788270065.650829:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262623232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (288us total) trans 30064771077 rc 0/0 00000100:00100000:3.0:1788270065.650836:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788270065.650855:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270065.650860:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788270065.650884:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27d7ddf80/2, rc 0, transno 30064771077 00000100:00100000:0.0:1788270065.650892:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262623232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788270065.652247:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:2.0:1788270065.652395:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.652405:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.652411:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.652418:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.652422:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.652429:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.652443:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:2.0:1788270065.652445:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270065.652449:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.652461:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08f24 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270065.652505:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253145216 00000100:00100000:1.0:1788270065.652512:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253145216 00000100:00100000:1.0:1788270065.652681:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788270065.652691:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253145216:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788270065.654464:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270065.654496:0:47283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:47283:1875136262623360:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270065.654522:0:47283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.654523:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253145344 00000100:00100000:3.0:1788270065.654531:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253145344 00010000:00010000:3.0:1788270065.654583:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 6 pid: 48231 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.654619:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788270065.654629:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253145344:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270065.654641:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270065.654647:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 6 pid: 48231 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654659:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 6 pid: 48231 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654681:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e08d6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610191c expref: 6 pid: 48231 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654696:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270065.654700:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270065.654706:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654715:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654742:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:2.0:1788270065.654776:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771077 is committed 00000001:00080000:2.0:1788270065.654785:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771076 is committed 00000100:00080000:1.0:1788270065.654847:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270065.654927:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253145344:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 299us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270065.654936:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00010000:00010000:3.0:1788270065.654965:0:47283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654975:0:47283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654986:0:47283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.654994:0:47283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.655015:0:47283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270065.655076:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270065.655085:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.655094:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ee00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270065.655097:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.655104:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.655117:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.655125:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a40974/0xc5f5d7a016e08f4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.655142:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270065.655152:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270065.655155:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270065.655233:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262623104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4828us (4955us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788270065.655242:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1788270065.655261:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c2c5180/2, rc 0, transno 30064771080 00000100:00100000:2.0:1788270065.655269:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262623104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788270065.655558:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253145216:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 2867us (3313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270065.655566:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788270065.659200:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.659399:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253145600 00000100:00100000:2.0:1788270065.659408:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253145600 00000100:00100000:2.0:1788270065.659457:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:2.0:1788270065.659465:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34549:x1875136253145600:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.659513:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270065.659536:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08f39 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101985 expref: 14 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.659550:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:2.0:1788270065.659553:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270065.659579:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.659593:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.659603:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270065.659718:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001246239c reply state 0000000074d37f04 transno 30064771129 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.659731:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.659738:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:2.0:1788270065.659741:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270065.659743:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270065.659838:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34549:x1875136253145600:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 373us (660us total) trans 30064771129 rc 0/0 00000100:00100000:2.0:1788270065.659848:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:0.0:1788270065.661914:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.661954:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253145728 00000100:00100000:3.0:1788270065.661963:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253145728 00000100:00100000:3.0:1788270065.662003:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788270065.662012:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253145728:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788270065.662169:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:3.0:1788270065.662173:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb mtime from disk: 1788270065 -> 1788270065 00002000:00010000:3.0:1788270065.662188:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb atime from disk: 0 -> 1788270065 00002000:00010000:3.0:1788270065.662191:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb ctime from disk: 1788270065 -> 1788270065 00002000:00010000:3.0:1788270065.662193:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb blocks from disk: 800 -> 800 00000100:00100000:3.0:1788270065.662255:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253145728:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 236us (339us total) trans 30064771078 rc 0/0 00000100:00100000:3.0:1788270065.662263:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788270065.664009:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.664298:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253145984 00000100:00100000:3.0:1788270065.664306:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253145984 00000100:00100000:3.0:1788270065.664346:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:3.0:1788270065.664354:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34549:x1875136253145984:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788270065.664413:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.664431:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 15 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.664441:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.664473:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 15 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.664486:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 15 pid: 45778 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.664500:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262623488:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270065.664798:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24aa70600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270065.669258:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.669331:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253146112 00000100:00100000:1.0:1788270065.669341:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253146112 00010000:00010000:1.0:1788270065.669378:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 16 pid: 45778 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270065.669419:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:1.0:1788270065.669431:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253146112:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270065.669446:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270065.669452:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 16 pid: 45778 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.669466:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 16 pid: 45778 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.669488:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:1.0:1788270065.669494:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.669502:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.669510:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.669531:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270065.669581:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253146112:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270065.669589:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00010000:00010000:3.0:1788270065.669750:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08f1d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101977 expref: 15 pid: 45778 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.669766:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262623488:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270065.669785:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669794:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669804:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669840:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669848:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669855:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669861:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270065.669866:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669873:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669883:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:3.0:1788270065.669886:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788270065.669890:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.669896:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f5c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.669946:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34549:x1875136253145984:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 5592us (5942us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788270065.669954:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:0.0:1788270065.670973:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.671030:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253146240 00000100:00100000:2.0:1788270065.671035:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253146240 00000100:00100000:2.0:1788270065.671168:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788270065.671174:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253146240:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788270065.671216:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.671231:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 7 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.671237:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270065.671240:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270065.671243:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.671269:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 7 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.671278:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 7 pid: 48230 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.671288:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262623616:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270065.671345:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788270065.672617:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262623616:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270065.672638:0:47281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.673844:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.673890:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253146368 00000100:00100000:2.0:1788270065.673897:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253146368 00010000:00010000:2.0:1788270065.673924:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 8 pid: 48230 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.673954:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788270065.673963:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253146368:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270065.673976:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270065.673995:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 8 pid: 48230 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.674004:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 8 pid: 48230 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.674021:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000581f3394/0xc5f5d7a016e08f47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101993 expref: 8 pid: 48230 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.674033:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270065.674036:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270065.674069:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.674079:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.674105:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270065.674124:0:47281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674136:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270065.674150:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253146368:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 188us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.674156:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00010000:00010000:0.0:1788270065.674157:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674168:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674190:0:47281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674199:0:47281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270065.674203:0:47281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674213:0:47281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674226:0:47281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270065.674233:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f28482d/0xc5f5d7a016e08f63 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.674392:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253146240:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 3216us (3418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.674401:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:0.0:1788270065.675806:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.675881:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253146624 00000100:00100000:1.0:1788270065.675889:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253146624 00000100:00100000:1.0:1788270065.675936:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:1.0:1788270065.675947:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34549:x1875136253146624:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788270065.676015:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676031:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676069:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676254:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676266:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 15 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676274:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676306:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 15 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.676324:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 15 pid: 45776 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270065.676337:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262623744:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270065.676406:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270065.682702:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.682792:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262623744:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270065.682815:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.682867:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253146752 00000100:00100000:3.0:1788270065.682873:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253146752 00010000:00010000:3.0:1788270065.682901:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 16 pid: 45776 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.682929:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788270065.683004:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253146752:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270065.683015:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270065.683020:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 16 pid: 45776 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.683029:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 16 pid: 45776 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.683072:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e08f2b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610197e expref: 16 pid: 45776 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.683085:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:3.0:1788270065.683088:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.683095:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.683100:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.683116:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270065.683155:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253146752:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 220us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270065.683161:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00010000:00010000:2.0:1788270065.683223:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.683231:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270065.683340:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771130 00000001:00080000:2.0:1788270065.683444:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771131 00000001:00080000:2.0:1788270065.683480:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771132 00000100:00100000:2.0:1788270065.683554:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262623872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788270065.683596:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270065.683625:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270065.683642:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262623872 00000100:00100000:0.0:1788270065.683648:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262623872 00000100:00100000:0.0:1788270065.683734:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788270065.683818:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262623872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788270065.683979:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262623872:12345-0@lo:1000:mdt00_002.0 Request processed in 238us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.683987:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788270065.684024:0:45778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771077 gen 2 00000004:00080000:2.0:1788270065.684030:0:45778:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27d7ddf80, transno 30064771077 00000100:00100000:2.0:1788270065.684081:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262623872:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788270065.684193:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771133 00000100:00100000:2.0:1788270065.684235:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262624000:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788270065.684262:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270065.684288:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270065.684341:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262624000 00000100:00100000:1.0:1788270065.684345:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262624000 00000100:00100000:1.0:1788270065.684380:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788270065.684389:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262624000:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788270065.684490:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45778:x1875136262624000:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (227us total) trans 30064771079 rc 0/0 00000100:00100000:1.0:1788270065.684497:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788270065.684526:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262624000:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788270065.684552:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684568:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684575:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684581:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19be00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270065.684587:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684599:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684612:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:1.0:1788270065.684615:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270065.684619:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684624:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e08f71 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684647:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684654:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684659:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684664:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270065.684667:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684673:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684681:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:1.0:1788270065.684683:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270065.684689:0:45778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684704:0:45778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684711:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.684735:0:45778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270065.684746:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262624128:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788270065.684853:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270065.689506:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.689571:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253146880 00000100:00100000:3.0:1788270065.689580:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253146880 00000100:00100000:3.0:1788270065.689637:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788270065.689647:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253146880:12345-192.168.201.42@tcp:49:mmap_sanity.0 00000100:00100000:3.0:1788270065.689758:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253146880:12345-192.168.201.42@tcp:49:mmap_sanity.0 Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270065.689764:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788270065.689906:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262624128:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270065.689925:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689933:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e08ebb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689958:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689969:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689977:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689983:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689987:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689991:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.689995:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.689997:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690001:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690011:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:2.0:1788270065.690013:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270065.690015:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690019:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f78 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690024:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690027:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690030:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690033:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270065.690035:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690246:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690252:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:2.0:1788270065.690254:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270065.690256:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.690259:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e08f6a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270065.690463:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270065.690468:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270065.690505:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 3 count 3 00000040:00080000:0.0:1788270065.690512:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270065.690584:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:34549:x1875136253146624:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 14638us (14781us total) trans 30064771134 rc 0/0 00000100:00100000:2.0:1788270065.690593:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000020:00080000:2.0:1788270065.690597:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788270065.692173:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.693292:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147008 00000100:00100000:2.0:1788270065.693303:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147008 00000100:00100000:2.0:1788270065.693361:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00080000:0.0:1788270065.693404:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270065.693430:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34548:x1875136253147008:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270065.693449:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270065.693470:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610199a expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270065.693494:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a96d5f1, atime: 0x6a96d5f1, ctime: 0x6a96d5f1, blocks: 0x320 00010000:00010000:2.0:1788270065.693515:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=857s v=(0 0) 00010000:00010000:2.0:1788270065.693520:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270065.693530:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 6 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270065.693546:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 6 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270065.693603:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270065.693677:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147264 00000100:00100000:3.0:1788270065.693681:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147264 00000100:00100000:3.0:1788270065.693718:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788270065.693724:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144b1b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:34549:x1875136253147264:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788270065.693929:0:45780:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788270065.693952:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771135 00010000:00010000:3.0:1788270065.693972:0:45780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.693982:0:45780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.693988:0:45780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.693994:0:45780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.693998:0:45780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.694005:0:45780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270065.694020:0:45780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270065.694063:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270065.694079:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.694086:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270065.694090:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.694096:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270065.694108:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144b1b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34549:x1875136253147264:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 383us (505us total) trans 30064771136 rc 0/0 00010000:00010000:1.0:1788270065.694108:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:1.0:1788270065.694112:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1788270065.694115:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00010000:00010000:1.0:1788270065.694116:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788270065.694119:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788270065.694122:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e08f86 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270065.694132:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270065.694133:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270065.694135:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270065.694662:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:2.0:1788270065.694708:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34548:x1875136253147008:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1337us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270065.694715:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788270065.698603:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.698703:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147392 00000100:00100000:2.0:1788270065.698713:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147392 00002000:00100000:2.0:1788270065.698759:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->4095) req@ffff98c27a6a2a00 x1875136253147392/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.698769:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a2a00 with x1875136253147392 ext(0->4095) 00002000:00010000:2.0:1788270065.698773:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a2a00 00000100:00100000:2.0:1788270065.698851:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788270065.698860:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147392:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.699022:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147392:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 163us (429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788270065.699027:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00002000:00100000:2.0:1788270065.699031:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->4095) req@ffff98c27a6a2a00 x1875136253147392/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/4536 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.699051:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a2a00 with x1875136253147392 ext(0->4095) 00002000:00010000:2.0:1788270065.699056:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a2a00 00000100:00100000:1.0:1788270065.702527:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.702764:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147520 00000100:00100000:2.0:1788270065.702774:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147520 00002000:00100000:2.0:1788270065.702819:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (4096->8191) req@ffff98c27c2c5f80 x1875136253147520/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.702830:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c5f80 with x1875136253147520 ext(4096->8191) 00002000:00010000:2.0:1788270065.702836:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c5f80 00000100:00100000:2.0:1788270065.702915:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788270065.702926:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147520:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.703148:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147520:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 223us (628us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788270065.703155:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00002000:00100000:2.0:1788270065.703162:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (4096->8191) req@ffff98c27c2c5f80 x1875136253147520/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/4536 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.703171:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c5f80 with x1875136253147520 ext(4096->8191) 00002000:00010000:2.0:1788270065.703174:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c5f80 00000100:00100000:0.0:1788270065.705696:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.705825:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147648 00000100:00100000:2.0:1788270065.705834:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147648 00002000:00100000:2.0:1788270065.705875:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (8192->12287) req@ffff98c27a6a1180 x1875136253147648/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.705886:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a1180 with x1875136253147648 ext(8192->12287) 00002000:00010000:2.0:1788270065.705892:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a1180 00000100:00100000:2.0:1788270065.705917:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788270065.705928:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147648:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.706759:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147648:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 831us (1069us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788270065.706768:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00002000:00100000:2.0:1788270065.706776:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (8192->12287) req@ffff98c27a6a1180 x1875136253147648/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/4536 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.706785:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a1180 with x1875136253147648 ext(8192->12287) 00002000:00010000:2.0:1788270065.706789:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a1180 00000100:00100000:0.0:1788270065.710224:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.710331:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147776 00000100:00100000:2.0:1788270065.710339:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147776 00002000:00100000:2.0:1788270065.710384:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (12288->69631) req@ffff98c27a6a1c00 x1875136253147776/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.710396:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a1c00 with x1875136253147776 ext(12288->69631) 00002000:00010000:2.0:1788270065.710401:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a1c00 00000100:00100000:2.0:1788270065.710428:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:2.0:1788270065.710438:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147776:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.712805:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253147776:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 2360us (2581us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1788270065.712818:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00002000:00100000:2.0:1788270065.712828:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (12288->69631) req@ffff98c27a6a1c00 x1875136253147776/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/440 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.712838:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a1c00 with x1875136253147776 ext(12288->69631) 00002000:00010000:2.0:1788270065.712844:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a1c00 00000100:00100000:0.0:1788270065.722941:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.723117:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253147904 00000100:00100000:2.0:1788270065.723128:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253147904 00002000:00100000:2.0:1788270065.723191:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (69632->106495) req@ffff98c27a6a2680 x1875136253147904/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.723202:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a2680 with x1875136253147904 ext(69632->106495) 00002000:00010000:2.0:1788270065.723208:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a2680 00000100:00100000:2.0:1788270065.723240:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788270065.723250:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253147904:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.730533:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253147904:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 7273us (7591us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270065.730547:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00002000:00100000:2.0:1788270065.730560:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (69632->106495) req@ffff98c27a6a2680 x1875136253147904/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/440 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.730571:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a2680 with x1875136253147904 ext(69632->106495) 00002000:00010000:2.0:1788270065.730577:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a2680 00000100:00100000:3.0:1788270065.736614:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.737289:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148032 00000100:00100000:2.0:1788270065.737298:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148032 00002000:00100000:2.0:1788270065.737348:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (106496->143359) req@ffff98c27d7ddf80 x1875136253148032/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.737360:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7ddf80 with x1875136253148032 ext(106496->143359) 00002000:00010000:2.0:1788270065.737366:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7ddf80 00000100:00100000:2.0:1788270065.737398:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788270065.737408:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253148032:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.758994:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253148032:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 21576us (22378us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270065.759007:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00002000:00100000:2.0:1788270065.759019:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (106496->143359) req@ffff98c27d7ddf80 x1875136253148032/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/440 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.759030:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7ddf80 with x1875136253148032 ext(106496->143359) 00002000:00010000:2.0:1788270065.759162:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7ddf80 00000100:00100000:3.0:1788270065.771591:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270065.771709:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148160 00000100:00100000:2.0:1788270065.771718:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148160 00002000:00100000:2.0:1788270065.771765:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (143360->180223) req@ffff98c27d7dd500 x1875136253148160/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.771778:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dd500 with x1875136253148160 ext(143360->180223) 00002000:00010000:2.0:1788270065.771785:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7dd500 00000100:00100000:2.0:1788270065.771817:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788270065.771828:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253148160:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270065.774446:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253148160:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 2609us (2854us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270065.774459:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00002000:00100000:2.0:1788270065.774470:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (143360->180223) req@ffff98c27d7dd500 x1875136253148160/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/440 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270065.774481:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dd500 with x1875136253148160 ext(143360->180223) 00002000:00010000:2.0:1788270065.774486:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7dd500 00000100:00100000:2.0:1788270065.787243:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270065.788158:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148288 00000100:00100000:1.0:1788270065.788168:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148288 00002000:00100000:1.0:1788270065.788222:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (180224->217087) req@ffff98c27d7f2680 x1875136253148288/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/0 e 0 to 0 dl 1788270076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270065.788230:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f2680 with x1875136253148288 ext(180224->217087) 00002000:00010000:1.0:1788270065.788235:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7f2680 00000100:00100000:1.0:1788270065.788315:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788270065.788326:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253148288:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:3.0:1788270065.793483:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253148288:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 5148us (6239us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788270065.793502:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00002000:00100000:3.0:1788270065.793526:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (180224->217087) req@ffff98c27d7f2680 x1875136253148288/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:481/0 lens 488/440 e 0 to 0 dl 1788270076 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788270065.793536:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f2680 with x1875136253148288 ext(180224->217087) 00002000:00010000:3.0:1788270065.793543:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7f2680 00000100:00100000:1.0:1788270065.860337:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270065.861295:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262624256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270065.861368:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270065.864347:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262624256 00000100:00100000:0.0:1788270065.864361:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262624256 00000100:00100000:0.0:1788270065.865059:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788270065.865070:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262624256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270065.865100:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446182912 avail 1299943424 00000100:00100000:0.0:1788270065.865306:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262624256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (3936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270065.865312:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788270065.865695:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262624256:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270066.118856:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270067.058461:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270067.059524:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148416 00000100:00100000:2.0:1788270067.059535:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148416 00000100:00100000:2.0:1788270067.059738:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:2.0:1788270067.059752:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34542:x1875136253148416:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270067.059775:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270067.059795:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f8d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019a1 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.059850:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f8d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a1 expref: 21 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.059866:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f8d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a1 expref: 21 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.059891:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:2.0:1788270067.059894:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270067.059899:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c200, rc 0) 00000100:00100000:2.0:1788270067.059966:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253148416:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 218us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270067.059973:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00080000:0.0:1788270067.060460:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270067.062675:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270067.062976:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148544 00000100:00100000:3.0:1788270067.062986:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148544 00000100:00100000:3.0:1788270067.063098:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788270067.063108:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34542:x1875136253148544:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270067.063125:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270067.063142:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019a8 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.063193:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 5 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.063202:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788270067.063207:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270067.063212:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.063246:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 5 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.063259:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 5 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270067.063285:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262624384:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270067.063360:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8000 going to sleep for 11 seconds 00000100:00080000:0.0:1788270067.063978:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270067.068784:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270067.069086:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148672 00000100:00100000:3.0:1788270067.069094:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148672 00002000:00100000:3.0:1788270067.069168:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->204799) req@ffff98c27d7dd180 x1875136253148672/t0(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788270067.069179:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dd180 with x1875136253148672 ext(0->204799) 00010000:00010000:3.0:1788270067.069189:0:47288:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 6 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.069208:0:47288:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 6 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270067.069215:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c27d7dd180 00000100:00100000:3.0:1788270067.069238:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788270067.069247:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253148672:12345-192.168.201.42@tcp:4:ldlm_bl.0 00000100:00080000:0.0:1788270067.070360:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270067.070404:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262624384:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270067.070435:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.070454:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f200, rc 0) 00000100:00100000:0.0:1788270067.070485:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34542:x1875136253148544:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 7380us (8002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270067.070505:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788270067.079276:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253148672:12345-192.168.201.42@tcp:4:ldlm_bl.0 Request processed in 10018us (10490us total) trans 30064771080 rc 0/0 00000100:00100000:2.0:1788270067.079300:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:2.0:1788270067.079312:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->204799) req@ffff98c27d7dd180 x1875136253148672/t30064771080(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/448 e 0 to 0 dl 1788270078 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270067.079322:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dd180 with x1875136253148672 ext(0->204799) 00010000:00010000:2.0:1788270067.079333:0:47288:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 8 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.079353:0:47288:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 8 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270067.079362:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c27d7dd180 00000100:00100000:0.0:1788270067.088061:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270067.088136:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148800 00000100:00100000:1.0:1788270067.088146:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148800 00010000:00010000:1.0:1788270067.088205:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 8 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270067.088238:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788270067.088248:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253148800:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270067.088263:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270067.088285:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 8 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.088299:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 8 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.088321:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3c0f31/0xc5f5d7a016e08f7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610199a expref: 8 pid: 48230 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.088335:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270067.088339:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270067.088347:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.088355:0:45763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.088402:0:45763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270067.088416:0:45763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:45763:1875136262624512:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788270067.088506:0:45763:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270067.091533:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270067.091596:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253148928 00000100:00100000:0.0:1788270067.091605:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253148928 00000100:00100000:0.0:1788270067.091738:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:0.0:1788270067.091758:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253148928:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270067.091778:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270067.091797:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e08f9b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019af expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.091831:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08fa2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.091845:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08fa2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.091858:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08fa2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270067.091888:0:45763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:45763:1875136262624512:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788270067.091911:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270067.091971:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2400:x1875136253148800:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3723us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270067.091981:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00010000:00010000:0.0:1788270067.091990:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e08f9b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019af expref: 23 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.092014:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08fa2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019af expref: 22 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.092022:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:0.0:1788270067.092026:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270067.092029:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270067.092099:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253148928:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 343us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270067.092106:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00010000:00010000:2.0:1788270067.140238:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270067.780860:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788270067.801103:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270067.801217:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149056 00000100:00100000:0.0:1788270067.801228:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149056 00000100:00100000:0.0:1788270067.801289:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:0.0:1788270067.801300:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:34548:x1875136253149056:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270067.801318:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270067.801337:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019b6 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.801370:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.801380:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788270067.801385:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788270067.801390:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019b6 expref: 8 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.801440:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.801453:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 6 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270067.801467:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262624640:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270067.801551:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270067.811302:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262624640:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270067.811339:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019b6 expref: 8 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270067.811362:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ee00, rc 0) 00000100:00100000:0.0:1788270067.811436:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34548:x1875136253149056:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 10138us (10342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270067.811445:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788270067.817084:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270067.817254:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149184 00000100:00100000:1.0:1788270067.817265:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149184 00002000:00100000:1.0:1788270067.817314:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->409599) req@ffff98c27d7ded80 x1875136253149184/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270067.817325:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7ded80 with x1875136253149184 ext(0->409599) 00010000:00010000:1.0:1788270067.817337:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 7 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.817353:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 7 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270067.817361:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c27d7ded80 00000100:00100000:1.0:1788270067.817394:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:1.0:1788270067.817405:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253149184:12345-192.168.201.42@tcp:4:mmap_sanity.0 00000100:00100000:1.0:1788270067.829247:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253149184:12345-192.168.201.42@tcp:4:mmap_sanity.0 Request processed in 11833us (12162us total) trans 30064771081 rc 0/0 00000100:00100000:1.0:1788270067.829260:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00002000:00100000:1.0:1788270067.829271:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->409599) req@ffff98c27d7ded80 x1875136253149184/t30064771081(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:483/0 lens 488/448 e 0 to 0 dl 1788270078 ref 1 fl Complete:H/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270067.829281:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7ded80 with x1875136253149184 ext(0->409599) 00010000:00010000:1.0:1788270067.829291:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 9 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.829315:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 9 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270067.829322:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c27d7ded80 00000100:00100000:2.0:1788270067.836934:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270067.838735:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149312 00000100:00100000:3.0:1788270067.838750:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149312 00010000:00010000:3.0:1788270067.838795:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 9 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270067.838901:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:3.0:1788270067.838910:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253149312:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270067.838925:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788270067.838942:0:45762:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb mtime from disk: 1788270065 -> 1788270067 00002000:00010000:3.0:1788270067.838944:0:45762:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb ctime from disk: 1788270065 -> 1788270067 00010000:00010000:3.0:1788270067.838950:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 9 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.838962:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 9 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.838990:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e08f94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a8 expref: 9 pid: 48231 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.839005:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1788270067.839009:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1788270067.839016:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019b6 expref: 7 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.839024:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019b6 expref: 7 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.839095:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019b6 expref: 7 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270067.839108:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262624768:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270067.839193:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270067.846235:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270067.846340:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149440 00000100:00100000:0.0:1788270067.846349:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149440 00002000:00100000:0.0:1788270067.846398:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (176128->241663) req@ffff98c27d7f1c00 x1875136253149440/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.846409:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f1c00 with x1875136253149440 ext(176128->241663) 00002000:00010000:0.0:1788270067.846427:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7f1c00 00000100:00100000:0.0:1788270067.846459:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788270067.846470:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253149440:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:3.0:1788270067.848109:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262624768:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270067.848135:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270067.848632:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253149312:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 9721us (11705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270067.848642:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788270067.850286:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253149440:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 3809us (4058us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1788270067.850299:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00002000:00100000:0.0:1788270067.850310:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (176128->241663) req@ffff98c27d7f1c00 x1875136253149440/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/440 e 0 to 0 dl 1788270078 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.850321:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f1c00 with x1875136253149440 ext(176128->241663) 00002000:00010000:0.0:1788270067.850327:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7f1c00 00000100:00100000:3.0:1788270067.857220:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270067.859363:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149568 00000100:00100000:1.0:1788270067.859393:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149568 00002000:00100000:1.0:1788270067.859466:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (241664->278527) req@ffff98c27d7de300 x1875136253149568/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270067.859479:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7de300 with x1875136253149568 ext(241664->278527) 00002000:00010000:1.0:1788270067.859486:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7de300 00000100:00100000:1.0:1788270067.859527:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788270067.859538:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253149568:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:1.0:1788270067.864027:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253149568:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 4480us (6812us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788270067.864074:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00002000:00100000:1.0:1788270067.864086:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (241664->278527) req@ffff98c27d7de300 x1875136253149568/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/440 e 0 to 0 dl 1788270078 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270067.864098:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7de300 with x1875136253149568 ext(241664->278527) 00002000:00010000:1.0:1788270067.864104:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7de300 00000100:00100000:3.0:1788270067.872497:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270067.872624:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149696 00000100:00100000:0.0:1788270067.872641:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149696 00002000:00100000:0.0:1788270067.872699:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (278528->315391) req@ffff98c27d7dca80 x1875136253149696/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.872711:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dca80 with x1875136253149696 ext(278528->315391) 00002000:00010000:0.0:1788270067.872718:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7dca80 00000100:00100000:0.0:1788270067.872757:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788270067.872769:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2402:x1875136253149696:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:0.0:1788270067.878680:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2402:x1875136253149696:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 5904us (6203us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788270067.878693:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00002000:00100000:0.0:1788270067.878705:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (278528->315391) req@ffff98c27d7dca80 x1875136253149696/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/440 e 0 to 0 dl 1788270078 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.878715:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dca80 with x1875136253149696 ext(278528->315391) 00002000:00010000:0.0:1788270067.878720:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7dca80 00000100:00100000:2.0:1788270067.889119:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270067.889233:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149824 00000100:00100000:1.0:1788270067.889249:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149824 00002000:00100000:1.0:1788270067.889308:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (315392->352255) req@ffff98c27d7f0380 x1875136253149824/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270067.889325:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f0380 with x1875136253149824 ext(315392->352255) 00002000:00010000:1.0:1788270067.889331:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7f0380 00000100:00100000:1.0:1788270067.889365:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788270067.889377:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253149824:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:1.0:1788270067.893632:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253149824:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 4249us (4521us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788270067.893646:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00002000:00100000:1.0:1788270067.893658:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (315392->352255) req@ffff98c27d7f0380 x1875136253149824/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/440 e 0 to 0 dl 1788270078 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270067.893665:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f0380 with x1875136253149824 ext(315392->352255) 00002000:00010000:1.0:1788270067.893671:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7f0380 00000100:00100000:3.0:1788270067.898426:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270067.898642:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253149952 00000100:00100000:0.0:1788270067.898667:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253149952 00002000:00100000:0.0:1788270067.898733:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (352256->389119) req@ffff98c27d7dfb80 x1875136253149952/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.898748:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dfb80 with x1875136253149952 ext(352256->389119) 00002000:00010000:0.0:1788270067.898756:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7dfb80 00000100:00100000:0.0:1788270067.898795:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788270067.898807:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253149952:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:0.0:1788270067.903335:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253149952:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 4518us (4912us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788270067.903350:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00002000:00100000:0.0:1788270067.903364:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (352256->389119) req@ffff98c27d7dfb80 x1875136253149952/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/440 e 0 to 0 dl 1788270078 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.903377:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7dfb80 with x1875136253149952 ext(352256->389119) 00002000:00010000:0.0:1788270067.903383:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27d7dfb80 00000100:00100000:1.0:1788270067.909903:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270067.910031:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270067.910095:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262624896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270067.910199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270067.910302:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262624896 00000100:00100000:1.0:1788270067.910315:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262624896 00000100:00100000:1.0:1788270067.910378:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788270067.910391:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262624896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270067.910436:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270067.910512:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262624896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270067.910519:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788270067.910580:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262624896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270067.911668:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150080 00000100:00100000:0.0:1788270067.911682:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150080 00002000:00100000:0.0:1788270067.911744:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (389120->409599) req@ffff98c27c2c5500 x1875136253150080/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/0 e 0 to 0 dl 1788270078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.911757:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c5500 with x1875136253150080 ext(389120->409599) 00002000:00010000:0.0:1788270067.911765:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c5500 00000100:00100000:0.0:1788270067.911801:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788270067.911815:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253150080:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:0.0:1788270067.917189:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253150080:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 5362us (7280us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1788270067.917208:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00002000:00100000:0.0:1788270067.917226:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (389120->409599) req@ffff98c27c2c5500 x1875136253150080/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:483/0 lens 488/440 e 0 to 0 dl 1788270078 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270067.917238:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c5500 with x1875136253150080 ext(389120->409599) 00002000:00010000:0.0:1788270067.917247:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c5500 00000100:00100000:1.0:1788270067.923292:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270067.923397:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150336 00000100:00100000:3.0:1788270067.923409:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150336 00000100:00080000:0.0:1788270067.923474:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270067.923498:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788270067.923511:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253150336:12345-192.168.201.42@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788270067.923526:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270067.923551:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08ead lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610195b expref: 10 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270067.923571:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:3.0:1788270067.923576:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270067.923633:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34548:x1875136253150336:12345-192.168.201.42@tcp:103:mmap_sanity.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270067.923640:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:1.0:1788270067.927493:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270067.927569:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150464 00000100:00100000:2.0:1788270067.927579:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150464 00000100:00100000:2.0:1788270067.927632:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788270067.927641:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34548:x1875136253150464:12345-192.168.201.42@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788270067.927742:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.927760:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.927769:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.927799:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.927813:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 21 pid: 48110 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270067.927827:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262625024:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270067.928086:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788270067.936462:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270067.936615:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262625024:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270067.936650:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270067.936755:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150592 00000100:00100000:1.0:1788270067.936780:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150592 00010000:00010000:1.0:1788270067.936823:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 22 pid: 48110 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270067.936875:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:1.0:1788270067.936900:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:2401:x1875136253150592:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270067.936932:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270067.936949:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 22 pid: 48110 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.936969:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 22 pid: 48110 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.936999:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e08e36 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101946 expref: 22 pid: 48110 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.937033:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:1.0:1788270067.937093:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.937103:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.937112:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270067.937151:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270067.937182:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.937193:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270067.937218:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253150592:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 332us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270067.937228:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000040:00080000:2.0:1788270067.937340:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].3, 136 off8600 00000100:00100000:2.0:1788270067.937456:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34548:x1875136253150464:12345-192.168.201.42@tcp:58:mmap_sanity.0 Request processed in 9813us (9969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270067.937468:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:3.0:1788270067.946898:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270067.949890:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150720 00000100:00100000:2.0:1788270067.949913:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150720 00000100:00100000:2.0:1788270067.950017:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:2.0:1788270067.950031:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:34548:x1875136253150720:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270067.950106:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270067.950150:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019bd expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.950223:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.950236:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 10 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.950264:0:45777:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.950280:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 10 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.950298:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:2.0:1788270067.950302:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270067.950308:0:45777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 10 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270067.950316:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c800, rc 0) 00000100:00100000:2.0:1788270067.950404:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253150720:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 375us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270067.950412:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00010000:00010000:1.0:1788270068.164574:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270068.225952:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.225995:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.226020:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.226098:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.226159:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151360 00000100:00100000:0.0:1788270068.226177:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151360 00000100:00100000:1.0:1788270068.226244:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150848 00000100:00100000:1.0:1788270068.226255:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150848 00000100:00100000:0.0:1788270068.226276:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788270068.226293:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2403:x1875136253151360:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270068.226316:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:1.0:1788270068.226329:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253150848:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270068.226404:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253150848:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 78us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.226411:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151104 00000100:00100000:1.0:1788270068.226413:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:2.0:1788270068.226416:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151104 00000100:00100000:1.0:1788270068.226515:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.226597:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151616 00000100:00100000:2.0:1788270068.226601:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151616 00000100:00100000:2.0:1788270068.226622:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788270068.226629:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2403:x1875136253151104:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270068.226662:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.226668:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2403:x1875136253151104:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.226675:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788270068.226687:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253150976 00000100:00100000:2.0:1788270068.226690:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253150976 00000100:00100000:1.0:1788270068.226694:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.226706:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:2.0:1788270068.226712:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253151616:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270068.226713:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.226736:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253151616:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.226743:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788270068.226753:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2403:x1875136253151360:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 463us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.226754:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151488 00000100:00100000:2.0:1788270068.226761:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151488 00000100:00100000:1.0:1788270068.226763:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.226780:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788270068.226786:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788270068.226796:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253150976:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270068.226817:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151872 00000100:00100000:0.0:1788270068.226824:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151872 00000100:00080000:1.0:1788270068.226860:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270068.226870:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151232 00000100:00100000:0.0:1788270068.226877:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151232 00000100:00100000:1.0:1788270068.226885:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253151744 00000100:00100000:1.0:1788270068.226892:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253151744 00000100:00100000:0.0:1788270068.226921:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788270068.226933:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:0.0:1788270068.226941:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2403:x1875136253151872:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270068.226952:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253151232:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270068.227022:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:3.0:1788270068.227034:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:2403:x1875136253151488:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270068.228684:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253150976:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1881us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.228698:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788270068.231542:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788270068.231577:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253151744:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270068.231594:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253151232:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4633us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270068.231595:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2403:x1875136253151872:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4649us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.231623:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788270068.231663:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253151744:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 101us (4903us total) trans 0 rc 0/0 00000100:00080000:1.0:1788270068.231826:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270068.234539:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:2403:x1875136253151488:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 7436us (7751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270068.234549:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788270068.234562:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788270068.237154:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788270068.420300:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262625152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270068.420397:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270068.420476:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625152 00000100:00100000:1.0:1788270068.420486:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625152 00000100:00100000:3.0:1788270068.420550:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262625280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270068.420563:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788270068.420575:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262625152:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270068.420597:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270068.420634:0:47286:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788270068.420647:0:47286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1788270068.420648:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270068.420677:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270068.420688:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262625408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270068.420725:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270068.420786:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625280 00000100:00100000:2.0:1788270068.420794:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625280 00000100:00100000:2.0:1788270068.420845:0:47286:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788270068.420851:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625408 00000100:00100000:2.0:1788270068.420854:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625408 00000100:00080000:2.0:1788270068.420872:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270068.420876:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788270068.421136:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 208896 granted 42032832 pending 663552 free 3923079168 avail 3691556864 00000100:00100000:1.0:1788270068.421354:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262625152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 780us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.421358:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788270068.421369:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788270068.421373:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262625280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270068.421399:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 425984 granted 25157312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1788270068.421401:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788270068.421412:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262625408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270068.421423:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 208896 granted 42032832 pending 663552 free 3923079168 avail 3691556864 00000100:00100000:1.0:1788270068.421453:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262625408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.421459:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788270068.421503:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262625408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270068.421659:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262625152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270068.422566:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262625280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1195us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.422573:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788270068.422991:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262625280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270068.423204:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262625664:0@lo:400:kworker.0 00000100:00100000:2.0:1788270068.423250:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270068.423321:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262625536:0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.423356:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270068.423402:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625536 00000100:00100000:1.0:1788270068.423409:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625536 00000100:00100000:1.0:1788270068.423487:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788270068.423495:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262625536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.423552:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262625536:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.423559:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788270068.423596:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262625536:0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.423642:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625664 00000100:00100000:1.0:1788270068.423646:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625664 00000100:00100000:1.0:1788270068.423674:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788270068.423680:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262625664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.423953:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262625792:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.423988:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270068.424033:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625792 00000100:00100000:3.0:1788270068.424059:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625792 00000100:00100000:3.0:1788270068.424092:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788270068.424098:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262625792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.424144:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262625792:12345-0@lo:400:kworker.0 Request processed in 46us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.424151:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788270068.424179:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262625792:0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.424337:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262625664:12345-0@lo:400:kworker.0 Request processed in 657us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.424344:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788270068.425094:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262626304:0@lo:400:kworker.0 00000100:00100000:0.0:1788270068.425146:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270068.425174:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788270068.425180:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262626176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425435:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262625920:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425468:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270068.425485:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262626432:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425505:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270068.425521:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788270068.425527:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262626048:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425567:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270068.425584:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262626560:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425609:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270068.425641:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262626304 00000100:00100000:3.0:1788270068.425646:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262626304 00000100:00100000:3.0:1788270068.425695:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262626432 00000100:00100000:3.0:1788270068.425699:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262626432 00000100:00100000:3.0:1788270068.425722:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262626560 00000100:00100000:3.0:1788270068.425726:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262626560 00000100:00100000:3.0:1788270068.425743:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788270068.425750:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262626304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425824:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262626304:12345-0@lo:400:kworker.0 Request processed in 74us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.425831:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788270068.425850:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788270068.425857:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262626432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425890:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262626432:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.425897:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788270068.425910:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788270068.425916:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262626560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.425942:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262626560:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.425959:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788270068.425998:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262626560:0@lo:400:kworker.0 00010000:00080000:3.0:1788270068.426013:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a6a1880 x1875136262626432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270068.426024:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262626432:0@lo:400:kworker.0 00000100:00080000:3.0:1788270068.426094:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270068.426099:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270068.426812:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262625920 00000100:00100000:1.0:1788270068.426818:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262625920 00000100:00100000:1.0:1788270068.426849:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788270068.426855:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262625920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.426900:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262625920:12345-0@lo:400:kworker.0 Request processed in 46us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.426904:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788270068.426934:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262625920:0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.426963:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262626048 00000100:00100000:1.0:1788270068.426965:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262626048 00000100:00100000:1.0:1788270068.426990:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788270068.426994:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262626048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.427017:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262626048:12345-0@lo:400:kworker.0 Request processed in 23us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.427021:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788270068.427030:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270068.427064:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262626048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270068.427316:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270068.427459:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262626688:0@lo:400:kworker.0 00000100:00100000:0.0:1788270068.427491:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270068.427653:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262626304:0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.427729:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262626176 00000100:00100000:1.0:1788270068.427733:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262626176 00000100:00100000:2.0:1788270068.427772:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262625664:0@lo:400:kworker.0 00000100:00100000:1.0:1788270068.427804:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262626688 00000100:00100000:1.0:1788270068.427808:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262626688 00000100:00080000:2.0:1788270068.427843:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270068.427858:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788270068.427868:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262626176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.427913:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262626176:12345-0@lo:400:kworker.0 Request processed in 47us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.427920:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788270068.427933:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788270068.427938:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262626176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.427950:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262626688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270068.427982:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262626688:12345-0@lo:400:kworker.0 Request processed in 34us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.427989:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788270068.427998:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a6a0380 x1875136262626688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270068.428009:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262626688:0@lo:400:kworker.0 00000040:00080000:0.0:1788270068.740390:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270068.740404:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270068.740443:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 4 count 4 00000040:00080000:0.0:1788270068.740457:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270068.741296:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262626816:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270068.741494:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270068.746987:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.747143:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253152000 00000100:00100000:2.0:1788270068.747156:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253152000 00000100:00100000:2.0:1788270068.747410:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:2.0:1788270068.747433:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34550:x1875136253152000:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270068.747637:0:45777:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270068.748033:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34550:x1875136253152000:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 603us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.748076:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:0.0:1788270068.748619:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262626816:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270068.752507:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.754297:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253152128 00000100:00100000:3.0:1788270068.754315:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253152128 00000100:00100000:3.0:1788270068.754464:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:3.0:1788270068.754478:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34550:x1875136253152128:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788270068.754576:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754597:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754610:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754627:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754632:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754645:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754669:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754675:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754679:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270068.754727:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:3.0:1788270068.754731:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270068.754742:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754750:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754755:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754762:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754773:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270068.754779:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754787:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754802:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:3.0:1788270068.754806:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270068.754813:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754819:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e08fbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754835:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754841:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754848:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754853:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270068.754856:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754863:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754872:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb6096ffe (ffff98c1429fd900) 00010000:00010000:3.0:1788270068.754874:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270068.754875:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754879:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e08fc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754891:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754894:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754897:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754901:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270068.754902:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754906:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754909:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:3.0:1788270068.754910:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270068.754912:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.754915:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e08fcc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270068.755006:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34550:x1875136253152128:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 527us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.755014:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:1.0:1788270068.757932:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.758082:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253152384 00000100:00100000:0.0:1788270068.758262:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253152384 00000100:00100000:0.0:1788270068.758398:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:0.0:1788270068.758412:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34550:x1875136253152384:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270068.758448:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270068.758485:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e08fd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019c4 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758628:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758645:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758660:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270068.758673:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:0.0:1788270068.758786:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758794:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758801:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758807:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270068.758812:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758820:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758834:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:0.0:1788270068.758837:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270068.758842:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758850:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e08fda lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758898:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e08fd3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019c4 expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758914:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:0.0:1788270068.758916:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270068.758920:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e08fd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019c4 expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.758930:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ec00, rc 0) 00000100:00100000:0.0:1788270068.759007:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34550:x1875136253152384:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 598us (1091us total) trans 30064771137 rc 301/301 00000100:00100000:0.0:1788270068.759016:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:1.0:1788270068.765731:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.765819:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253152512 00000100:00100000:3.0:1788270068.765832:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253152512 00000100:00100000:3.0:1788270068.765902:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:3.0:1788270068.765916:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34550:x1875136253152512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270068.765962:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270068.766149:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34550:x1875136253152512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 235us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.766158:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:1.0:1788270068.770729:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.771288:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253152768 00000100:00100000:3.0:1788270068.771303:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253152768 00000100:00100000:2.0:1788270068.771521:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:2.0:1788270068.771535:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34550:x1875136253152768:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270068.771561:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270068.771585:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08fe8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019cb expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270068.772061:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc3:0x0], index 0: 0 00010000:00010000:2.0:1788270068.772242:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08fef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.772256:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08fef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.772269:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08fef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.772318:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e08fe8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019cb expref: 25 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.772334:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08fef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019cb expref: 24 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.772341:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429fbb00) 00010000:00010000:2.0:1788270068.772343:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270068.772346:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:2.0:1788270068.772420:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34550:x1875136253152768:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 888us (1706us total) trans 30064771138 rc 0/0 00000100:00100000:2.0:1788270068.772427:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:3.0:1788270068.778016:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.778348:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253153024 00000100:00100000:0.0:1788270068.778362:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253153024 00000100:00100000:0.0:1788270068.779360:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:1.0:1788270068.779601:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34550:x1875136253153024:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788270068.779682:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270068.779717:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e08fef lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019cb expref: 24 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779740:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429fbb00) 00010000:00010000:1.0:1788270068.779753:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270068.779846:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779864:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779875:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779892:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779899:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779907:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779959:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779968:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779975:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779982:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270068.779987:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.779995:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780004:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270068.780007:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270068.780011:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780018:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e08ffd lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780030:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780036:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780245:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780251:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270068.780255:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780262:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780272:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x9b0e7352 (ffff98c143878000) 00010000:00010000:1.0:1788270068.780275:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270068.780278:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.780285:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09004 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x9b0e7352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.780440:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:34550:x1875136253153024:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1068us (2438us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788270068.780449:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:3.0:1788270068.783412:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.783552:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253153152 00000100:00100000:0.0:1788270068.783565:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253153152 00000100:00100000:0.0:1788270068.783665:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:0.0:1788270068.783678:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:34550:x1875136253153152:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270068.783705:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270068.783737:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0900b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019d2 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.783787:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.783802:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.783814:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.783948:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0900b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 25 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.783968:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.783978:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270068.783981:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270068.783985:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fc00, rc 0) 00000100:00100000:0.0:1788270068.784066:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34550:x1875136253153152:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 391us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270068.784073:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:3.0:1788270068.786666:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.787453:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253153408 00000100:00100000:2.0:1788270068.787476:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253153408 00000100:00100000:2.0:1788270068.788379:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:2.0:1788270068.788399:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34550:x1875136253153408:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270068.788600:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.788622:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.788641:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270068.788894:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].4, 88 off8496 00000004:00080000:2.0:1788270068.788909:0:45777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860495869091ns, next at 861495865901ns, rc = 0 00000004:00010000:2.0:1788270068.788973:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002741a21 reply state 00000000033e97ef transno 30064771139 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.788989:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.788998:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:2.0:1788270068.789001:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270068.789006:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270068.789167:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:34550:x1875136253153408:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 775us (2513us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1788270068.789190:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:3.0:1788270068.792836:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.792919:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253153536 00000100:00100000:1.0:1788270068.792934:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253153536 00000100:00100000:1.0:1788270068.793012:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788270068.793026:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:34550:x1875136253153536:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270068.793079:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270068.793106:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019d9 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.793194:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 27 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.793218:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 27 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.793243:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:1.0:1788270068.793247:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270068.793252:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a200, rc 0) 00000100:00100000:1.0:1788270068.793336:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:34550:x1875136253153536:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 309us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.793345:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788270068.796666:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.796755:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253153664 00000100:00100000:3.0:1788270068.796835:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253153664 00000100:00100000:3.0:1788270068.796939:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788270068.796951:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253153664:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788270068.797334:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253153664:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 383us (680us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788270068.797343:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000001:00080000:2.0:1788270068.801622:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771081 is committed 00000001:00080000:2.0:1788270068.801647:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771080 is committed 00000100:00100000:0.0:1788270068.804130:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.804393:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253153920 00000100:00100000:3.0:1788270068.804408:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253153920 00000100:00100000:3.0:1788270068.804484:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788270068.804498:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:34550:x1875136253153920:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270068.804860:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34550:x1875136253153920:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 364us (826us total) trans 30064771140 rc 0/0 00000100:00100000:3.0:1788270068.804870:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788270068.807748:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.807880:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253154176 00000100:00100000:1.0:1788270068.807894:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253154176 00000100:00100000:1.0:1788270068.807967:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:1.0:1788270068.807979:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34550:x1875136253154176:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788270068.808182:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34550:x1875136253154176:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 195us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.808192:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:2.0:1788270068.811654:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.811726:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253154304 00000100:00100000:1.0:1788270068.811737:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253154304 00000100:00100000:1.0:1788270068.812036:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:1.0:1788270068.812089:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34550:x1875136253154304:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270068.812117:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270068.812155:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09027 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019e0 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.812262:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0902e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.812278:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0902e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.812292:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0902e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270068.812349:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270068.812372:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0902e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.812409:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09027 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e0 expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.812433:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0902e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e0 expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.812443:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:1.0:1788270068.812446:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788270068.812450:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a400, rc 0) 00000100:00100000:1.0:1788270068.812518:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34550:x1875136253154304:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 432us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.812526:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:3.0:1788270068.816371:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.818204:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253154432 00000100:00100000:2.0:1788270068.818224:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253154432 00000100:00100000:2.0:1788270068.818318:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788270068.818331:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253154432:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270068.818357:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270068.818390:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019e7 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270068.818423:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d5f4, blocks: 0x0 00010000:00010000:2.0:1788270068.818448:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=860s v=(0 0) 00010000:00010000:2.0:1788270068.818453:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270068.818465:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 6 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.818488:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 6 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.818505:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:2.0:1788270068.818605:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2402:x1875136253154432:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 275us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.818612:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788270068.820862:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.820939:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253154688 00000100:00100000:1.0:1788270068.820951:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253154688 00000100:00100000:1.0:1788270068.821021:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:1.0:1788270068.821034:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34550:x1875136253154688:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788270068.821281:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34550:x1875136253154688:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 248us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.821290:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:1.0:1788270068.825721:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.825916:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253154816 00000100:00100000:2.0:1788270068.825936:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253154816 00000100:00100000:1.0:1788270068.826193:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270068.826207:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34550:x1875136253154816:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270068.826232:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270068.826263:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019ee expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.826312:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.826324:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270068.826329:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270068.826336:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.826383:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.826400:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 960 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.826423:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262626944:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270068.826562:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270068.834626:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.834770:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262626944:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270068.834816:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.834849:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b400, rc 0) 00000100:00100000:1.0:1788270068.834933:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34550:x1875136253154816:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 8728us (9227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.834944:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788270068.835109:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253154944 00000100:00100000:3.0:1788270068.835120:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253154944 00010000:00010000:3.0:1788270068.835174:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 960 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270068.835217:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788270068.835228:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253154944:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270068.835245:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270068.835273:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 960 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.835287:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 960 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.835319:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e09035 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e7 expref: 7 pid: 48230 timeout: 960 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.835336:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270068.835341:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270068.835352:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.835365:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.835407:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270068.835423:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a623480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:45762:1875136262627072:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270068.835488:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788270068.842468:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a623480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:45762:1875136262627072:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270068.842506:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270068.842728:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253154944:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 7499us (8118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.842741:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:2.0:1788270068.853874:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.854963:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253155072 00000100:00100000:0.0:1788270068.854978:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253155072 00002000:00100000:1.0:1788270068.855240:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc3:0x0] (0->409599) req@ffff98c248219180 x1875136253155072/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:484/0 lens 488/0 e 0 to 0 dl 1788270079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270068.855254:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c248219180 with x1875136253155072 ext(0->409599) 00002000:00010000:1.0:1788270068.855262:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c248219180 00000100:00100000:1.0:1788270068.855351:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788270068.855364:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253155072:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788270068.877461:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253155072:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 22083us (23584us total) trans 30064771082 rc 0/0 00000100:00100000:1.0:1788270068.877475:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00002000:00100000:1.0:1788270068.877489:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc3:0x0] (0->409599) req@ffff98c248219180 x1875136253155072/t30064771082(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:484/0 lens 488/448 e 0 to 0 dl 1788270079 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270068.877504:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c248219180 with x1875136253155072 ext(0->409599) 00002000:00010000:1.0:1788270068.877511:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c248219180 00000100:00100000:2.0:1788270068.885620:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.886131:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253155200 00000100:00100000:0.0:1788270068.886146:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253155200 00000100:00100000:0.0:1788270068.886221:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:0.0:1788270068.886234:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34550:x1875136253155200:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788270068.889676:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771140 is committed 00000004:00080000:0.0:1788270068.889703:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788270068.889747:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c249159c00 refcount 2 committed 0 result 0 batchid 25769803837 00000020:00080000:0.0:1788270068.889753:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c1410d7400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c249159600 00000020:00080000:0.0:1788270068.889756:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c1410d7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1448d5200 00000020:00080000:0.0:1788270068.889794:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803836 batchid updated 00010000:00010000:3.0:1788270068.889822:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889837:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889846:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889853:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270068.889858:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889871:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889893:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff98c1429f1e00) 00010000:00010000:3.0:1788270068.889897:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270068.889903:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889909:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e08f55 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889943:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889950:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889956:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889961:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270068.889964:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889970:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889978:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:3.0:1788270068.889981:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788270068.889984:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.889995:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09019 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270068.890014:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34550:x1875136253155200:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 3763us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270068.890027:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000020:00080000:2.0:1788270068.890589:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803837 committed batchid 25769803836 00000020:00080000:2.0:1788270068.890666:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803836 00000100:00100000:0.0:1788270068.890684:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270068.890706:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262627200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788270068.890776:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270068.890833:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262627200 00000100:00100000:1.0:1788270068.890843:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262627200 00000100:00100000:1.0:1788270068.890901:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788270068.890912:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262627200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788270068.891066:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:1.0:1788270068.891071:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788270069 00002000:00010000:1.0:1788270068.891073:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270068.891075:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb ctime from disk: 1788270068 -> 1788270069 00002000:00010000:1.0:1788270068.891077:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb blocks from disk: 0 -> 800 00000100:00100000:1.0:1788270068.891116:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262627200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (339us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1788270068.891136:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788270068.892450:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771080 gen 2 00000004:00080000:2.0:1788270068.892462:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771079 committed transno 30064771080 00000004:00080000:2.0:1788270068.892498:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c2c5180, transno 30064771080 00000100:00100000:2.0:1788270068.892516:0:3607:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c27c309180 x1875136262627200/t30064771083(30064771083) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788270084 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788270068.892530:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c309180/2, rc 0, transno 30064771083 00000100:00100000:2.0:1788270068.892540:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262627200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788270068.893283:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.893502:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253155328 00000100:00100000:0.0:1788270068.893512:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253155328 00000100:00100000:2.0:1788270068.893655:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:2.0:1788270068.893669:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253155328:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788270068.897454:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771083 is committed 00000001:00080000:0.0:1788270068.897475:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771082 is committed 00000100:00100000:2.0:1788270068.897723:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253155328:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 4049us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.897737:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788270068.901844:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.902004:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253155584 00000100:00100000:3.0:1788270068.902015:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253155584 00000100:00100000:3.0:1788270068.902101:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:3.0:1788270068.902111:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34550:x1875136253155584:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788270068.902200:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270068.902233:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0902e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019e0 expref: 15 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.902254:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:3.0:1788270068.902259:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270068.902349:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.902367:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.902859:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270068.903000:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27df97b reply state 00000000f45074ca transno 30064771141 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.903012:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.903017:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270068.903019:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270068.903021:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270068.903179:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:34550:x1875136253155584:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1067us (1346us total) trans 30064771141 rc 0/0 00000100:00100000:0.0:1788270068.903191:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788270068.910695:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.910846:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253155712 00000100:00100000:0.0:1788270068.910860:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253155712 00000100:00100000:0.0:1788270068.910936:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788270068.910948:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253155712:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788270068.911262:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:0.0:1788270068.911266:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb mtime from disk: 1788270069 -> 1788270065 00002000:00010000:0.0:1788270068.911268:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb atime from disk: 0 -> 1788270065 00002000:00010000:0.0:1788270068.911270:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb ctime from disk: 1788270069 -> 1788270065 00002000:00010000:0.0:1788270068.911271:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb blocks from disk: 800 -> 800 00000100:00100000:0.0:1788270068.911341:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253155712:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 394us (663us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1788270068.911348:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788270068.917900:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.918006:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253155968 00000100:00100000:1.0:1788270068.918017:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253155968 00000100:00100000:1.0:1788270068.918416:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788270068.918427:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:34550:x1875136253155968:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788270068.918516:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.918537:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 16 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.918549:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.918592:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 16 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.918604:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 16 pid: 45776 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.918618:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262627328:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270068.918708:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270068.921468:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.921583:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253156096 00000100:00100000:0.0:1788270068.921594:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253156096 00000100:00100000:1.0:1788270068.921602:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262627328:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270068.921642:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 17 pid: 45776 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.921648:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270068.921702:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788270068.921714:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253156096:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270068.921737:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270068.921744:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 17 pid: 45776 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.921764:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 17 pid: 45776 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.921791:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09012 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d2 expref: 17 pid: 45776 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.921811:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270068.921816:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.921828:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.921835:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.921862:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270068.921902:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.921911:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270068.921921:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253156096:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 209us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270068.921930:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00010000:00010000:1.0:1788270068.921961:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.921969:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.921978:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.921984:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19bc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270068.921990:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.922010:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.922022:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:1.0:1788270068.922025:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788270068.922029:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.922036:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0904a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.922116:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34550:x1875136253155968:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 3690us (4228us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788270068.922138:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:3.0:1788270068.924164:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.924239:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253156224 00000100:00100000:0.0:1788270068.924249:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253156224 00000100:00100000:0.0:1788270068.924302:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788270068.924312:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253156224:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788270068.924364:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.924388:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.924404:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270068.924409:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270068.924415:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.924457:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.924474:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 7 pid: 47284 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270068.924493:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262627456:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270068.924586:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788270068.926916:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262627456:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270068.926954:0:48231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.931292:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.931468:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253156352 00000100:00100000:3.0:1788270068.931481:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253156352 00010000:00010000:3.0:1788270068.931537:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 8 pid: 47284 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270068.931572:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788270068.931581:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253156352:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270068.931595:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270068.931617:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 8 pid: 47284 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.931627:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 8 pid: 47284 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.931651:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a4cf7/0xc5f5d7a016e0903c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019ee expref: 8 pid: 47284 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.931666:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270068.931669:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270068.931674:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.931682:0:45763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.931719:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270068.931791:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253156352:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 210us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270068.931799:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00010000:00010000:1.0:1788270068.931846:0:48231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931856:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931879:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931888:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931903:0:48231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931911:0:48231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270068.931916:0:48231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931926:0:48231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931939:0:48231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.931947:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000581f3394/0xc5f5d7a016e09051 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.932149:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253156224:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 7838us (7994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270068.932159:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788270068.936702:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.936836:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253156608 00000100:00100000:0.0:1788270068.936849:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253156608 00000100:00100000:0.0:1788270068.936916:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788270068.936928:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:34550:x1875136253156608:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788270068.937028:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.937084:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.937097:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.937954:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.937971:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 16 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.937980:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.938027:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 16 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.938080:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 16 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270068.938099:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262627584:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270068.938647:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270068.941528:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262627584:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270068.941546:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:0.0:1788270068.941564:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270068.941650:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253156736 00000100:00100000:3.0:1788270068.941657:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253156736 00010000:00010000:3.0:1788270068.941695:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 17 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270068.941730:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788270068.941737:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253156736:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270068.941750:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270068.941756:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 17 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.941770:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 17 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.941791:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09020 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019d9 expref: 17 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.941807:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:3.0:1788270068.941812:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.942398:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270068.942407:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.942507:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270068.942540:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.942548:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270068.942576:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253156736:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 837us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.942584:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000001:00080000:0.0:1788270068.942681:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771142 00000001:00080000:0.0:1788270068.942791:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771143 00000001:00080000:0.0:1788270068.942818:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771144 00000100:00100000:0.0:1788270068.942902:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262627712:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270068.942947:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270068.942984:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270068.942994:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262627712 00000100:00100000:2.0:1788270068.943000:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262627712 00000100:00100000:2.0:1788270068.943077:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788270068.943086:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262627712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270068.943561:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262627712:12345-0@lo:1000:mdt00_000.0 Request processed in 475us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.943569:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788270068.943633:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771083 gen 2 00000004:00080000:0.0:1788270068.943638:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c309180, transno 30064771083 00000100:00100000:0.0:1788270068.943683:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262627712:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788270068.943789:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771145 00000100:00100000:0.0:1788270068.943829:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262627840:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270068.943856:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270068.943881:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23900 going to sleep for 11 seconds 00000100:00100000:3.0:1788270068.943895:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262627840 00000100:00100000:3.0:1788270068.943902:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262627840 00000100:00100000:3.0:1788270068.943939:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788270068.943948:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262627840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270068.944089:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262627840:12345-0@lo:1000:mdt00_000.0 Request processed in 141us (230us total) trans 30064771085 rc 0/0 00000100:00100000:3.0:1788270068.944096:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788270068.944110:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262627840:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788270068.944152:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944162:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944170:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944177:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270068.944181:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944190:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944206:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270068.944210:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270068.944215:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944223:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0905f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944257:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944265:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944271:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944277:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270068.944280:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944286:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944294:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:0.0:1788270068.944296:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270068.944303:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944319:0:45776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944329:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.944356:0:45776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270068.944364:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262627968:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788270068.944415:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295840 going to sleep for 11 seconds 00000100:00100000:0.0:1788270068.946406:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262627968:192.168.201.42@tcp:105: 00010000:00010000:0.0:1788270068.946440:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946453:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e08fb0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946505:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946520:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946539:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946555:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946563:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946570:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946576:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270068.946580:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946586:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946599:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:0.0:1788270068.946602:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270068.946606:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946617:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09066 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946628:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946635:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946641:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946646:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270068.946650:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946656:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946663:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:0.0:1788270068.946666:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270068.946668:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.946675:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09058 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270068.946901:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270068.947152:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253156864 00000100:00100000:3.0:1788270068.947161:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253156864 00000100:00100000:3.0:1788270068.947238:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788270068.947249:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253156864:12345-192.168.201.42@tcp:49:mmap_sanity.0 00000100:00100000:0.0:1788270068.947334:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34550:x1875136253156608:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 10407us (10644us total) trans 30064771146 rc 0/0 00000100:00100000:0.0:1788270068.947344:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000020:00080000:0.0:1788270068.947349:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788270068.947355:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253156864:12345-192.168.201.42@tcp:49:mmap_sanity.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000040:00080000:2.0:1788270068.947723:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270068.947728:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270068.947749:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 4 count 4 00000040:00080000:2.0:1788270068.947757:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270068.948346:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788270068.951175:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270068.951291:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253157120 00000100:00100000:1.0:1788270068.951303:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253157120 00000100:00100000:1.0:1788270068.951420:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:1.0:1788270068.951666:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34550:x1875136253157120:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788270068.952026:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788270068.952114:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771147 00010000:00010000:1.0:1788270068.952170:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.952192:0:45779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.952206:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.952215:0:45779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.952222:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.952229:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270068.952257:0:45779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270068.952362:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34550:x1875136253157120:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 932us (1197us total) trans 30064771148 rc 0/0 00000100:00100000:1.0:1788270068.952372:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000020:00080000:1.0:1788270068.952377:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270068.953001:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270068.953012:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.953021:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270068.953027:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.953059:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.953076:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270068.953079:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270068.953085:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.953091:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e0906d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270068.953107:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270068.953109:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270068.953111:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270068.953555:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.953713:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253157248 00000100:00100000:2.0:1788270068.953724:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253157248 00000100:00100000:2.0:1788270068.953782:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:2.0:1788270068.953791:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34548:x1875136253157248:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270068.953809:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270068.953832:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e09074 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019f5 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270068.953860:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc3:0x0] initial LVB size: 409600, mtime: 0x6a96d5f1, atime: 0x6a96d5f1, ctime: 0x6a96d5f1, blocks: 0x320 00010000:00010000:2.0:1788270068.953882:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=860s v=(0 0) 00010000:00010000:2.0:1788270068.953888:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270068.953898:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e09074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019f5 expref: 6 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.953914:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e09074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019f5 expref: 6 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270068.953927:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270068.953990:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34548:x1875136253157248:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 200us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270068.954221:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788270068.959890:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.959949:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253157376 00000100:00100000:0.0:1788270068.959963:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253157376 00002000:00100000:0.0:1788270068.960075:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->65535) req@ffff98c27a620a80 x1875136253157376/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/0 e 0 to 0 dl 1788270079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270068.960089:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a620a80 with x1875136253157376 ext(0->65535) 00002000:00010000:0.0:1788270068.960097:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a620a80 00000100:00100000:0.0:1788270068.960146:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788270068.960157:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253157376:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:0.0:1788270068.965424:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253157376:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 5254us (5531us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1788270068.965437:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00002000:00100000:0.0:1788270068.965452:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (0->65535) req@ffff98c27a620a80 x1875136253157376/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/440 e 0 to 0 dl 1788270079 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270068.965515:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a620a80 with x1875136253157376 ext(0->65535) 00002000:00010000:0.0:1788270068.965523:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a620a80 00000100:00100000:1.0:1788270068.971701:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.971786:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253157504 00000100:00100000:2.0:1788270068.971800:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253157504 00002000:00100000:2.0:1788270068.971858:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (65536->102399) req@ffff98c27c30bb80 x1875136253157504/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/0 e 0 to 0 dl 1788270079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270068.971872:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c30bb80 with x1875136253157504 ext(65536->102399) 00002000:00010000:2.0:1788270068.971880:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c30bb80 00000100:00100000:2.0:1788270068.971913:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:2.0:1788270068.971922:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253157504:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:2.0:1788270068.974956:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253157504:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 3017us (3251us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788270068.974972:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00002000:00100000:2.0:1788270068.974986:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (65536->102399) req@ffff98c27c30bb80 x1875136253157504/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/440 e 0 to 0 dl 1788270079 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270068.974997:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c30bb80 with x1875136253157504 ext(65536->102399) 00002000:00010000:2.0:1788270068.975004:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c30bb80 00000100:00100000:1.0:1788270068.978642:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270068.980447:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253157632 00000100:00100000:0.0:1788270068.980466:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253157632 00002000:00100000:0.0:1788270068.980540:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (102400->139263) req@ffff98c27c308a80 x1875136253157632/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/0 e 0 to 0 dl 1788270079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270068.980550:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c308a80 with x1875136253157632 ext(102400->139263) 00002000:00010000:0.0:1788270068.980556:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c308a80 00000100:00100000:0.0:1788270068.980621:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:0.0:1788270068.980630:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253157632:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:0.0:1788270068.983421:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253157632:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 2778us (4783us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788270068.983433:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00002000:00100000:0.0:1788270068.983445:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc2:0x0] (102400->139263) req@ffff98c27c308a80 x1875136253157632/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/440 e 0 to 0 dl 1788270079 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788270068.983454:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c308a80 with x1875136253157632 ext(102400->139263) 00002000:00010000:0.0:1788270068.983460:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c308a80 00000100:00100000:0.0:1788270068.986370:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.986478:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253157760 00000100:00100000:2.0:1788270068.986491:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253157760 00002000:00100000:2.0:1788270068.986549:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (139264->176127) req@ffff98c27a6a1500 x1875136253157760/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/0 e 0 to 0 dl 1788270079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788270068.986559:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a1500 with x1875136253157760 ext(139264->176127) 00002000:00010000:2.0:1788270068.986564:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a1500 00000100:00100000:2.0:1788270068.986594:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788270068.986605:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2402:x1875136253157760:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:1.0:1788270068.988655:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2402:x1875136253157760:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 2038us (2285us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788270068.988669:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00002000:00100000:1.0:1788270068.988683:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (139264->176127) req@ffff98c27a6a1500 x1875136253157760/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:484/0 lens 488/440 e 0 to 0 dl 1788270079 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270068.988695:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a6a1500 with x1875136253157760 ext(139264->176127) 00002000:00010000:1.0:1788270068.988701:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a6a1500 00000100:00100000:0.0:1788270068.997661:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270068.998076:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253158016 00000100:00100000:2.0:1788270068.998088:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253158016 00000100:00100000:2.0:1788270068.998164:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788270068.998178:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:34548:x1875136253158016:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000001:00080000:2.0:1788270068.998538:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771149 00000100:00100000:2.0:1788270068.998722:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+12:34548:x1875136253158016:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 474us (1002us total) trans 30064771150 rc 0/0 00000100:00100000:2.0:1788270068.998733:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000020:00080000:2.0:1788270068.998739:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788270069.000448:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.000587:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253158272 00000100:00100000:1.0:1788270069.000597:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253158272 00000100:00080000:2.0:1788270069.000657:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270069.000672:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788270069.000684:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+12:34548:x1875136253158272:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000001:00080000:1.0:1788270069.000895:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771151 00000001:00080000:1.0:1788270069.000972:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771152 00000100:00100000:1.0:1788270069.001095:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+15:34548:x1875136253158272:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 413us (655us total) trans 30064771153 rc 0/0 00000100:00100000:1.0:1788270069.001104:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000020:00080000:1.0:1788270069.001109:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788270069.105637:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270069.105710:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253158528 00000100:00100000:0.0:1788270069.105723:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253158528 00000100:00100000:0.0:1788270069.105822:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788270069.105835:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144b19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253158528:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00080000:2.0:1788270069.106168:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270069.106189:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144b19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253158528:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 356us (563us total) trans 30064771154 rc 0/0 00000100:00100000:0.0:1788270069.106454:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788270069.109372:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.109485:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253158784 00000100:00100000:1.0:1788270069.109498:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253158784 00000100:00100000:1.0:1788270069.109555:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788270069.109562:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253158784:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788270069.109888:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:34542:x1875136253158784:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 326us (526us total) trans 30064771155 rc 0/0 00000100:00100000:1.0:1788270069.109893:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788270069.111868:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270069.111937:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253158912 00000100:00100000:0.0:1788270069.111949:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253158912 00000100:00100000:0.0:1788270069.112019:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:0.0:1788270069.112030:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:34542:x1875136253158912:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270069.112085:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270069.112111:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0907b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561019fc expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112215:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112232:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112245:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112262:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112270:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112276:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112364:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112375:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112382:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270069.112425:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:0.0:1788270069.112430:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270069.112453:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112465:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112474:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112481:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112489:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112495:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270069.112500:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112508:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112522:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270069.112525:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270069.112531:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112539:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09082 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112559:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112566:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112572:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112577:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270069.112580:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112587:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112594:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c1429f1700) 00010000:00010000:0.0:1788270069.112596:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270069.112599:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112605:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09089 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112639:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0907b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019fc expref: 25 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112654:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019fc expref: 24 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.112667:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:0.0:1788270069.112669:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270069.112671:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f200, rc 0) 00000100:00100000:0.0:1788270069.112750:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34542:x1875136253158912:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 721us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270069.112757:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788270069.117718:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.117927:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253159168 00000100:00100000:1.0:1788270069.117940:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253159168 00000100:00100000:1.0:1788270069.118020:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788270069.118033:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34542:x1875136253159168:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788270069.118163:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788270069.118200:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09090 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019fc expref: 24 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118419:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e08fa2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019af expref: 23 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118433:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e08f8d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019a1 expref: 22 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118445:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:1.0:1788270069.118451:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270069.118483:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118497:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118507:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118538:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118546:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118553:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118657:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118667:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.118673:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270069.118945:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].3, 64 off8408 00000004:00080000:1.0:1788270069.118953:0:45777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 860825913015ns, next at 861825910955ns, rc = 0 00010000:00010000:1.0:1788270069.118996:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119002:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119007:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119013:0:45777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119017:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119021:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119175:0:45777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270069.119199:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119207:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119213:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119219:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270069.119224:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119233:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119243:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:1.0:1788270069.119246:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788270069.119250:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119256:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090a5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119276:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119282:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119288:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119293:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270069.119297:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119303:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.119305:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270069.119315:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:3.0:1788270069.119318:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119320:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270069.119326:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.119331:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270069.119337:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119338:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09097 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.119349:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270069.119358:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009295e309 reply state 00000000e46435b5 transno 30064771156 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.119363:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:3.0:1788270069.119369:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788270069.119374:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119378:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.119382:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e090ac lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.119390:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c143878000) 00010000:00010000:1.0:1788270069.119394:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270069.119397:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270069.119400:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270069.119403:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270069.119404:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270069.119494:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:34542:x1875136253159168:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 1463us (1790us total) trans 30064771156 rc 0/0 00000100:00100000:1.0:1788270069.119502:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788270069.125901:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.126030:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253159296 00000100:00100000:2.0:1788270069.126112:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253159296 00000100:00100000:2.0:1788270069.126363:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:2.0:1788270069.126376:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:34542:x1875136253159296:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270069.126408:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.126435:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090b3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a03 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.126522:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.126541:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.126554:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.126573:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.126581:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.126588:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128232:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128256:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128268:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270069.128391:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:2.0:1788270069.128396:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270069.128424:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128438:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128448:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128456:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128465:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128472:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.128477:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128485:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128500:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270069.128503:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.128508:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128514:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090ba lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128527:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128533:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128539:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128545:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.128548:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128554:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128561:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c1429faf00) 00010000:00010000:2.0:1788270069.128563:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.128566:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128572:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090c1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128619:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090b3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a03 expref: 25 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128635:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a03 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.128643:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:2.0:1788270069.128645:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270069.128648:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c200, rc 0) 00000100:00100000:2.0:1788270069.128740:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34542:x1875136253159296:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 2366us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.128752:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:3.0:1788270069.133763:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.133983:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253159552 00000100:00100000:2.0:1788270069.137348:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253159552 00000100:00100000:2.0:1788270069.137475:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:2.0:1788270069.137489:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:34542:x1875136253159552:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270069.137562:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270069.137597:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e090c8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a03 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.137619:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:2.0:1788270069.137624:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270069.137653:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.137669:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.137680:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.137695:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.137701:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.137708:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.139788:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.139812:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.139824:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270069.140597:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].5, 64 off8560 00010000:00010000:2.0:1788270069.140657:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140667:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140677:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140685:0:45778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140693:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140700:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140726:0:45778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270069.140749:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140755:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140761:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140767:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.140772:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140781:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140792:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:2.0:1788270069.140795:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788270069.140800:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140806:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e090dd lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140826:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140833:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140839:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140844:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.140847:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140852:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140859:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270069.140861:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.140864:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140869:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e090cf lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270069.140879:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009994409c reply state 0000000097f0b7f6 transno 30064771157 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140890:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.140896:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c1429faf00) 00010000:00010000:2.0:1788270069.140898:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270069.140901:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788270069.142202:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270069.142217:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.142228:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270069.142234:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.142242:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.142259:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:1.0:1788270069.142263:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270069.142267:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.142273:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e090e4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.142290:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270069.142293:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270069.142295:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270069.142463:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253159552:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 4970us (8703us total) trans 30064771157 rc 0/0 00000100:00100000:2.0:1788270069.142476:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788270069.145829:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.145937:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253159680 00000100:00100000:1.0:1788270069.145950:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253159680 00000100:00100000:1.0:1788270069.146141:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:1.0:1788270069.146157:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253159680:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270069.146189:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270069.146296:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090eb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a0a expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146386:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146403:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146415:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146433:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146440:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146446:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146494:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146501:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146508:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146515:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19be00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270069.146521:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146529:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146544:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270069.146548:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270069.146552:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146560:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e090f2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146578:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146584:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146589:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146593:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19bc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270069.146596:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146603:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146610:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff98c143878200) 00010000:00010000:1.0:1788270069.146612:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270069.146615:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146621:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e090f9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146658:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090eb lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a0a expref: 26 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146669:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270069.146672:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270069.146676:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e090eb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a0a expref: 26 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.146686:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b200, rc 0) 00000100:00100000:1.0:1788270069.146755:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253159680:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 602us (940us total) trans 0 rc 301/301 00000100:00100000:1.0:1788270069.146763:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:1.0:1788270069.152107:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.152433:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253159936 00000100:00100000:2.0:1788270069.152446:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253159936 00000100:00100000:2.0:1788270069.152541:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:2.0:1788270069.152552:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253159936:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270069.152578:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.152603:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09100 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a11 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.152727:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.152745:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.152757:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.152773:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.152780:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.152787:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153412:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09115 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153429:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09115 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153437:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09115 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270069.153448:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788270069.153473:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153481:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153488:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153494:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.153499:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153507:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153519:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270069.153522:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.153526:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153532:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09107 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270069.153544:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d353fcd5 reply state 00000000dc03dc2e transno 30064771158 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153556:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153562:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff98c1429fa900) 00010000:00010000:2.0:1788270069.153564:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270069.153567:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270069.153593:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09100 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a11 expref: 28 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153607:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09115 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a11 expref: 27 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.153614:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:2.0:1788270069.153617:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788270069.153619:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:2.0:1788270069.153689:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253159936:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1138us (1597us total) trans 30064771158 rc 0/0 00000100:00100000:2.0:1788270069.153697:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788270069.156380:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.156431:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253160192 00000100:00100000:2.0:1788270069.156444:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253160192 00000100:00100000:2.0:1788270069.156505:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:2.0:1788270069.156517:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253160192:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270069.156776:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.156795:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.156812:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270069.156853:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771159 00000004:00010000:2.0:1788270069.156870:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2fdd790 reply state 000000009d066d92 transno 30064771160 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.156883:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.156891:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:2.0:1788270069.156895:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270069.156898:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270069.156991:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:34542:x1875136253160192:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 476us (620us total) trans 30064771160 rc 0/0 00000100:00100000:2.0:1788270069.156998:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000020:00080000:2.0:1788270069.157002:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270069.169364:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270069.169441:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253160320 00000100:00100000:0.0:1788270069.169454:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253160320 00002000:00100000:0.0:1788270069.169687:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc3:0x0] (0->409599) req@ffff98c27a620000 x1875136253160320/t0(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:485/0 lens 488/0 e 0 to 0 dl 1788270080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788270069.169699:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a620000 with x1875136253160320 ext(0->409599) 00002000:00010000:0.0:1788270069.169706:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a620000 00000100:00100000:0.0:1788270069.169743:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788270069.169756:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253160320:12345-192.168.201.42@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1788270069.173676:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.173926:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253160576 00000100:00100000:1.0:1788270069.173937:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253160576 00000100:00100000:1.0:1788270069.173995:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788270069.174004:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:34542:x1875136253160576:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788270069.174111:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270069.174160:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09115 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a11 expref: 31 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174185:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:1.0:1788270069.174190:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270069.174370:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174384:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174394:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174402:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174410:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174414:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174497:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174501:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174505:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788270069.174688:0:45777:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0xb:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1788270069.174759:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174765:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174770:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174774:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270069.174778:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174783:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174793:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:1.0:1788270069.174795:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788270069.174798:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174802:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09138 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174812:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174815:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174818:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174821:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19bc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270069.174823:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174827:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174830:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270069.174832:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270069.174833:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174836:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19bc00/0xc5f5d7a016e0912a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270069.174845:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016146776 reply state 00000000afbe68a8 transno 30064771161 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174854:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.174858:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff98c1429fa900) 00010000:00010000:1.0:1788270069.174859:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270069.174861:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270069.174945:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:34542:x1875136253160576:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 942us (1280us total) trans 30064771161 rc 0/0 00000100:00100000:1.0:1788270069.174951:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788270069.176861:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2400:x1875136253160320:12345-192.168.201.42@tcp:4:mmap_sanity.0 Request processed in 7097us (7499us total) trans 30064771086 rc 0/0 00000100:00100000:1.0:1788270069.176877:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00002000:00100000:1.0:1788270069.176891:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc3:0x0] (0->409599) req@ffff98c27a620000 x1875136253160320/t30064771086(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:485/0 lens 488/448 e 0 to 0 dl 1788270080 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270069.176902:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a620000 with x1875136253160320 ext(0->409599) 00002000:00010000:1.0:1788270069.176910:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a620000 00000100:00100000:2.0:1788270069.178788:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270069.178891:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253160704 00000100:00100000:0.0:1788270069.178901:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253160704 00000100:00100000:0.0:1788270069.178993:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788270069.179002:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:34542:x1875136253160704:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270069.179028:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270069.179134:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0913f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a18 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179285:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179307:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179321:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179339:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179347:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179354:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179400:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179407:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179416:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179422:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270069.179427:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179436:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179450:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270069.179454:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270069.179460:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179466:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09146 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179480:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179486:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179492:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179497:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270069.179499:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179505:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179513:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c1429f1700) 00010000:00010000:0.0:1788270069.179516:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270069.179519:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179525:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0914d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179563:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0913f lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a18 expref: 33 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179576:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270069.179578:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270069.179582:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0913f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a18 expref: 33 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.179591:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fe00, rc 0) 00000100:00100000:0.0:1788270069.179694:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:34542:x1875136253160704:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 692us (916us total) trans 0 rc 301/301 00000100:00100000:0.0:1788270069.179700:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788270069.181560:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.181679:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253160960 00000100:00100000:2.0:1788270069.181690:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253160960 00000100:00100000:2.0:1788270069.181792:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:2.0:1788270069.181802:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:34542:x1875136253160960:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270069.181820:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.181840:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e09154 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a1f expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.181934:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.181947:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.181956:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.181967:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.181972:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.181976:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182518:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182530:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182536:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270069.182547:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 0 00010000:00010000:2.0:1788270069.182577:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182584:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182589:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182593:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.182596:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182601:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182611:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270069.182613:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.182616:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182619:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e0915b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270069.182632:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000826324f reply state 00000000ab6e0792 transno 30064771162 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182639:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182644:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c1429fa800) 00010000:00010000:2.0:1788270069.182645:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270069.182648:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270069.182676:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e09154 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 35 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182691:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 34 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.182702:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270069.182704:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788270069.182707:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbc00, rc 0) 00000100:00100000:2.0:1788270069.182779:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34542:x1875136253160960:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 978us (1229us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1788270069.182787:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:0.0:1788270069.183226:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270069.183254:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253161088 00000100:00100000:0.0:1788270069.183260:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253161088 00000100:00100000:0.0:1788270069.183300:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788270069.183309:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:33917:x1875136253161088:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270069.183323:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788270069.183341:0:45761:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb mtime from disk: 1788270065 -> 1788270069 00002000:00010000:0.0:1788270069.183345:0:45761:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc3:0x0] updating lvb ctime from disk: 1788270065 -> 1788270069 00010000:00010000:0.0:1788270069.183361:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e09074 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019f5 expref: 8 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270069.183380:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270069.183406:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:33917:x1875136253161088:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 99us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270069.183413:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788270069.184910:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.184965:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253161344 00000100:00100000:2.0:1788270069.184972:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253161344 00000100:00100000:2.0:1788270069.185034:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:2.0:1788270069.185068:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34542:x1875136253161344:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270069.185333:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.185346:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.185355:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270069.185390:0:46770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771163 00000004:00010000:2.0:1788270069.185405:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aeca6d6e reply state 000000009715f8ad transno 30064771164 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.185412:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.185418:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270069.185421:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270069.185425:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270069.185518:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34542:x1875136253161344:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 476us (614us total) trans 30064771164 rc 0/0 00000100:00100000:2.0:1788270069.185526:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000020:00080000:2.0:1788270069.185530:0:46770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270069.186473:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.186559:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253161472 00000100:00100000:1.0:1788270069.186566:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253161472 00002000:00100000:1.0:1788270069.186628:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (204800->409599) req@ffff98c27a622680 x1875136253161472/t0(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:485/0 lens 488/0 e 0 to 0 dl 1788270080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270069.186639:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a622680 with x1875136253161472 ext(204800->409599) 00002000:00010000:1.0:1788270069.186644:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a622680 00000100:00100000:1.0:1788270069.186667:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:1.0:1788270069.186674:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253161472:12345-192.168.201.42@tcp:4:ldlm_bl.0 00000100:00080000:2.0:1788270069.186873:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788270069.188729:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270069.189584:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.191314:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253161728 00000100:00100000:2.0:1788270069.191328:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253161728 00000100:00100000:2.0:1788270069.191413:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:2.0:1788270069.191423:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+15:34542:x1875136253161728:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270069.191448:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.191556:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e0917e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a26 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191652:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191667:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191676:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191684:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191689:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191693:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191803:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09193 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191813:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09193 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191820:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09193 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270069.191832:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788270069.191901:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191907:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191912:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191916:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.191920:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191925:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191936:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270069.191938:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.191941:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191948:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e09185 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191957:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191960:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191964:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191967:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.191969:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191972:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191975:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c1429fa800) 00010000:00010000:2.0:1788270069.191977:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.191978:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.191981:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e0918c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.192013:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e0917e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a26 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.192025:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09193 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a26 expref: 17 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.192032:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270069.192034:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270069.192037:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbe00, rc 0) 00000100:00100000:2.0:1788270069.192204:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+17:34542:x1875136253161728:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 781us (2629us total) trans 30064771165 rc 0/0 00000100:00100000:2.0:1788270069.192213:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788270069.193187:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:2401:x1875136253161472:12345-192.168.201.42@tcp:4:ldlm_bl.0 Request processed in 6507us (6713us total) trans 30064771082 rc 0/0 00000100:00100000:1.0:1788270069.193198:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00002000:00100000:1.0:1788270069.193210:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc2:0x0] (204800->409599) req@ffff98c27a622680 x1875136253161472/t30064771082(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:485/0 lens 488/448 e 0 to 0 dl 1788270080 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270069.193288:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a622680 with x1875136253161472 ext(204800->409599) 00002000:00010000:1.0:1788270069.193295:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a622680 00000100:00100000:0.0:1788270069.199235:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270069.199287:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.199404:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253161856 00000100:00100000:2.0:1788270069.199423:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253161856 00000100:00100000:3.0:1788270069.199447:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253162112 00000100:00100000:3.0:1788270069.199465:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253162112 00000100:00100000:2.0:1788270069.199511:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:3.0:1788270069.199525:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788270069.199527:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+10:33916:x1875136253161856:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788270069.199540:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+17:34542:x1875136253162112:12345-192.168.201.42@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1788270069.199548:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270069.199554:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270069.199585:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09193 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a26 expref: 17 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.199611:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:3.0:1788270069.199618:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1788270069.199626:0:46531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb mtime from disk: 1788270067 -> 1788270068 00002000:00010000:2.0:1788270069.199630:0:46531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc2:0x0] updating lvb ctime from disk: 1788270067 -> 1788270068 00010000:00010000:2.0:1788270069.199646:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a40974/0xc5f5d7a016e08fa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019b6 expref: 10 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.199671:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270069.199695:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+16:34542:x1875136253162112:12345-192.168.201.42@tcp:103:mmap_sanity.0 Request processed in 159us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.199698:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+9:33916:x1875136253161856:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 176us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270069.199709:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788270069.201050:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788270069.203463:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.203566:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253162240 00000100:00100000:2.0:1788270069.203578:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253162240 00000100:00100000:2.0:1788270069.203740:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:2.0:1788270069.203753:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+16:34542:x1875136253162240:12345-192.168.201.42@tcp:58:mmap_sanity.0 00000100:00100000:0.0:1788270069.204071:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:2.0:1788270069.204096:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.204131:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 37 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.204142:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.204189:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 37 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.204206:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 37 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270069.204224:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262628096:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270069.204333:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788270069.204409:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253162496 00000100:00100000:1.0:1788270069.204414:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253162496 00000100:00100000:1.0:1788270069.204458:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:1.0:1788270069.204467:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34551:x1875136253162496:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000004:00080000:1.0:1788270069.204662:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1788270069.204748:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.204760:0:45779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.204774:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.204783:0:45779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.204790:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.204801:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.204826:0:45779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270069.204856:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270069.204867:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.204877:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b400 already unused, calling callback (ffffffffc0e7f230) 00000100:00100000:1.0:1788270069.204911:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34551:x1875136253162496:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 443us (868us total) trans 30064771166 rc 0/0 00010000:00010000:3.0:1788270069.204912:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270069.204928:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00010000:00010000:3.0:1788270069.204929:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.204951:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:3.0:1788270069.204954:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788270069.204959:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.204965:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e091a8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270069.204980:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270069.204982:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270069.204984:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270069.209635:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262628096:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270069.209679:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270069.210178:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270069.210321:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253162624 00000100:00100000:1.0:1788270069.210330:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253162624 00010000:00010000:1.0:1788270069.210379:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 39 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270069.210427:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788270069.210438:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2400:x1875136253162624:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270069.210455:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270069.210463:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 39 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.210478:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 39 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.210503:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09169 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a1f expref: 39 pid: 45778 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.210534:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270069.210540:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.210552:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.210560:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270069.210727:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270069.210794:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:2400:x1875136253162624:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 357us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270069.210803:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00010000:00010000:2.0:1788270069.212106:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.212129:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270069.212290:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].4, 136 off8736 00000100:00100000:2.0:1788270069.212402:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+16:34542:x1875136253162240:12345-192.168.201.42@tcp:58:mmap_sanity.0 Request processed in 8647us (8946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.212413:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:0.0:1788270069.218424:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.218566:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253162752 00000100:00100000:2.0:1788270069.218581:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253162752 00000100:00100000:2.0:1788270069.218768:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:2.0:1788270069.218780:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+16:34542:x1875136253162752:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270069.218807:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.218832:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a2d expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.219137:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.219150:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.219175:0:46770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.219193:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.219210:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270069.219214:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270069.219218:0:46770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.219227:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821daa00, rc 0) 00000100:00100000:2.0:1788270069.219338:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+17:34542:x1875136253162752:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 559us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.219346:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000040:00080000:2.0:1788270069.956506:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270069.957554:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270069.957611:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 5 count 5 00000040:00080000:2.0:1788270069.957625:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270069.957823:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262628224:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788270069.957936:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270069.962994:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262628224:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270069.964240:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.964336:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253162880 00000100:00100000:2.0:1788270069.964347:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253162880 00000100:00100000:2.0:1788270069.964456:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:2.0:1788270069.964468:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34554:x1875136253162880:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270069.964525:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270069.964677:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34554:x1875136253162880:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 210us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.964686:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:0.0:1788270069.971349:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.971681:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253163008 00000100:00100000:2.0:1788270069.971696:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253163008 00000100:00100000:2.0:1788270069.971776:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:2.0:1788270069.971788:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34554:x1875136253163008:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270069.971898:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.971919:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.971935:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.971955:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.971963:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.971970:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.972000:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.972010:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.972017:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270069.972123:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1788270069.972129:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270069.972146:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973344:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973358:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973367:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973373:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.973378:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973387:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973406:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:2.0:1788270069.973410:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.973416:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973423:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e091b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973444:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973449:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973456:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973461:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.973465:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973471:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973491:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xadcadaa3 (ffff98c1429fa000) 00010000:00010000:2.0:1788270069.973495:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.973498:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973504:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e091bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973524:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973530:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973536:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973541:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.973544:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973550:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973557:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270069.973560:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270069.973563:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.973568:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e091c4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270069.973685:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34554:x1875136253163008:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 1895us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.973695:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:3.0:1788270069.976560:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.976741:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253163264 00000100:00100000:2.0:1788270069.976754:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253163264 00000100:00100000:2.0:1788270069.976837:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:2.0:1788270069.976851:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34554:x1875136253163264:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270069.976880:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.976907:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e091cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a34 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977077:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977095:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977121:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270069.977135:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788270069.977247:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977257:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977266:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977273:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270069.977278:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977288:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977301:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270069.977305:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270069.977310:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977317:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091d2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977365:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e091cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a34 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977377:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:2.0:1788270069.977379:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270069.977384:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e091cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a34 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.977397:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbe00, rc 0) 00000100:00100000:2.0:1788270069.977759:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34554:x1875136253163264:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 909us (1211us total) trans 30064771167 rc 301/301 00000100:00100000:2.0:1788270069.977772:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:0.0:1788270069.984501:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.984573:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253163392 00000100:00100000:2.0:1788270069.984587:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253163392 00000100:00100000:2.0:1788270069.984669:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:2.0:1788270069.984681:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34554:x1875136253163392:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270069.984730:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270069.984890:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34554:x1875136253163392:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 210us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270069.984899:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788270069.992963:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270069.993097:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253163648 00000100:00100000:2.0:1788270069.993124:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253163648 00000100:00100000:2.0:1788270069.993312:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:2.0:1788270069.993327:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34554:x1875136253163648:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270069.993355:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270069.993383:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091e0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a3b expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270069.996205:0:45778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc3:0x0], index 1: 0 00010000:00010000:2.0:1788270069.996433:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e091e7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.996454:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e091e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.996468:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e091e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.996568:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091e0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a3b expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.996592:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e091e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a3b expref: 41 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270069.996602:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c1429fa000) 00010000:00010000:2.0:1788270069.996606:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270069.996610:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:2.0:1788270069.996698:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34554:x1875136253163648:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3374us (3746us total) trans 30064771168 rc 0/0 00000100:00100000:2.0:1788270069.996706:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788270070.002487:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.002844:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253163904 00000100:00100000:2.0:1788270070.002858:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253163904 00000100:00100000:2.0:1788270070.003600:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:2.0:1788270070.003617:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34554:x1875136253163904:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270070.003702:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270070.003739:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e091e7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a3b expref: 41 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003763:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c1429fa000) 00010000:00010000:2.0:1788270070.003777:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270070.003807:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003825:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003837:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003855:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003863:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003870:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003935:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003943:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003950:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003957:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.003964:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003973:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003983:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270070.003986:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.003991:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.003998:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e091f5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004007:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004014:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004020:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004024:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.004027:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004033:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004074:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x1decf1f0 (ffff98c1429fae00) 00010000:00010000:2.0:1788270070.004077:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.004081:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.004088:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e091fc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x1decf1f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.004219:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34554:x1875136253163904:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 606us (1743us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270070.004228:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:0.0:1788270070.007769:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.007855:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253164032 00000100:00100000:1.0:1788270070.007867:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253164032 00000100:00100000:1.0:1788270070.007958:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:1.0:1788270070.007969:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34554:x1875136253164032:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270070.007992:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270070.008019:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09203 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a42 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.008077:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.008091:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.008115:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.008258:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09203 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 42 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.008281:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 41 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.008291:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:1.0:1788270070.008295:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270070.008298:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b000, rc 0) 00000100:00100000:1.0:1788270070.008401:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34554:x1875136253164032:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 434us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.008408:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788270070.011723:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.012188:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253164288 00000100:00100000:1.0:1788270070.012201:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253164288 00000100:00100000:1.0:1788270070.012261:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788270070.012271:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34554:x1875136253164288:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788270070.012382:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.012401:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.012414:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270070.012621:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].4, 88 off8496 00000004:00010000:1.0:1788270070.012683:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d843d2eb reply state 000000007d8b04be transno 30064771169 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.012699:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.012708:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:1.0:1788270070.012711:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788270070.012715:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270070.012818:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:34554:x1875136253164288:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 548us (1106us total) trans 30064771169 rc 0/0 00000100:00100000:1.0:1788270070.012826:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:3.0:1788270070.016296:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.016378:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253164416 00000100:00100000:2.0:1788270070.016391:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253164416 00000100:00100000:2.0:1788270070.016457:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:2.0:1788270070.016466:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:34554:x1875136253164416:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270070.016493:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270070.016514:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a49 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.016585:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.016599:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.016620:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:2.0:1788270070.016624:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270070.016629:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:2.0:1788270070.016698:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:34554:x1875136253164416:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 232us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.016703:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:0.0:1788270070.019391:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.019521:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253164544 00000100:00100000:1.0:1788270070.019534:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253164544 00000100:00100000:1.0:1788270070.019623:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788270070.019635:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253164544:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788270070.019903:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253164544:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 269us (522us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1788270070.019912:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00080000:2.0:1788270070.020861:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270070.022466:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.022531:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253164800 00000100:00100000:2.0:1788270070.022544:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253164800 00000100:00100000:2.0:1788270070.022644:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788270070.022657:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:34554:x1875136253164800:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270070.022931:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34554:x1875136253164800:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 277us (474us total) trans 30064771170 rc 0/0 00000100:00100000:2.0:1788270070.022942:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788270070.025001:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.025251:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165056 00000100:00100000:1.0:1788270070.025262:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165056 00000100:00100000:1.0:1788270070.025353:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:1.0:1788270070.025365:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34554:x1875136253165056:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788270070.025494:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34554:x1875136253165056:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 131us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.025502:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:3.0:1788270070.027492:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.027827:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165184 00000100:00100000:0.0:1788270070.027838:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165184 00000100:00100000:0.0:1788270070.027906:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:0.0:1788270070.027961:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:34554:x1875136253165184:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270070.027985:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270070.028011:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0921f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a50 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.028200:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09226 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.028219:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09226 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.028232:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09226 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270070.028297:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270070.028323:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09226 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.028358:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0921f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a50 expref: 47 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.028380:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09226 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a50 expref: 46 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.028390:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:0.0:1788270070.028394:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788270070.028397:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f800, rc 0) 00000100:00100000:0.0:1788270070.028665:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34554:x1875136253165184:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 749us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.028672:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:0.0:1788270070.030912:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.030973:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165312 00000100:00100000:0.0:1788270070.030984:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165312 00000100:00100000:0.0:1788270070.031056:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:0.0:1788270070.031066:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253165312:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270070.031086:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270070.031126:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a57 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270070.031159:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d5f6, blocks: 0x0 00010000:00010000:0.0:1788270070.031182:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=861s v=(0 0) 00010000:00010000:0.0:1788270070.031188:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270070.031199:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 10 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.031219:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 10 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.031235:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ea00, rc 0) 00000100:00100000:0.0:1788270070.031282:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253165312:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 218us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.031290:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:3.0:1788270070.033553:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.033757:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165568 00000100:00100000:1.0:1788270070.033769:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165568 00000100:00100000:2.0:1788270070.033872:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:2.0:1788270070.033888:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34554:x1875136253165568:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270070.034023:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34554:x1875136253165568:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 140us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.034031:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:0.0:1788270070.037350:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.037509:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165696 00000100:00100000:1.0:1788270070.037522:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165696 00000100:00100000:1.0:1788270070.037624:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788270070.037636:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:34554:x1875136253165696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270070.037661:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270070.037686:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a5e expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.037724:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 11 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.037735:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270070.037739:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270070.037745:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 11 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.037785:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 11 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.037801:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 11 pid: 48231 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.037818:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c308e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262628352:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270070.037916:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788270070.040718:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.040811:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165824 00000100:00100000:2.0:1788270070.040822:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165824 00010000:00010000:2.0:1788270070.040874:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 12 pid: 48231 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.040919:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788270070.040929:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253165824:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270070.040946:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270070.040973:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 12 pid: 48231 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.040989:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 12 pid: 48231 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.041019:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270070.041024:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270070.041034:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 12 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.041071:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 12 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.041230:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 12 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.041249:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262628480:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270070.041343:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270070.043810:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262628480:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270070.043847:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270070.043903:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253165824:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 2974us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.043915:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00010000:00010000:1.0:1788270070.045063:0:47284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541f7679/0xc5f5d7a016e0922d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a57 expref: 11 pid: 48231 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.045088:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c308e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262628352:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270070.045134:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 10 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.045153:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b800, rc 0) 00000100:00100000:1.0:1788270070.045213:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:34554:x1875136253165696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 7579us (7875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.045222:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:2.0:1788270070.048942:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.049012:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253165952 00000100:00100000:1.0:1788270070.049025:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253165952 00002000:00100000:1.0:1788270070.049098:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c27fb73800 x1875136253165952/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:486/0 lens 4584/0 e 0 to 0 dl 1788270081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270070.049128:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73800 with x1875136253165952 ext(0->4095) 00002000:00010000:1.0:1788270070.049135:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb73800 00000100:00100000:1.0:1788270070.049169:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788270070.049180:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253165952:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788270070.050683:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253165952:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 1492us (1742us total) trans 30064771084 rc 0/0 00000100:00100000:1.0:1788270070.050699:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00002000:00100000:1.0:1788270070.050711:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c27fb73800 x1875136253165952/t30064771084(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:486/0 lens 4584/448 e 0 to 0 dl 1788270081 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788270070.050723:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73800 with x1875136253165952 ext(0->4095) 00002000:00010000:1.0:1788270070.050729:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb73800 00000100:00100000:3.0:1788270070.053801:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.053895:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253166080 00000100:00100000:0.0:1788270070.053908:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253166080 00000100:00100000:0.0:1788270070.053976:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:0.0:1788270070.053987:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:34554:x1875136253166080:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788270070.055705:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771170 is committed 00000001:00080000:1.0:1788270070.055740:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771165 is committed 00010000:00010000:2.0:1788270070.055744:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055761:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788270070.055761:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1788270070.055773:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055780:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.055786:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055800:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788270070.055817:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c24bb23840 refcount 2 committed 0 result 0 batchid 25769803838 00010000:00010000:2.0:1788270070.055823:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff98c1429f1200) 00000020:00080000:1.0:1788270070.055825:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c1449c4600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c24bb233c0 00010000:00010000:2.0:1788270070.055829:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1788270070.055832:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c1449c4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c247996c00 00010000:00010000:2.0:1788270070.055836:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055843:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09043 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788270070.055868:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803837 batchid updated 00010000:00010000:2.0:1788270070.055878:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055885:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055891:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055897:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.055900:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055907:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055914:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff98c143878000) 00010000:00010000:2.0:1788270070.055916:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.055919:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055925:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0909e lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055941:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055947:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055953:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055958:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.055961:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055967:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055973:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff98c1429faf00) 00010000:00010000:2.0:1788270070.055975:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.055978:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055983:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e090d6 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.055995:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.056001:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.056008:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.056013:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.056016:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.056022:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.056028:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff98c1429fa900) 00010000:00010000:2.0:1788270070.056030:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.056032:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788270070.056078:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803838 committed batchid 25769803837 00000020:00080000:0.0:1788270070.056165:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803837 00000100:00100000:0.0:1788270070.056313:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34554:x1875136253166080:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 2322us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.056324:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:3.0:1788270070.056513:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270070.056532:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262628608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788270070.056595:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788270070.057046:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0910e lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057073:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057081:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057088:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057095:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.057110:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057123:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057138:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:2.0:1788270070.057140:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.057144:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057150:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09123 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057167:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057173:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057180:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057185:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19be00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.057187:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057193:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057199:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff98c1429fa900) 00010000:00010000:2.0:1788270070.057201:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.057204:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057211:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09131 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057225:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057230:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057237:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057242:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.057245:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057251:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057257:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c1429fa800) 00010000:00010000:2.0:1788270070.057259:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.057262:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057267:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e09162 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057280:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057286:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057293:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057298:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.057301:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057306:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057312:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270070.057315:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.057317:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057323:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09177 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057332:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057337:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057340:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057344:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.057347:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057356:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057363:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:2.0:1788270070.057365:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270070.057369:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.057375:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09211 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270070.059340:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262628608 00000100:00100000:0.0:1788270070.059359:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262628608 00000100:00100000:2.0:1788270070.059413:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00080000:1.0:1788270070.059566:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270070.060269:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253166208 00000100:00100000:0.0:1788270070.060277:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253166208 00000100:00100000:0.0:1788270070.060324:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788270070.060335:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262628608:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788270070.060365:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:2.0:1788270070.060374:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253166208:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00002000:00080000:0.0:1788270070.060376:0:48230:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:194 count 1 00002000:00010000:0.0:1788270070.060419:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a96d5f4, atime: 0x6a96d5f1, ctime: 0x6a96d5f4, blocks: 0x320 00010000:00010000:0.0:1788270070.060429:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.060675:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=861s v=(0 0) 00010000:00010000:0.0:1788270070.060682:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270070.060690:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.060709:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.060720:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.060729:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.060753:0:48230:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270070.060859:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270070.060868:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.060881:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270070.060887:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.060898:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.060918:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.060927:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814ba2a3/0xc5f5d7a016e0923b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.060951:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270070.060953:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270070.060954:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270070.061747:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262628608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1410us (5147us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1788270070.061757:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1788270070.061781:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c2c7480/2, rc 0, transno 30064771085 00000100:00100000:2.0:1788270070.061799:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262628608:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788270070.062706:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771084 is committed 00000001:00080000:2.0:1788270070.062722:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771082 is committed 00000001:00080000:2.0:1788270070.062738:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771079 is committed 00000100:00100000:3.0:1788270070.062880:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253166208:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 2503us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270070.062891:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788270070.065996:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.066227:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253166464 00000100:00100000:3.0:1788270070.066240:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253166464 00000100:00100000:2.0:1788270070.066405:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788270070.066418:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34554:x1875136253166464:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270070.066488:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270070.066527:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09226 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a50 expref: 13 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.066551:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:2.0:1788270070.066556:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270070.066592:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.066605:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.069216:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270070.069414:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004aeed20d reply state 0000000084cb9869 transno 30064771171 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.069449:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.069460:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:2.0:1788270070.069463:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270070.069470:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270070.069622:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34554:x1875136253166464:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 3201us (3632us total) trans 30064771171 rc 0/0 00000100:00100000:2.0:1788270070.069633:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:0.0:1788270070.071698:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.071799:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253166592 00000100:00100000:1.0:1788270070.071812:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253166592 00000100:00100000:1.0:1788270070.071915:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788270070.071926:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253166592:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788270070.072151:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1788270070.072156:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788270069 00002000:00010000:1.0:1788270070.072159:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb atime from disk: 0 -> 1788270069 00002000:00010000:1.0:1788270070.072161:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb ctime from disk: 1788270070 -> 1788270069 00002000:00010000:1.0:1788270070.072164:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788270070.072235:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253166592:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 311us (548us total) trans 30064771086 rc 0/0 00000100:00100000:1.0:1788270070.072243:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:3.0:1788270070.073931:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.074116:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253166848 00000100:00100000:2.0:1788270070.074129:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253166848 00000100:00100000:2.0:1788270070.074210:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:2.0:1788270070.074222:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:34554:x1875136253166848:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788270070.074311:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.074331:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 14 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.074347:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.074390:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 14 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.074405:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 14 pid: 45777 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.074423:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262628736:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270070.074509:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270070.078796:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.078829:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262628736:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270070.078868:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270070.078939:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253166976 00000100:00100000:3.0:1788270070.078948:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253166976 00010000:00010000:3.0:1788270070.078991:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 15 pid: 45777 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270070.079169:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788270070.079184:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253166976:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270070.079203:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270070.079213:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 15 pid: 45777 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.079228:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 15 pid: 45777 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.079254:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0920a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a42 expref: 15 pid: 45777 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.079274:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:0.0:1788270070.079280:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.079292:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.079301:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.079330:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270070.079673:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079682:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079729:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079737:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079744:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079756:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.079761:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079769:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079780:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:1.0:1788270070.079782:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788270070.079787:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.079793:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09249 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270070.079916:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253166976:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 734us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.079924:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:1.0:1788270070.079995:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34554:x1875136253166848:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 5776us (6074us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788270070.080004:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:0.0:1788270070.082637:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.082749:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253167104 00000100:00100000:3.0:1788270070.082762:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253167104 00000100:00100000:3.0:1788270070.082850:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788270070.082862:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2403:x1875136253167104:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788270070.082920:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.082943:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.082954:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270070.082960:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270070.082965:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.083006:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.083023:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 7 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270070.083076:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262628864:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270070.083188:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1437a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788270070.086181:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.086253:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253167232 00000100:00100000:1.0:1788270070.086264:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253167232 00010000:00010000:1.0:1788270070.086308:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 8 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.086356:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788270070.086367:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253167232:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270070.086383:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270070.086406:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 8 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.086438:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 8 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.086473:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270070.086478:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270070.086485:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.086497:0:45763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.086520:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270070.086582:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253167232:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 216us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.086589:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00010000:00010000:3.0:1788270070.086825:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09234 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a5e expref: 7 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270070.086842:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262628864:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270070.086981:0:48231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.086993:0:48231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087001:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087022:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087030:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087141:0:48231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087151:0:48231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270070.087156:0:48231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087172:0:48231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087186:0:48231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.087193:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09250 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270070.087259:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253167104:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 4398us (4634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270070.087268:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:0.0:1788270070.089991:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.090096:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253167488 00000100:00100000:2.0:1788270070.090264:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253167488 00000100:00100000:2.0:1788270070.090344:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:2.0:1788270070.090357:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:34554:x1875136253167488:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788270070.090464:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090486:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090500:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090758:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090770:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 14 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090776:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090810:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 14 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.090821:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 14 pid: 46770 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.090835:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262628992:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270070.090926:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270070.093601:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262628992:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270070.093703:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270070.093817:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.094152:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253167616 00000100:00100000:2.0:1788270070.094161:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253167616 00010000:00010000:2.0:1788270070.094204:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 15 pid: 46770 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.094251:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:2.0:1788270070.094262:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253167616:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270070.094280:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270070.094288:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 15 pid: 46770 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.094300:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 15 pid: 46770 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.094327:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09218 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a49 expref: 15 pid: 46770 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.094358:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:2.0:1788270070.094363:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.094374:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.094381:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.094419:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270070.094473:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.094482:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270070.094486:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253167616:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 226us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.094494:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000001:00080000:1.0:1788270070.094630:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771172 00000001:00080000:1.0:1788270070.094765:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771173 00000001:00080000:1.0:1788270070.094806:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771174 00000100:00100000:1.0:1788270070.094887:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262629120:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270070.094943:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270070.094991:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249132a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788270070.095109:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262629120 00000100:00100000:2.0:1788270070.095115:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262629120 00000100:00100000:2.0:1788270070.095147:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788270070.095154:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262629120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270070.096172:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262629120:12345-0@lo:1000:mdt00_000.0 Request processed in 1013us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.096183:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788270070.096765:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771079 gen 2 00000004:00080000:3.0:1788270070.096774:0:45776:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771079 committed transno 30064771079 00000100:00100000:3.0:1788270070.096806:0:45776:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c27c2c7480 x1875136262628608/t30064771085(30064771085) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788270086 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270070.096818:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262629120:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788270070.096983:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771175 00000100:00100000:2.0:1788270070.100288:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262629248:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270070.100399:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270070.100504:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788270070.104245:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262629248 00000100:00100000:3.0:1788270070.104270:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262629248 00000100:00100000:2.0:1788270070.104441:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788270070.104454:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262629248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270070.104745:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:45776:x1875136262629248:12345-0@lo:1000:mdt00_000.0 Request processed in 293us (4345us total) trans 30064771087 rc 0/0 00000100:00100000:2.0:1788270070.104755:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788270070.104877:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262629248:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788270070.104931:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.104939:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.104946:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.104952:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.104955:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.104961:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.104978:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:1.0:1788270070.104981:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270070.104984:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.104989:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0925e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105014:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105018:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105021:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105025:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.105027:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105031:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105035:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270070.105036:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270070.105130:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 10 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105143:0:45776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 10 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105152:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 10 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.105192:0:45776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 10 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.105205:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262629376:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788270070.105291:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788270070.109717:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.109837:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253167744 00000100:00100000:0.0:1788270070.109851:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253167744 00000100:00100000:0.0:1788270070.109974:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788270070.109987:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+11:34542:x1875136253167744:12345-192.168.201.42@tcp:49:mmap_sanity.0 00000100:00100000:0.0:1788270070.110187:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+11:34542:x1875136253167744:12345-192.168.201.42@tcp:49:mmap_sanity.0 Request processed in 202us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.110195:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788270070.110282:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262629376:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788270070.110314:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110331:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e091a1 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110371:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110387:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110401:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110412:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110418:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110425:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110432:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19aa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.110436:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110444:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110457:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270070.110460:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270070.110464:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110470:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09265 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110482:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110488:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110493:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110498:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.110500:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110505:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110513:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270070.110515:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270070.110518:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.110524:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09257 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.110687:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34554:x1875136253167488:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 20332us (20708us total) trans 30064771176 rc 0/0 00000100:00100000:1.0:1788270070.110696:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 147 00000020:00080000:1.0:1788270070.110701:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788270070.110910:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270070.110917:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270070.110936:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 5 count 5 00000040:00080000:2.0:1788270070.110944:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270070.112620:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.112730:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168000 00000100:00100000:2.0:1788270070.112814:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168000 00000100:00100000:2.0:1788270070.112968:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788270070.112981:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:34554:x1875136253168000:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270070.113390:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.113416:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168128 00000100:00100000:3.0:1788270070.113422:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168128 00000100:00100000:3.0:1788270070.113466:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788270070.113474:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:34542:x1875136253168128:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270070.113486:0:47283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270070.113513:0:47283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a65 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270070.113543:0:47283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3:0x0] initial LVB size: 4096, mtime: 0x6a96d5f5, atime: 0x6a96d5f5, ctime: 0x6a96d5f5, blocks: 0x8 00010000:00010000:3.0:1788270070.113566:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=861s v=(0 0) 00010000:00010000:3.0:1788270070.113570:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270070.113580:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 6 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.113599:0:47283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 6 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.113614:0:47283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ea00, rc 0) 00000100:00100000:3.0:1788270070.113681:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:34542:x1875136253168128:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 207us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270070.113688:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000004:00080000:2.0:1788270070.116499:0:45780:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788270070.116550:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771177 00010000:00010000:2.0:1788270070.116595:0:45780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.116615:0:45780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.116630:0:45780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.116640:0:45780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.116647:0:45780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.116658:0:45780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.116685:0:45780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270070.116850:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270070.116858:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.116867:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270070.116872:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.116881:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.116897:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:0.0:1788270070.116900:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270070.116904:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.116910:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09273 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.116928:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270070.116930:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270070.116932:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270070.117263:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34554:x1875136253168000:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 4280us (4647us total) trans 30064771178 rc 0/0 00000100:00100000:2.0:1788270070.117275:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000020:00080000:2.0:1788270070.117282:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270070.117305:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.117342:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168256 00000100:00100000:3.0:1788270070.117353:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168256 00002000:00100000:3.0:1788270070.117409:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c265e71500 x1875136253168256/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:486/0 lens 488/0 e 0 to 0 dl 1788270081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788270070.117421:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c265e71500 with x1875136253168256 ext(0->4095) 00002000:00010000:3.0:1788270070.117427:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c265e71500 00000100:00100000:3.0:1788270070.117513:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788270070.117523:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253168256:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:3.0:1788270070.118889:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253168256:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 825us (1042us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788270070.118903:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00002000:00100000:3.0:1788270070.118916:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c265e71500 x1875136253168256/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:486/0 lens 488/4536 e 0 to 0 dl 1788270081 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788270070.118927:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c265e71500 with x1875136253168256 ext(0->4095) 00002000:00010000:3.0:1788270070.118933:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c265e71500 00000100:00100000:0.0:1788270070.122235:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.122319:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168384 00000100:00100000:2.0:1788270070.122333:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168384 00000100:00100000:2.0:1788270070.122429:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:2.0:1788270070.122452:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:34542:x1875136253168384:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788270070.122482:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270070.122510:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0927a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a6c expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.122576:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0927a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a6c expref: 20 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.122591:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0927a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a6c expref: 20 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.122612:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:2.0:1788270070.122615:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270070.122620:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ce00, rc 0) 00000100:00100000:2.0:1788270070.122694:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34542:x1875136253168384:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 255us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.122706:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:3.0:1788270070.125251:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.125374:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168512 00000100:00100000:1.0:1788270070.125386:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168512 00000100:00100000:1.0:1788270070.125462:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788270070.125474:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:34542:x1875136253168512:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270070.125496:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270070.125520:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a73 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.125559:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 5 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.125570:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270070.125574:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270070.125581:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.125692:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 5 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.125709:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 5 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.125736:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262629504:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270070.125832:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788270070.128519:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.129204:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168640 00000100:00100000:3.0:1788270070.129218:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168640 00002000:00100000:3.0:1788270070.129285:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c1451c3480 x1875136253168640/t0(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:486/0 lens 4584/0 e 0 to 0 dl 1788270081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788270070.129298:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c3480 with x1875136253168640 ext(0->4095) 00010000:00010000:3.0:1788270070.129310:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 6 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.129330:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 6 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270070.129340:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c1451c3480 00000100:00100000:3.0:1788270070.129380:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788270070.129392:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253168640:12345-192.168.201.42@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1788270070.130559:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253168640:12345-192.168.201.42@tcp:4:ldlm_bl.0 Request processed in 1161us (2045us total) trans 30064771088 rc 0/0 00000100:00100000:3.0:1788270070.130573:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00002000:00100000:3.0:1788270070.130582:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c1451c3480 x1875136253168640/t30064771088(0) o4->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:486/0 lens 4584/448 e 0 to 0 dl 1788270081 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788270070.130593:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c3480 with x1875136253168640 ext(0->4095) 00010000:00010000:3.0:1788270070.130601:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 8 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.130695:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 8 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270070.130705:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c1451c3480 00000100:00100000:1.0:1788270070.131827:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262629504:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270070.131869:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.131888:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b800, rc 0) 00000100:00100000:1.0:1788270070.131947:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:34542:x1875136253168512:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 6475us (6706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.131957:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788270070.135408:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.135656:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168768 00000100:00100000:1.0:1788270070.135666:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168768 00010000:00010000:1.0:1788270070.135712:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 8 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.135757:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:1.0:1788270070.135768:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253168768:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270070.135787:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788270070.135813:0:45761:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb mtime from disk: 1788270069 -> 1788270070 00002000:00010000:1.0:1788270070.135815:0:45761:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc3:0x0] updating lvb ctime from disk: 1788270069 -> 1788270070 00010000:00010000:1.0:1788270070.135821:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 8 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.135834:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 8 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.135855:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e0926c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a65 expref: 8 pid: 47283 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.135877:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270070.135881:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270070.135889:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.135896:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.135943:0:45761:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270070.135962:0:45761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:45761:1875136262629632:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788270070.136085:0:45761:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270070.138123:0:45761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:45761:1875136262629632:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788270070.138155:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270070.138224:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2401:x1875136253168768:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 2452us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.138237:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:3.0:1788270070.139239:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.139323:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253168896 00000100:00100000:1.0:1788270070.139330:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253168896 00002000:00100000:1.0:1788270070.139387:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c265e73800 x1875136253168896/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:486/0 lens 488/0 e 0 to 0 dl 1788270081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270070.139397:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c265e73800 with x1875136253168896 ext(0->4095) 00002000:00010000:1.0:1788270070.139402:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c265e73800 00000100:00100000:1.0:1788270070.139429:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:1.0:1788270070.139440:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253168896:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:1.0:1788270070.139682:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253168896:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 243us (447us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788270070.139690:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00002000:00100000:1.0:1788270070.139697:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c265e73800 x1875136253168896/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:486/0 lens 488/4536 e 0 to 0 dl 1788270081 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270070.139706:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c265e73800 with x1875136253168896 ext(0->4095) 00002000:00010000:1.0:1788270070.139709:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c265e73800 00000100:00100000:0.0:1788270070.143005:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.144240:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253169024 00000100:00100000:3.0:1788270070.144256:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253169024 00000100:00100000:3.0:1788270070.144320:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788270070.144330:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:34542:x1875136253169024:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788270070.144354:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270070.144379:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a7a expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.144417:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.144434:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270070.144438:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1788270070.144444:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a7a expref: 8 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.144485:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 6 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.144501:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 6 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270070.144517:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262629760:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270070.144806:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c245610000 going to sleep for 11 seconds 00000100:00100000:3.0:1788270070.150265:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262629760:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270070.150328:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a7a expref: 8 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.150361:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f200, rc 0) 00000100:00100000:3.0:1788270070.150797:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:34542:x1875136253169024:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 6465us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270070.150808:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:1.0:1788270070.154728:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.155015:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253169152 00000100:00100000:0.0:1788270070.155029:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253169152 00010000:00010000:0.0:1788270070.155180:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 7 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270070.155235:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788270070.155248:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253169152:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270070.155269:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270070.155299:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 7 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.155316:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 7 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.155344:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a849ae04/0xc5f5d7a016e09281 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a73 expref: 7 pid: 47284 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.155367:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788270070.155372:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788270070.155382:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a7a expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.155395:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a7a expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.155988:0:48804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a7a expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270070.156009:0:48804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262629888:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788270070.156267:0:48804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295000 going to sleep for 11 seconds 00000100:00100000:2.0:1788270070.164059:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.164150:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253169280 00000100:00100000:1.0:1788270070.164163:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253169280 00002000:00100000:1.0:1788270070.164224:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c1451c0380 x1875136253169280/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:486/0 lens 488/0 e 0 to 0 dl 1788270081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00000100:00100000:0.0:1788270070.164224:0:48804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262629888:192.168.201.42@tcp:105: 00002000:00100000:1.0:1788270070.164235:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c0380 with x1875136253169280 ext(0->4095) 00002000:00010000:1.0:1788270070.164241:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1451c0380 00010000:00010000:0.0:1788270070.164250:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270070.164271:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270070.164280:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253169280:12345-192.168.201.42@tcp:3:kworker.0 00000100:00100000:0.0:1788270070.164312:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253169152:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 9067us (9599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.164322:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270070.164439:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:2401:x1875136253169280:12345-192.168.201.42@tcp:3:kworker.0 Request processed in 158us (412us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788270070.164447:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00002000:00100000:1.0:1788270070.164453:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc3:0x0] (0->4095) req@ffff98c1451c0380 x1875136253169280/t0(0) o3->04ecb0d1-118e-4eab-bf07-e32490d1fd1f@192.168.201.42@tcp:486/0 lens 488/4536 e 0 to 0 dl 1788270081 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788270070.164469:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c0380 with x1875136253169280 ext(0->4095) 00002000:00010000:1.0:1788270070.164472:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1451c0380 00000100:00100000:2.0:1788270070.172137:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.172225:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253169536 00000100:00100000:0.0:1788270070.172242:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253169536 00000100:00100000:0.0:1788270070.172374:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788270070.172395:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144b18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+11:34542:x1875136253169536:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000001:00080000:0.0:1788270070.172784:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771179 00000100:00100000:0.0:1788270070.173185:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144b18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+13:34542:x1875136253169536:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 793us (1059us total) trans 30064771180 rc 0/0 00000100:00100000:0.0:1788270070.173194:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000020:00080000:0.0:1788270070.173203:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270070.177309:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.177399:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253169792 00000100:00100000:2.0:1788270070.177414:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253169792 00000100:00100000:2.0:1788270070.177493:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788270070.177506:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:34542:x1875136253169792:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788270070.178844:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253169792:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 1332us (1540us total) trans 30064771181 rc 0/0 00000100:00100000:2.0:1788270070.178857:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788270070.183967:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.184086:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253169920 00000100:00100000:1.0:1788270070.184108:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253169920 00000100:00100000:1.0:1788270070.184181:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:1.0:1788270070.184192:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:34542:x1875136253169920:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270070.184222:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270070.184247:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0928f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a81 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184328:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184345:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184359:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184376:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184383:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184390:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184499:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184510:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184517:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270070.184561:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1788270070.184566:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270070.184587:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184599:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184609:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184615:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184622:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184628:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.184633:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184640:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184655:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270070.184659:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270070.184664:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184670:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09296 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184688:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184694:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184700:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184706:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19be00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.184709:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184715:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184723:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c14387fd00) 00010000:00010000:1.0:1788270070.184725:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270070.184728:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184734:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e0929d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184770:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e0928f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a81 expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184785:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a81 expref: 22 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.184792:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270070.184794:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270070.184797:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ac00, rc 0) 00000100:00100000:1.0:1788270070.184874:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253169920:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 683us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270070.184882:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:0.0:1788270070.190156:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.192186:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253170176 00000100:00100000:1.0:1788270070.192202:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253170176 00000100:00100000:1.0:1788270070.192327:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 150 00000100:00100000:1.0:1788270070.192337:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253170176:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788270070.192399:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788270070.192431:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e092a4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a81 expref: 22 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192459:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0927a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a6c expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192471:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270070.192477:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270070.192509:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192525:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192536:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192551:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192556:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192560:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192645:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192653:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192660:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270070.192915:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].5, 64 off8560 00000004:00080000:1.0:1788270070.192925:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 861899884626ns, next at 862899881110ns, rc = 0 00010000:00010000:1.0:1788270070.192973:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192980:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192990:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192995:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.192999:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193003:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193021:0:45776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270070.193070:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270070.193078:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193078:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193085:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193090:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.193096:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270070.193117:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.193125:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.193136:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:3.0:1788270070.193139:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788270070.193143:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.193149:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e092c0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193159:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270070.193163:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270070.193164:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270070.193165:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270070.193167:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270070.193171:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193177:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:1.0:1788270070.193180:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788270070.193183:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193189:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092b9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193204:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193210:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193216:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193221:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270070.193224:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193231:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193238:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:1.0:1788270070.193241:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270070.193243:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193247:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ab lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270070.193254:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000366f49db reply state 0000000035be6eaa transno 30064771182 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193266:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.193270:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c14387f600) 00010000:00010000:1.0:1788270070.193272:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270070.193274:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270070.193358:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253170176:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 1021us (3216us total) trans 30064771182 rc 0/0 00000100:00100000:1.0:1788270070.193365:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 150 00000100:00100000:2.0:1788270070.197470:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.197770:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253170432 00000100:00100000:0.0:1788270070.197782:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253170432 00000100:00100000:0.0:1788270070.197845:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 151 00000100:00100000:0.0:1788270070.197854:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:34542:x1875136253170432:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270070.197883:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270070.197904:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e092c7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a88 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198010:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198023:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198032:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198072:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198081:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198088:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198587:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e092dc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198596:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e092dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198601:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e092dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270070.198609:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788270070.198637:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198645:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198652:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198659:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270070.198664:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198672:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198685:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270070.198687:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270070.198692:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198697:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e092ce lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270070.198707:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af9f1942 reply state 0000000040b9eabc transno 30064771183 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198714:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198721:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff98c1429f1300) 00010000:00010000:0.0:1788270070.198723:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270070.198725:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270070.198750:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e092c7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a88 expref: 25 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198759:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e092dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a88 expref: 24 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.198765:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff98c1429f1600) 00010000:00010000:0.0:1788270070.198767:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270070.198768:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ee00, rc 0) 00000100:00100000:0.0:1788270070.198835:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253170432:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 984us (1379us total) trans 30064771183 rc 0/0 00000100:00100000:0.0:1788270070.198841:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 151 00010000:00010000:1.0:1788270070.212603:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270070.279134:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.279176:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253170688 00000100:00100000:0.0:1788270070.279189:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253170688 00000100:00100000:0.0:1788270070.279263:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788270070.279277:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:34542:x1875136253170688:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788270070.279631:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:34542:x1875136253170688:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 358us (593us total) trans 30064771184 rc 0/0 00000100:00100000:0.0:1788270070.279638:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:2.0:1788270070.285823:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.285889:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253170944 00000100:00100000:1.0:1788270070.285902:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253170944 00000100:00100000:1.0:1788270070.285975:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:1.0:1788270070.285985:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:34542:x1875136253170944:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270070.286016:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270070.286077:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a8f expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.286473:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092f1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.286490:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092f1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.286503:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092f1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270070.286516:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788270070.286642:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e092ea lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a8f expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.286665:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092f1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a8f expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.286675:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff98c1429f1600) 00010000:00010000:1.0:1788270070.286678:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788270070.286682:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a400, rc 0) 00000100:00100000:1.0:1788270070.286907:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253170944:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 922us (1094us total) trans 30064771185 rc 0/0 00000100:00100000:1.0:1788270070.286914:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:2.0:1788270070.329900:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.329966:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253171200 00000100:00100000:3.0:1788270070.329979:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253171200 00000100:00100000:3.0:1788270070.330086:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788270070.330110:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:34542:x1875136253171200:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1788270070.330378:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34542:x1875136253171200:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 283us (490us total) trans 30064771186 rc 0/0 00000100:00100000:3.0:1788270070.330386:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788270070.334689:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.334777:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253171456 00000100:00100000:2.0:1788270070.334990:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253171456 00000100:00100000:2.0:1788270070.335295:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:2.0:1788270070.335308:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34542:x1875136253171456:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270070.335384:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270070.335421:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e092f1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a8f expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335448:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e092dc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a88 expref: 28 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335461:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff98c1429f1600) 00010000:00010000:2.0:1788270070.335474:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270070.335502:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335518:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335530:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335542:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335550:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335557:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335664:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335673:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335680:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335907:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335914:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335922:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335927:0:45777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335931:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335935:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335957:0:45777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270070.335973:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335976:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335980:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335984:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.335988:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335992:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.335997:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:2.0:1788270070.335999:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788270070.336002:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.336165:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270070.336377:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.336387:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270070.336393:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.336400:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.336412:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:0.0:1788270070.336415:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270070.336418:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.336424:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09314 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.336441:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270070.336444:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270070.336445:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270070.336889:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0930d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336917:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336924:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336931:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336937:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.336941:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336948:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336958:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270070.336960:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.336963:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.336970:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e092ff lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270070.336981:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016ec9bdd reply state 0000000044285cb4 transno 30064771187 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.337000:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.337020:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff98c1429f1300) 00010000:00010000:2.0:1788270070.337318:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270070.337323:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270070.337442:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34542:x1875136253171456:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 2133us (2762us total) trans 30064771187 rc 0/0 00000100:00100000:2.0:1788270070.337452:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:2.0:1788270070.340223:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.340375:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253171712 00000100:00100000:0.0:1788270070.340389:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253171712 00000100:00100000:0.0:1788270070.340467:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:0.0:1788270070.340479:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:34542:x1875136253171712:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270070.340510:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270070.340535:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0931b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a96 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.340669:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.340688:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.340702:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.340720:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.340728:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.340735:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341325:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09330 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341337:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09330 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341345:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09330 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270070.341357:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:0.0:1788270070.341388:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341396:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341404:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341411:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270070.341416:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341429:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341443:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270070.341446:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270070.341452:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341458:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09322 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270070.341471:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e8445e5 reply state 000000007f547593 transno 30064771188 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341484:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341491:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff98c1429f1a00) 00010000:00010000:0.0:1788270070.341493:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270070.341496:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270070.341530:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0931b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a96 expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341544:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09330 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a96 expref: 31 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.341551:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff98c1429f1100) 00010000:00010000:0.0:1788270070.341553:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270070.341556:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fc00, rc 0) 00000100:00100000:0.0:1788270070.341640:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:34542:x1875136253171712:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 1163us (1430us total) trans 30064771188 rc 0/0 00000100:00100000:0.0:1788270070.341648:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:1.0:1788270070.432241:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.432332:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253171968 00000100:00100000:0.0:1788270070.432344:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253171968 00000100:00100000:0.0:1788270070.432405:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788270070.432414:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:34542:x1875136253171968:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788270070.432810:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34542:x1875136253171968:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 396us (580us total) trans 30064771189 rc 0/0 00000100:00100000:0.0:1788270070.432816:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788270070.439005:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270070.439144:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253172224 00000100:00100000:1.0:1788270070.439158:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253172224 00000100:00100000:1.0:1788270070.439245:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 155 00000100:00100000:1.0:1788270070.439258:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:34542:x1875136253172224:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788270070.439288:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270070.439314:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0933e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101a9d expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.439452:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09345 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.439469:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09345 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.439481:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09345 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270070.439497:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:1.0:1788270070.439634:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0933e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a9d expref: 36 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.439656:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09345 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a9d expref: 35 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.439666:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff98c1429f1100) 00010000:00010000:1.0:1788270070.439670:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788270070.439674:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b000, rc 0) 00000100:00100000:1.0:1788270070.439755:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34542:x1875136253172224:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 499us (764us total) trans 30064771190 rc 0/0 00000100:00100000:1.0:1788270070.439764:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 155 00000100:00100000:2.0:1788270070.468570:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262630016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270070.468673:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270070.468936:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630016 00000100:00100000:0.0:1788270070.468947:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630016 00000100:00100000:0.0:1788270070.469113:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788270070.469126:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262630016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270070.469178:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41164480 pending 434176 free 3923087360 avail 3691565056 00000100:00100000:0.0:1788270070.469365:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262630016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 241us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.469375:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788270070.469547:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270070.469611:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262630016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270070.504980:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270070.505037:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253172480 00000100:00100000:3.0:1788270070.505073:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253172480 00000100:00100000:3.0:1788270070.505240:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788270070.505253:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34542:x1875136253172480:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1788270070.505499:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34542:x1875136253172480:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 249us (526us total) trans 30064771191 rc 0/0 00000100:00100000:3.0:1788270070.505507:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:3.0:1788270070.508503:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270070.508691:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253172736 00000100:00100000:2.0:1788270070.508700:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253172736 00000100:00100000:2.0:1788270070.508814:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 156 00000100:00100000:2.0:1788270070.508825:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34542:x1875136253172736:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270070.508883:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270070.508913:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09345 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a9d expref: 36 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.508937:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09330 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a96 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.508948:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff98c1429f1100) 00010000:00010000:2.0:1788270070.508958:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270070.508979:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.508990:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.508999:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509011:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509018:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509025:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509163:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509172:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509179:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509346:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509355:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509366:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509373:0:45777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509379:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509386:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509653:0:45777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270070.509672:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509679:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509686:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509704:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.509708:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509716:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509725:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:2.0:1788270070.509728:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788270070.509732:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509737:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09361 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509751:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509757:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509762:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509767:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270070.509770:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509776:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509783:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270070.509786:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270070.509789:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509794:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09353 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270070.509803:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3885bc6 reply state 00000000bebf6a4e transno 30064771192 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509819:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270070.509825:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff98c1429f1a00) 00010000:00010000:2.0:1788270070.509827:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270070.509830:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270070.509904:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34542:x1875136253172736:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 1081us (1409us total) trans 30064771192 rc 0/0 00000100:00100000:2.0:1788270070.509911:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 156 00010000:00010000:1.0:1788270070.511569:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270070.511851:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.511864:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270070.511868:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.511877:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.511892:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:1.0:1788270070.511894:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270070.511898:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.511908:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09368 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270070.511930:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270070.511933:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270070.511934:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270070.513906:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.513992:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253172992 00000100:00100000:0.0:1788270070.514002:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253172992 00000100:00100000:0.0:1788270070.514081:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 157 00000100:00100000:0.0:1788270070.514091:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34542:x1875136253172992:12345-192.168.201.42@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788270070.514123:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270070.514142:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0936f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101aa4 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.514246:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09376 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.514259:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09376 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.514270:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09376 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270070.514280:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788270070.514374:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0936f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aa4 expref: 39 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.514390:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09376 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aa4 expref: 38 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.514398:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff98c1429fea00) 00010000:00010000:0.0:1788270070.514401:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270070.514404:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270070.514549:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34542:x1875136253172992:12345-192.168.201.42@tcp:101:mmap_sanity.0 Request processed in 459us (649us total) trans 30064771193 rc 0/0 00000100:00100000:0.0:1788270070.514556:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 157 00000100:00100000:2.0:1788270070.516638:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270070.516778:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253173120 00000100:00100000:0.0:1788270070.516785:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253173120 00000100:00100000:0.0:1788270070.516844:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788270070.516854:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+8:33916:x1875136253173120:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270070.516867:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270070.516909:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d5324c/0xc5f5d7a016e09288 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a7a expref: 8 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270070.516933:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270070.516983:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:33916:x1875136253173120:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 129us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270070.516991:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788270070.980342:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262630144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270070.980425:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270070.980945:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630144 00000100:00100000:2.0:1788270070.980953:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630144 00000100:00100000:2.0:1788270070.981001:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788270070.981012:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262630144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270070.981059:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446182912 avail 1299943424 00000100:00100000:2.0:1788270070.981121:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262630144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270070.981130:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788270070.981179:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262630144:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270071.236538:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270071.520622:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270071.520703:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253173376 00000100:00100000:0.0:1788270071.520712:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253173376 00000100:00080000:3.0:1788270071.520769:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270071.520809:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:0.0:1788270071.520817:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144055850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34542:x1875136253173376:12345-192.168.201.42@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788270071.521119:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144055850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34542:x1875136253173376:12345-192.168.201.42@tcp:35:mmap_sanity.0 Request processed in 301us (503us total) trans 30064771194 rc 0/0 00000100:00100000:0.0:1788270071.521127:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788270071.524788:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270071.524859:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253173632 00000100:00100000:2.0:1788270071.524869:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253173632 00000100:00100000:2.0:1788270071.524926:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:2.0:1788270071.524936:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34542:x1875136253173632:12345-192.168.201.42@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788270071.524992:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270071.525021:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09376 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aa4 expref: 39 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525089:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e08b2d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101890 expref: 38 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525101:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff98c1429fea00) 00010000:00010000:2.0:1788270071.525111:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270071.525135:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525147:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525155:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525169:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525176:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525182:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525256:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525264:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525271:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525439:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525447:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525456:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525463:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525469:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525475:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525494:0:45776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270071.525511:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525518:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525523:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270071.525525:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525532:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525534:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270071.525542:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525544:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270071.525550:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525573:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525573:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525597:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:2.0:1788270071.525601:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788270071.525604:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525609:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff98c1429fa400) 00010000:00010000:2.0:1788270071.525611:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09392 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525615:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270071.525621:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525629:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09399 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525631:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525642:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525648:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270071.525650:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270071.525652:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270071.525655:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270071.525660:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270071.525664:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525671:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525679:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:2.0:1788270071.525681:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270071.525684:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525693:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09384 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270071.525704:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2ba3f1e reply state 00000000f1424723 transno 30064771195 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525714:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270071.525732:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff98c1429fa900) 00010000:00010000:2.0:1788270071.525734:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270071.525737:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270071.525808:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34542:x1875136253173632:12345-192.168.201.42@tcp:36:mmap_sanity.0 Request processed in 874us (1029us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1788270071.525815:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 158 00010000:00010000:0.0:1788270072.274438:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270072.613548:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270072.614122:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253173760 00000100:00100000:0.0:1788270072.614133:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253173760 00000100:00100000:0.0:1788270072.614202:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788270072.614214:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:33917:x1875136253173760:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270072.614228:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788270072.614255:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e08a9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101866 expref: 39 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.614276:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:0.0:1788270072.614288:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e08b50 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101897 expref: 38 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.614302:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270072.614310:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e08a70 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610185f expref: 37 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.614324:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c2515e9d00) 00010000:00010000:0.0:1788270072.614339:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e08a54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101858 expref: 36 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.614346:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c1429f8e00) 00010000:00010000:0.0:1788270072.614350:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270072.614489:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:33917:x1875136253173760:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 276us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270072.614497:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788270072.625727:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270072.626118:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253173888 00000100:00100000:0.0:1788270072.626131:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253173888 00000100:00100000:0.0:1788270072.626229:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788270072.626241:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+13:33916:x1875136253173888:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1788270072.626254:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788270072.626261:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:0.0:1788270072.626286:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e08c68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018cf expref: 13 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.626309:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c2515e9c00) 00010000:00010000:0.0:1788270072.626326:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e08cb5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018e4 expref: 12 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.626338:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff98c2515e9600) 00010000:00010000:0.0:1788270072.626348:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e091af lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101a2d expref: 11 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.626360:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff98c1429fa200) 00010000:00010000:0.0:1788270072.626367:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e08fb7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561019bd expref: 10 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.626372:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:0.0:1788270072.626379:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e08ec2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101962 expref: 9 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.626384:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff98c1429f1900) 00010000:00010000:0.0:1788270072.626390:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e08c84 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561018d6 expref: 8 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.626395:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f8d00) 00010000:00010000:0.0:1788270072.626400:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270072.626461:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:33916:x1875136253173888:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 222us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270072.626468:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788270072.650411:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270072.650884:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253174016 00000100:00100000:2.0:1788270072.650895:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253174016 00000100:00100000:2.0:1788270072.650959:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:2.0:1788270072.650970:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:34581:x1875136253174016:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:2.0:1788270072.650994:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270072.651015:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101aab expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.651130:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.651144:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.651158:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270072.651202:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270072.651206:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270072.651244:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.651268:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aab expref: 37 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.651286:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aab expref: 36 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.651294:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429faf00) 00010000:00010000:2.0:1788270072.651296:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270072.651300:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821db600, rc 0) 00000100:00100000:2.0:1788270072.651362:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34581:x1875136253174016:12345-192.168.201.42@tcp:101:rm.0 Request processed in 394us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270072.651368:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:3.0:1788270072.655002:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270072.655098:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253174144 00000100:00100000:0.0:1788270072.655108:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253174144 00000100:00100000:0.0:1788270072.655169:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:0.0:1788270072.655180:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:34581:x1875136253174144:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:0.0:1788270072.655200:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270072.655219:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e093ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ab2 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655290:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655301:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655309:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655320:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655324:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655328:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655408:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e093c3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655416:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e093c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655423:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e093c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270072.655463:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270072.655467:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270072.655488:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e093c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655505:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655511:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655518:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655524:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270072.655529:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655535:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655547:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429faf00) 00010000:00010000:0.0:1788270072.655550:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270072.655554:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655560:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e093b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655572:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655577:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655582:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655588:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270072.655590:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655595:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655600:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429f1900) 00010000:00010000:0.0:1788270072.655603:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270072.655605:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655610:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e093bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655636:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e093ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ab2 expref: 38 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655648:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e093c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ab2 expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270072.655655:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270072.655657:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270072.655659:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ea00, rc 0) 00000100:00100000:0.0:1788270072.655719:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:34581:x1875136253174144:12345-192.168.201.42@tcp:101:rm.0 Request processed in 541us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270072.655726:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:3.0:1788270072.658680:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270072.658752:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253174400 00000100:00100000:2.0:1788270072.658763:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253174400 00000100:00100000:2.0:1788270072.658824:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:2.0:1788270072.658834:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:34581:x1875136253174400:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:2.0:1788270072.658853:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270072.658874:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ab9 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270072.658985:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788270072.659128:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ab9 expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.659144:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429faf00) 00010000:00010000:2.0:1788270072.659147:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270072.659153:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ab9 expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.659166:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dae00, rc 0) 00000100:00100000:2.0:1788270072.659227:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34581:x1875136253174400:12345-192.168.201.42@tcp:101:rm.0 Request processed in 394us (556us total) trans 30064771196 rc 301/301 00000100:00100000:2.0:1788270072.659234:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:1.0:1788270072.662405:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270072.662651:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253174528 00000100:00100000:2.0:1788270072.662661:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253174528 00000100:00100000:2.0:1788270072.662720:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788270072.662731:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34581:x1875136253174528:12345-192.168.201.42@tcp:37:rm.0 00000100:00100000:2.0:1788270072.665892:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34581:x1875136253174528:12345-192.168.201.42@tcp:37:rm.0 Request processed in 3151us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270072.665906:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788270072.669456:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270072.669532:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253174784 00000100:00100000:0.0:1788270072.669542:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253174784 00000100:00100000:0.0:1788270072.669600:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788270072.669610:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:34581:x1875136253174784:12345-192.168.201.42@tcp:35:rm.0 00000100:00100000:0.0:1788270072.669858:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34581:x1875136253174784:12345-192.168.201.42@tcp:35:rm.0 Request processed in 248us (410us total) trans 30064771197 rc 0/0 00000100:00100000:0.0:1788270072.669866:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:1.0:1788270072.672426:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270072.673087:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175040 00000100:00100000:2.0:1788270072.673098:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175040 00000100:00100000:2.0:1788270072.673168:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:2.0:1788270072.673179:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34581:x1875136253175040:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:2.0:1788270072.673236:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270072.673264:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e093c3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ab2 expref: 39 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673284:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:2.0:1788270072.673300:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aab expref: 38 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673309:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429faf00) 00010000:00010000:2.0:1788270072.673314:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270072.673336:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673348:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673357:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673368:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673375:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673380:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673459:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673471:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673476:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270072.673694:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788270072.673709:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673715:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673721:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673727:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270072.673731:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673738:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673747:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff98c1429fac00) 00010000:00010000:2.0:1788270072.673750:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788270072.673754:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673760:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e093e6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673776:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673783:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673789:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673794:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270072.673796:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673802:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673808:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fa100) 00010000:00010000:2.0:1788270072.673810:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270072.673812:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673817:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e093d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270072.673829:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005af7dc1 reply state 000000000e6de897 transno 30064771198 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673840:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270072.673846:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429fad00) 00010000:00010000:2.0:1788270072.673848:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270072.673850:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270072.673913:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:34581:x1875136253175040:12345-192.168.201.42@tcp:36:rm.0 Request processed in 736us (1503us total) trans 30064771198 rc 0/0 00000100:00100000:2.0:1788270072.673920:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:1.0:1788270073.028207:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270073.028232:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262630272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270073.028306:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.028353:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630272 00000100:00100000:2.0:1788270073.028361:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630272 00000100:00100000:2.0:1788270073.028421:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788270073.028432:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262630272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270073.028466:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:2.0:1788270073.028633:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262630272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 203us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.028641:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788270073.030420:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262630272:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270073.285143:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270073.347224:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347262:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347285:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347305:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347326:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347343:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347501:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347527:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347549:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270073.347583:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175168 00000100:00100000:3.0:1788270073.347592:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175168 00000100:00100000:3.0:1788270073.347641:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:3.0:1788270073.347652:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253175168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.347722:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253175168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 70us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.347730:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:3.0:1788270073.347772:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175424 00000100:00100000:3.0:1788270073.347776:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175424 00000100:00100000:3.0:1788270073.347817:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175936 00000100:00100000:3.0:1788270073.347821:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175936 00000100:00100000:3.0:1788270073.347840:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175296 00000100:00100000:3.0:1788270073.347843:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175296 00000100:00100000:3.0:1788270073.347865:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175808 00000100:00100000:3.0:1788270073.347868:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175808 00000100:00100000:3.0:1788270073.347890:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:3.0:1788270073.347898:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2403:x1875136253175424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.347930:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2403:x1875136253175424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.347938:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:3.0:1788270073.347955:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788270073.347962:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253175936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.347986:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253175936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.347994:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788270073.348008:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788270073.348015:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2403:x1875136253175296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.348080:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2403:x1875136253175296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 64us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.348087:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788270073.348105:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:3.0:1788270073.348112:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2403:x1875136253175808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.348141:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2403:x1875136253175808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.348147:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:3.0:1788270073.348170:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175680 00000100:00100000:3.0:1788270073.348174:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175680 00000100:00100000:3.0:1788270073.348205:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176192 00000100:00100000:3.0:1788270073.348208:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176192 00000100:00100000:3.0:1788270073.348224:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253175552 00000100:00100000:3.0:1788270073.348227:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253175552 00000100:00100000:3.0:1788270073.348242:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176064 00000100:00100000:3.0:1788270073.348245:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176064 00000100:00100000:3.0:1788270073.348263:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788270073.348270:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253175680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.348298:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253175680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.348305:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788270073.348320:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788270073.348327:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2403:x1875136253176192:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.349094:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2403:x1875136253176192:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 765us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.349104:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788270073.349122:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788270073.349132:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253175552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.349166:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253175552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.349173:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788270073.349187:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788270073.349197:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2403:x1875136253176064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270073.349220:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+7:2403:x1875136253176064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270073.349227:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00080000:2.0:1788270073.349481:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270073.349486:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270073.349489:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270073.349492:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788270073.540233:0:45803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865247191302ns, next at 866247189271ns, rc = 0 00000100:00100000:1.0:1788270073.540253:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262630400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270073.540324:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.540367:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630400 00000100:00100000:2.0:1788270073.540376:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630400 00000100:00100000:2.0:1788270073.540451:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788270073.540458:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270073.540463:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262630400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270073.540492:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66424512 pending 28672 free 3923484672 avail 3691962368 00000100:00100000:2.0:1788270073.540548:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262630400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.540555:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788270073.540616:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262630400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270073.545836:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262630784:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.545925:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.545966:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262631296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.545997:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546022:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262631808:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546094:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546128:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788270073.546137:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262630656:0@lo:400:kworker.0 00000004:00080000:1.0:1788270073.546146:0:45801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865253105167ns, next at 866253101497ns, rc = 0 00000100:00100000:2.0:1788270073.546169:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546198:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262631168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546219:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546237:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262631680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546259:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546277:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262632192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270073.546301:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262630912:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546302:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546342:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630784 00000100:00100000:1.0:1788270073.546343:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546351:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630784 00000100:00100000:1.0:1788270073.546373:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262631424:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.546401:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546411:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631296 00000100:00100000:2.0:1788270073.546415:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631296 00000100:00100000:1.0:1788270073.546425:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262631936:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546441:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631168 00000100:00100000:2.0:1788270073.546446:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631168 00000100:00100000:1.0:1788270073.546454:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546469:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788270073.546480:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788270073.546481:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262630784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.546492:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262630528:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.546526:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546553:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262630784:12345-0@lo:400:kworker.0 Request processed in 74us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270073.546559:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262631040:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546564:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788270073.546586:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788270073.546593:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262631296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.546600:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270073.546625:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262631552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.546635:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262631296:12345-0@lo:400:kworker.0 Request processed in 42us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.546643:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788270073.546658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546660:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788270073.546669:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262631168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.546677:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262632064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270073.546707:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262631168:12345-0@lo:400:kworker.0 Request processed in 39us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270073.546715:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270073.546719:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788270073.546742:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631808 00000100:00100000:2.0:1788270073.546746:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631808 00000100:00100000:2.0:1788270073.546774:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630912 00000100:00100000:1.0:1788270073.546774:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631680 00000100:00100000:2.0:1788270073.546779:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630912 00000100:00100000:1.0:1788270073.546781:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631680 00000100:00100000:2.0:1788270073.546792:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631424 00000100:00100000:2.0:1788270073.546797:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631424 00000100:00100000:1.0:1788270073.546816:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631936 00000100:00100000:2.0:1788270073.546817:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631552 00000100:00100000:1.0:1788270073.546822:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631936 00000100:00100000:2.0:1788270073.546823:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631552 00000100:00100000:1.0:1788270073.546860:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788270073.546869:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262631808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.546904:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262631808:12345-0@lo:400:kworker.0 Request processed in 37us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548160:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788270073.548176:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262630912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548244:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262630912:12345-0@lo:400:kworker.0 Request processed in 75us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548253:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788270073.548277:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788270073.548285:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262631680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548315:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262631680:12345-0@lo:400:kworker.0 Request processed in 32us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548321:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788270073.548334:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788270073.548342:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262631424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548377:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262631424:12345-0@lo:400:kworker.0 Request processed in 37us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548384:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788270073.548397:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788270073.548405:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262631936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548432:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262631936:12345-0@lo:400:kworker.0 Request processed in 29us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548438:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788270073.548450:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788270073.548457:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548476:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262631552:12345-0@lo:400:kworker.0 Request processed in 20us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548481:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788270073.548501:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630656 00000100:00100000:2.0:1788270073.548507:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630656 00000100:00100000:2.0:1788270073.548531:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262631040 00000100:00100000:2.0:1788270073.548533:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262631040 00000100:00100000:2.0:1788270073.548543:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788270073.548548:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262630656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548576:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262630656:12345-0@lo:400:kworker.0 Request processed in 28us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548582:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788270073.548590:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788270073.548596:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262631040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548624:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262631040:12345-0@lo:400:kworker.0 Request processed in 28us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548633:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788270073.548664:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632192 00000100:00100000:2.0:1788270073.548668:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632192 00000100:00100000:2.0:1788270073.548690:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632064 00000100:00100000:2.0:1788270073.548692:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632064 00000100:00100000:2.0:1788270073.548709:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788270073.548717:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262632192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270073.548740:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41164480 pending 434176 free 3923087360 avail 3691565056 00000100:00100000:2.0:1788270073.548772:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262632192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548778:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788270073.548790:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788270073.548798:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262632064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270073.548807:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66424512 pending 28672 free 3923484672 avail 3691962368 00000100:00100000:2.0:1788270073.548827:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262632064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270073.548833:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788270073.548887:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262630656:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548901:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262631168:0@lo:400:kworker.0 00010000:00080000:2.0:1788270073.548913:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144383480 x1875136262631680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270073.548925:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262631680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548945:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262632192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270073.548957:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262630784:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548969:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262631296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270073.548982:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262631808:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.549230:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788270073.549268:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262630528 00000100:00100000:1.0:1788270073.549272:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262630528 00000100:00100000:1.0:1788270073.549306:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788270073.549312:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262630528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.549351:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262630528:12345-0@lo:400:kworker.0 Request processed in 39us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270073.549357:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1788270073.549392:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270073.549396:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270073.549400:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270073.549403:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270073.549420:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262630528:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.549432:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262631040:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.549441:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262631552:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.549455:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262632064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270073.549465:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262630912:0@lo:400:kworker.0 00000100:00100000:1.0:1788270073.549474:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262631424:0@lo:400:kworker.0 00010000:00080000:1.0:1788270073.549484:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c144383b80 x1875136262631936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270073.549493:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262631936:0@lo:400:kworker.0 00000001:00080000:1.0:1788270074.059386:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771086 is committed 00000001:00080000:1.0:1788270074.059735:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771085 is committed 00000001:00080000:1.0:1788270074.059747:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771084 is committed 00010000:00010000:0.0:1788270074.308439:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270075.334244:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270075.589189:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270075.589209:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262632320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270075.589277:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270075.589349:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632320 00000100:00100000:3.0:1788270075.589356:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632320 00000100:00100000:3.0:1788270075.589404:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788270075.589411:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262632320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270075.589435:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40730304 pending 0 free 3923087360 avail 3691565056 00000100:00100000:3.0:1788270075.589479:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262632320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270075.589485:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788270075.589532:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262632320:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270075.589594:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270075.675277:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270075.675368:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176320 00000100:00100000:2.0:1788270075.675378:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176320 00000100:00100000:2.0:1788270075.675453:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:2.0:1788270075.675464:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:35009:x1875136253176320:12345-192.168.201.42@tcp:101:lctl.0 00010000:00010000:2.0:1788270075.675482:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270075.675504:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ac0 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.675565:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e093f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.675578:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e093f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.675589:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e093f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270075.675634:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270075.675638:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270075.675677:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e093f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.675703:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e093ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac0 expref: 41 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.675721:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e093f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac0 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.675731:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c24a952800) 00010000:00010000:2.0:1788270075.675734:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270075.675737:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821da400, rc 0) 00000100:00100000:2.0:1788270075.675801:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:35009:x1875136253176320:12345-192.168.201.42@tcp:101:lctl.0 Request processed in 339us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270075.675808:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00080000:0.0:1788270075.675865:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270075.724809:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270075.724881:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176448 00000100:00100000:1.0:1788270075.724893:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176448 00000100:00100000:1.0:1788270075.724955:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:1.0:1788270075.724968:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34531:x1875136253176448:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788270075.725208:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34531:x1875136253176448:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 242us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270075.725215:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:1.0:1788270075.726131:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270075.726225:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176576 00000100:00100000:3.0:1788270075.726231:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176576 00000100:00100000:3.0:1788270075.726346:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:3.0:1788270075.726356:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:34531:x1875136253176576:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788270075.726430:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:34531:x1875136253176576:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270075.726440:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00080000:0.0:1788270075.728188:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270075.730185:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270075.730325:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176832 00000100:00100000:0.0:1788270075.730334:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176832 00000100:00100000:0.0:1788270075.730378:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:0.0:1788270075.730388:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:34531:x1875136253176832:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788270075.731387:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:34531:x1875136253176832:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 997us (1206us total) trans 30064771199 rc 0/0 00000100:00100000:0.0:1788270075.731396:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000001:00080000:2.0:1788270075.736097:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771199 is committed 00000004:00080000:2.0:1788270075.736121:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788270075.736143:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788270075.736220:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788270075.736221:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270075.736228:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771180 is committed 00010000:00010000:3.0:1788270075.736246:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788270075.736249:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c1437a8780 refcount 2 committed 0 result 0 batchid 25769803839 00000020:00080000:2.0:1788270075.736259:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c27a1c2500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c1437a8b40 00000020:00080000:2.0:1788270075.736270:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c27a1c2e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c247996400 00010000:00010000:3.0:1788270075.736272:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736282:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736287:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736294:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736313:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff98c143878200) 00010000:00010000:3.0:1788270075.736316:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736320:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736326:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09242 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736356:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736362:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736372:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736377:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736380:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736385:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736391:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff98c14387f600) 00010000:00010000:3.0:1788270075.736393:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736395:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736400:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e092b2 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736413:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736420:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736426:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736430:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736433:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736443:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736452:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff98c1429f1300) 00010000:00010000:3.0:1788270075.736455:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736458:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736463:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e092d5 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736471:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736476:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736482:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736486:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736488:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736493:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736498:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff98c1429f1300) 00010000:00010000:3.0:1788270075.736500:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736502:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736508:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09306 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736519:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736524:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736529:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736534:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736536:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736541:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736546:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff98c1429f1a00) 00010000:00010000:3.0:1788270075.736548:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736550:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736555:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09329 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736562:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736567:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736572:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736577:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736579:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736584:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736590:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff98c1429f1a00) 00010000:00010000:3.0:1788270075.736591:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736821:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736830:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0935a lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736844:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736849:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736854:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736858:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736861:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736870:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736882:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff98c1429fa900) 00010000:00010000:3.0:1788270075.736885:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736888:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736893:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e0938b lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736908:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736914:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736919:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736924:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270075.736927:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736932:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736940:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff98c1429fad00) 00010000:00010000:3.0:1788270075.736942:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270075.736945:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.736951:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e093df lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788270075.737114:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803838 batchid updated 00000100:00100000:0.0:1788270075.737290:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262632448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788270075.737296:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262632576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788270075.737362:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788270075.737382:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803839 committed batchid 25769803838 00000100:00100000:2.0:1788270075.737425:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632448 00000100:00100000:2.0:1788270075.737438:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632448 00000020:00080000:1.0:1788270075.737456:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803838 00000100:00080000:0.0:1788270075.737483:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270075.737498:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270075.737531:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632576 00000100:00100000:2.0:1788270075.737537:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632576 00000100:00100000:0.0:1788270075.737554:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788270075.737584:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262632448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788270075.737592:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788270075.737604:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262632576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788270075.737634:0:47281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:195 count 1 00002000:00010000:2.0:1788270075.737674:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc3:0x0] initial LVB size: 409600, mtime: 0x6a96d5f5, atime: 0x6a96d5f1, ctime: 0x6a96d5f5, blocks: 0x320 00010000:00010000:2.0:1788270075.737684:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.737707:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=867s v=(0 0) 00010000:00010000:2.0:1788270075.737712:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc3:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1788270075.737717:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788270075.737720:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.737740:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.737749:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270075.737757:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270075.737764:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3609:x1875136262632448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (396us total) trans 30064771089 rc 0/0 00000100:00100000:0.0:1788270075.737786:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:1.0:1788270075.737793:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27a62c000/2, rc 0, transno 30064771089 00010000:00010000:2.0:1788270075.737794:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270075.737828:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262632448:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788270075.737868:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788270075.737874:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788270075.737876:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270075.737886:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262632704:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788270075.737891:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270075.737897:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.737912:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.737931:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.737940:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f8810a6/0xc5f5d7a016e093fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270075.737955:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270075.737997:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632704 00000100:00100000:0.0:1788270075.738014:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632704 00000100:00100000:0.0:1788270075.738072:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788270075.738081:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3608:x1875136262632704:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788270075.738092:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788270075.738096:0:48231:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:195 count 1 00010000:00010000:1.0:1788270075.738097:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270075.738100:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788270075.738120:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc3:0x0] initial LVB size: 4096, mtime: 0x6a96d5f6, atime: 0x6a96d5f5, ctime: 0x6a96d5f6, blocks: 0x8 00010000:00010000:0.0:1788270075.738129:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270075.738144:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=867s v=(0 0) 00010000:00010000:0.0:1788270075.738149:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270075.738156:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270075.738166:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262632576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 561us (666us total) trans 30064771087 rc 0/0 00000100:00100000:2.0:1788270075.738181:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:0.0:1788270075.738183:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270075.738196:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270075.738204:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270075.738238:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788270075.738303:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771085 gen 2 00000004:00080000:0.0:1788270075.738309:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771085 committed transno 30064771085 00000100:00100000:0.0:1788270075.738332:0:3610:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c27c389880 x1875136262632576/t30064771087(30064771087) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788270091 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788270075.738342:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c389880/2, rc 0, transno 30064771087 00000100:00100000:0.0:1788270075.738346:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262632576:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788270075.738451:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270075.738457:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.738465:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270075.738468:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.738476:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.738488:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.738495:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12f56c5/0xc5f5d7a016e09402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270075.738508:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270075.738510:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270075.738511:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788270075.740639:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771089 is committed 00000001:00080000:2.0:1788270075.740656:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771088 is committed 00000001:00080000:2.0:1788270075.740675:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771086 is committed 00000100:00100000:0.0:1788270075.740746:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262632704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2662us (2788us total) trans 30064771090 rc 0/0 00000100:00100000:0.0:1788270075.740758:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788270075.740795:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771089 gen 2 00000004:00080000:2.0:1788270075.740804:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c2c7480, transno 30064771085 00000004:00080000:2.0:1788270075.740825:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771087 committed transno 30064771089 00000004:00080000:2.0:1788270075.740849:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27a62c000, transno 30064771089 00000100:00100000:2.0:1788270075.740858:0:3608:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c27a62e680 x1875136262632704/t30064771090(30064771090) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788270091 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788270075.740872:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27a62e680/2, rc 0, transno 30064771090 00000100:00100000:2.0:1788270075.740878:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262632704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788270075.870332:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270075.870442:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253176960 00000100:00100000:3.0:1788270075.870452:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253176960 00000100:00080000:1.0:1788270075.870516:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270075.870583:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:3.0:1788270075.870594:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:35026:x1875136253176960:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:3.0:1788270075.870613:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270075.870632:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ac7 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.870690:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.870702:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.870714:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270075.870755:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270075.870760:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270075.870796:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.870821:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 7 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.870844:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 6 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270075.870852:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c24a952800) 00010000:00010000:3.0:1788270075.870855:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270075.870858:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f800, rc 0) 00000100:00100000:3.0:1788270075.870926:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:35026:x1875136253176960:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 335us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270075.870934:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:0.0:1788270076.100907:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262632832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270076.100978:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270076.101076:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632832 00000100:00100000:3.0:1788270076.101085:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632832 00000100:00100000:1.0:1788270076.101151:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788270076.101170:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262632832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270076.101202:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1299947520 00000100:00100000:1.0:1788270076.101776:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262632832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 608us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270076.101785:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788270076.102002:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262632832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270076.356842:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270077.384056:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788270077.705915:0:49029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 5: Mmap 00000040:00080000:1.0:1788270078.020749:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788270078.148376:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262632960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270078.148449:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.150114:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262632960 00000100:00100000:3.0:1788270078.150136:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262632960 00000100:00100000:3.0:1788270078.150201:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788270078.150210:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262632960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270078.150245:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:3.0:1788270078.150712:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262632960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 502us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.150720:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788270078.150793:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262632960:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270078.404199:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270078.467146:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467191:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467224:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467246:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467265:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467282:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467302:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467317:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467339:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.467364:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177600 00000100:00100000:3.0:1788270078.467373:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177600 00000100:00100000:2.0:1788270078.467404:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177344 00000100:00100000:2.0:1788270078.467411:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177344 00000100:00100000:3.0:1788270078.467426:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253178112 00000100:00100000:3.0:1788270078.467431:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253178112 00000100:00100000:3.0:1788270078.467451:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177472 00000100:00100000:3.0:1788270078.467455:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177472 00000100:00100000:2.0:1788270078.467455:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177856 00000100:00100000:2.0:1788270078.467461:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177856 00000100:00100000:3.0:1788270078.467473:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177984 00000100:00100000:3.0:1788270078.467477:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177984 00000100:00100000:2.0:1788270078.467483:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177216 00000100:00100000:2.0:1788270078.467488:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177216 00000100:00100000:3.0:1788270078.467501:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788270078.467508:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177728 00000100:00100000:2.0:1788270078.467513:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177728 00000100:00100000:3.0:1788270078.467515:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253177600:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270078.467535:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:2.0:1788270078.467545:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253177344:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270078.467591:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253177600:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.467592:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253177344:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.467611:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788270078.467612:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788270078.467636:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788270078.467641:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270078.467649:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253178112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270078.467654:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253177856:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270078.467682:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253178112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.467689:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788270078.467694:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253177856:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 42us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.467702:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:2.0:1788270078.467718:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788270078.467727:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253177216:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270078.467759:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253177216:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.467767:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788270078.467787:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788270078.467796:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253177728:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270078.467821:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253177728:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.467828:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788270078.467851:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788270078.467859:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788270078.467861:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253177472:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270078.467872:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253177984:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270078.467888:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253177472:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.467898:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788270078.467907:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253177984:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.467915:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788270078.468201:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253177088 00000100:00100000:1.0:1788270078.468206:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253177088 00000100:00080000:3.0:1788270078.468250:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270078.468255:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270078.468258:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270078.468260:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270078.468291:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:1.0:1788270078.468300:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253177088:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270078.468323:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253177088:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270078.468329:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:2.0:1788270078.509900:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270078.510074:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253178240 00000100:00100000:1.0:1788270078.510432:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253178240 00000100:00100000:1.0:1788270078.510548:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:1.0:1788270078.510560:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:35288:x1875136253178240:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270078.510582:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270078.510602:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ace expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510668:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510683:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510695:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510711:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510719:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510725:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510783:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0942c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510791:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0942c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510797:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0942c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270078.510831:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270078.510835:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270078.510853:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0942c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510863:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510870:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510881:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510887:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270078.510890:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510897:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510909:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c24a952800) 00010000:00010000:1.0:1788270078.510912:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270078.510916:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510922:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e0941e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510935:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510940:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510946:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510951:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270078.510966:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510984:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.510991:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98c14387f100) 00010000:00010000:1.0:1788270078.510993:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270078.510996:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.511002:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.511029:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ace expref: 8 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.511099:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a400/0xc5f5d7a016e0942c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ace expref: 7 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.511107:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:1.0:1788270078.511110:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270078.511113:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a400, rc 0) 00000100:00100000:1.0:1788270078.511184:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:35288:x1875136253178240:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 627us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270078.511192:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:2.0:1788270078.514381:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.514709:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253178496 00000100:00100000:3.0:1788270078.514720:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253178496 00000100:00100000:3.0:1788270078.514769:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788270078.514780:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:35288:x1875136253178496:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270078.514800:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270078.514819:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09433 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ad5 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.514891:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.514905:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.514916:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.514932:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.514939:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.514945:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515181:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e09448 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515190:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e09448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515198:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e09448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270078.515208:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788270078.515480:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515487:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515491:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515494:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270078.515497:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515502:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515511:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:3.0:1788270078.515513:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270078.515515:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515522:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0943a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515531:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515534:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515537:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515540:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270078.515542:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515545:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515548:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429fd100) 00010000:00010000:3.0:1788270078.515549:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270078.515551:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515554:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09441 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515815:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09433 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ad5 expref: 10 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515834:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9fa00/0xc5f5d7a016e09448 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ad5 expref: 9 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.515841:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:3.0:1788270078.515843:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270078.515845:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9fa00, rc 0) 00000100:00100000:3.0:1788270078.515912:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:35288:x1875136253178496:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1134us (1548us total) trans 30064771200 rc 0/0 00000100:00100000:3.0:1788270078.515919:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:0.0:1788270078.520796:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.520930:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253178624 00000100:00100000:3.0:1788270078.520940:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253178624 00000100:00100000:3.0:1788270078.524794:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:3.0:1788270078.524825:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:35288:x1875136253178624:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270078.524984:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:35288:x1875136253178624:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 171us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.525719:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:2.0:1788270078.527555:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270078.527640:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253178752 00000100:00100000:1.0:1788270078.527649:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253178752 00000100:00100000:1.0:1788270078.527822:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 170 00000100:00100000:1.0:1788270078.527833:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:35288:x1875136253178752:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270078.527940:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:35288:x1875136253178752:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 108us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270078.527948:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 170 00000100:00100000:1.0:1788270078.591796:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.591889:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179008 00000100:00100000:3.0:1788270078.591898:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179008 00000100:00100000:3.0:1788270078.592012:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:3.0:1788270078.592022:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:35302:x1875136253179008:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270078.592081:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270078.592085:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270078.592109:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e093f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac0 expref: 9 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.592134:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c24a952800) 00010000:00010000:3.0:1788270078.592139:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270078.592151:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09456 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101adc expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.592250:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.592263:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.592272:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.592310:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.592323:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 5 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270078.592342:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262633088:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270078.592410:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb233c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270078.595338:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.596280:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179136 00000100:00100000:2.0:1788270078.596288:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179136 00010000:00010000:2.0:1788270078.596338:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 6 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270078.596377:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788270078.596385:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253179136:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270078.596396:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270078.596401:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 6 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.596411:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 6 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.596427:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c24a952800) 00010000:00010000:2.0:1788270078.596430:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.596437:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.596442:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.596454:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270078.596495:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253179136:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 111us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.596499:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00010000:00010000:0.0:1788270078.596635:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09410 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ac7 expref: 5 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270078.596649:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262633088:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270078.596666:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.596675:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.596681:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.596704:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.596712:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.596720:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270078.597747:0:48110:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc4:0x0], index 0: 0 00010000:00010000:0.0:1788270078.597919:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.597931:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.597940:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.597990:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598177:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598186:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598192:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270078.598196:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598209:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598220:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270078.598223:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270078.598227:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598294:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0945d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270078.598309:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce819c8b reply state 0000000058dc240d transno 30064771201 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598319:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598325:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f1900) 00010000:00010000:0.0:1788270078.598387:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270078.598391:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270078.598427:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09456 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 11 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598444:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 10 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.598451:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1c00) 00010000:00010000:0.0:1788270078.598454:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270078.598456:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ee00, rc 0) 00000100:00100000:0.0:1788270078.598515:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:35302:x1875136253179008:12345-192.168.201.42@tcp:101:bash.0 Request processed in 6495us (6727us total) trans 30064771201 rc 0/0 00000100:00100000:0.0:1788270078.598521:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:3.0:1788270078.601799:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.601857:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179264 00000100:00100000:0.0:1788270078.601866:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179264 00000100:00100000:0.0:1788270078.601988:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:0.0:1788270078.602008:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2400:x1875136253179264:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270078.602025:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.602083:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ae3 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270078.602122:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270078.602141:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=870s v=(0 0) 00010000:00010000:0.0:1788270078.602146:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270078.602156:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 6 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.602175:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 6 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.602188:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270078.602252:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253179264:12345-192.168.201.42@tcp:101:bash.0 Request processed in 255us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.602260:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788270078.606650:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.606772:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179392 00000100:00100000:0.0:1788270078.606783:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179392 00000100:00100000:0.0:1788270078.606828:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:0.0:1788270078.606835:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:35302:x1875136253179392:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270078.606850:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.606863:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101aea expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.606888:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.606895:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270078.606898:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270078.606902:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.606925:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.606935:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 970 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270078.606944:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262633216:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270078.607414:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c144293cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270078.610693:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.610693:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262633216:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270078.610731:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 7 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.610757:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ea00, rc 0) 00000100:00100000:0.0:1788270078.610823:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:35302:x1875136253179392:12345-192.168.201.42@tcp:101:bash.0 Request processed in 3986us (4181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.610832:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:2.0:1788270078.612226:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179520 00000100:00100000:2.0:1788270078.612238:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179520 00010000:00010000:2.0:1788270078.612274:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 970 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270078.612325:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:2.0:1788270078.612335:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253179520:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270078.612349:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270078.612372:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 970 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.612386:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 970 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.612409:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005402f45/0xc5f5d7a016e09479 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ae3 expref: 7 pid: 48230 timeout: 970 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.612425:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270078.612430:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270078.612439:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.612449:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.612482:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270078.612496:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:45762:1875136262633344:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270078.612569:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2486613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270078.615996:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:45762:1875136262633344:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270078.616020:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270078.616127:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253179520:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3792us (5437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.616139:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788270078.622984:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.623101:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179776 00000100:00100000:2.0:1788270078.623109:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179776 00000100:00100000:2.0:1788270078.623164:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:2.0:1788270078.623171:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:35302:x1875136253179776:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:2.0:1788270078.623484:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:35302:x1875136253179776:12345-192.168.201.42@tcp:35:bash.0 Request processed in 311us (507us total) trans 30064771202 rc 0/0 00000100:00100000:2.0:1788270078.623492:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788270078.660320:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262633600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270078.660370:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262633472:0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.660444:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270078.660503:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262633984:0@lo:400:kworker.0 00000100:00100000:1.0:1788270078.660527:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270078.660536:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270078.660564:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262634496:0@lo:400:kworker.0 00000100:00100000:1.0:1788270078.660568:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262634112:0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.660597:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270078.660616:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270078.660621:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262635008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270078.660644:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262634624:0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.660652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270078.660686:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270078.660804:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262633600 00000100:00100000:2.0:1788270078.660813:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262633600 00000100:00100000:2.0:1788270078.660862:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788270078.660871:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262633600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270078.660898:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40730304 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1788270078.660970:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788270078.660979:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262633856:0@lo:400:kworker.0 00000100:00080000:3.0:1788270078.660987:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270078.661008:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.661026:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634112 00000100:00100000:0.0:1788270078.661031:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262634368:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661032:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634112 00000100:00100000:0.0:1788270078.661087:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.661095:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262635008 00000100:00100000:3.0:1788270078.661100:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262635008 00000100:00100000:0.0:1788270078.661109:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262634880:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661136:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634624 00000100:00100000:0.0:1788270078.661141:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.661142:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634624 00000100:00100000:0.0:1788270078.661156:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270078.661162:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634880 00000100:00100000:3.0:1788270078.661166:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634880 00000100:00100000:0.0:1788270078.661167:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262635392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270078.661191:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788270078.661198:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.661203:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262634112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.661236:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262633472 00000100:00100000:0.0:1788270078.661241:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262633472 00000100:00100000:3.0:1788270078.661264:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262634112:12345-0@lo:400:kworker.0 Request processed in 64us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.661275:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788270078.661279:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788270078.661288:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262633472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661308:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788270078.661317:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262635008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.661328:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262633472:12345-0@lo:400:kworker.0 Request processed in 41us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.661335:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788270078.661365:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262633984 00000100:00100000:0.0:1788270078.661369:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262633984 00000100:00100000:0.0:1788270078.661393:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634496 00000100:00100000:0.0:1788270078.661396:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634496 00000100:00100000:0.0:1788270078.661409:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262633856 00000100:00100000:0.0:1788270078.661411:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262633856 00000100:00100000:0.0:1788270078.661423:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634368 00000100:00100000:0.0:1788270078.661426:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634368 00000100:00100000:0.0:1788270078.661441:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270078.661448:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.661495:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262633984:12345-0@lo:400:kworker.0 Request processed in 47us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.661503:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788270078.661521:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262635008:12345-0@lo:400:kworker.0 Request processed in 203us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.661525:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788270078.661535:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788270078.661537:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262634496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661555:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788270078.661564:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262634624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.661575:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262634496:12345-0@lo:400:kworker.0 Request processed in 40us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.661583:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788270078.661606:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788270078.661607:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262634624:12345-0@lo:400:kworker.0 Request processed in 41us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.661620:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788270078.661620:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262633856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661636:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788270078.661645:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262634880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.661660:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262633856:12345-0@lo:400:kworker.0 Request processed in 45us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.661670:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788270078.661682:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788270078.661689:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262634368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661761:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262634880:12345-0@lo:400:kworker.0 Request processed in 118us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.661772:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788270078.661793:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262635392 00000100:00100000:3.0:1788270078.661797:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262635392 00000100:00100000:3.0:1788270078.661819:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788270078.661825:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262635392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270078.661841:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66395840 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788270078.661870:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262635392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.661876:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788270078.661897:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270078.661900:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270078.661902:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270078.661904:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270078.661935:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262633728:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.661976:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.661999:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262634240:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662020:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.662057:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262634752:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662081:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.662097:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262635264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270078.662118:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270078.662148:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262633728 00000100:00100000:3.0:1788270078.662152:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262633728 00000100:00100000:3.0:1788270078.662174:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634240 00000100:00100000:3.0:1788270078.662177:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634240 00000100:00100000:3.0:1788270078.662191:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788270078.662196:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262633728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662249:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262633728:12345-0@lo:400:kworker.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.662255:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788270078.662268:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788270078.662274:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662312:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262634240:12345-0@lo:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.662318:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788270078.662592:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262635264 00000100:00100000:3.0:1788270078.662597:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262635264 00000100:00100000:3.0:1788270078.662619:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788270078.662625:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262635264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270078.662635:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66395840 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788270078.662662:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262635264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.662795:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788270078.662837:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262633728:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662849:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262634240:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662864:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262635264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270078.662896:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262634752 00000100:00100000:3.0:1788270078.662899:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262634752 00000100:00100000:3.0:1788270078.662930:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788270078.662937:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262634752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.662987:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262634752:12345-0@lo:400:kworker.0 Request processed in 50us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.662994:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788270078.663150:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270078.663171:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262634752:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.663438:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262635392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270078.663452:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262633856:0@lo:400:kworker.0 00010000:00080000:3.0:1788270078.663464:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a62df80 x1875136262634880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270078.663474:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262634880:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.663483:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262633472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.663491:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262633984:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.663499:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262634496:0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.663509:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262635008:0@lo:400:kworker.0 00000100:00100000:0.0:1788270078.663671:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262634368:12345-0@lo:400:kworker.0 Request processed in 1980us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.663679:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788270078.664846:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262634368:0@lo:400:kworker.0 00000100:00100000:1.0:1788270078.667241:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262634624:0@lo:400:kworker.0 00000100:00100000:1.0:1788270078.667258:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262635136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270078.667584:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270078.667734:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262634112:0@lo:400:kworker.0 00000100:00100000:2.0:1788270078.667837:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262633600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6965us (7308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270078.667849:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788270078.667910:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262635136 00000100:00100000:3.0:1788270078.667917:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262635136 00000100:00100000:1.0:1788270078.667965:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262633600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270078.668075:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788270078.668085:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262635136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270078.668133:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262635136:12345-0@lo:400:kworker.0 Request processed in 50us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.668139:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788270078.668172:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27c2c7800 x1875136262635136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270078.668184:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262635136:0@lo:400:kworker.0 00000100:00080000:0.0:1788270078.668378:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270078.680321:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.680693:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253179904 00000100:00100000:0.0:1788270078.680703:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253179904 00000100:00100000:0.0:1788270078.680802:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:0.0:1788270078.680814:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:35309:x1875136253179904:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270078.680837:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.680860:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101af1 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.680922:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0948e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.680935:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0948e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.680946:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0948e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270078.681008:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270078.681012:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270078.681031:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0948e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.681098:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101af1 expref: 14 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.681117:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0948e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101af1 expref: 13 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.681136:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1300) 00010000:00010000:0.0:1788270078.681139:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270078.681142:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f600, rc 0) 00000100:00100000:0.0:1788270078.681212:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:35309:x1875136253179904:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 400us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.681220:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:3.0:1788270078.683659:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.683985:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253180160 00000100:00100000:0.0:1788270078.683996:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253180160 00000100:00100000:0.0:1788270078.684118:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:0.0:1788270078.684129:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:35309:x1875136253180160:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270078.684149:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.684167:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101af8 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.684265:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.684280:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 14 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.684289:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.684324:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 14 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.684338:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 14 pid: 48110 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270078.684352:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262635520:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270078.684709:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c144293480 going to sleep for 11 seconds 00000100:00100000:0.0:1788270078.689839:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262635520:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270078.689868:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270078.689929:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.690099:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253180288 00000100:00100000:3.0:1788270078.690107:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253180288 00010000:00010000:3.0:1788270078.690195:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 15 pid: 48110 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270078.690449:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788270078.690459:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253180288:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270078.690474:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270078.690481:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 15 pid: 48110 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.690494:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 15 pid: 48110 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.690513:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e0946b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101adc expref: 15 pid: 48110 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.690528:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1c00) 00010000:00010000:3.0:1788270078.690533:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.690542:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.690549:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.690657:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270078.690709:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253180288:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 250us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.690716:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00010000:00010000:0.0:1788270078.690938:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.690946:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270078.691008:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1788270078.691144:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101af8 expref: 15 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.691160:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101af8 expref: 14 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.691168:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1c00) 00010000:00010000:0.0:1788270078.691170:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788270078.691173:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e200, rc 0) 00000100:00100000:0.0:1788270078.691240:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:35309:x1875136253180160:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 7113us (7591us total) trans 30064771203 rc 0/0 00000100:00100000:0.0:1788270078.691247:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:1.0:1788270078.693633:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.693780:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253180544 00000100:00100000:2.0:1788270078.693789:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253180544 00000100:00100000:2.0:1788270078.693879:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:2.0:1788270078.693890:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:35309:x1875136253180544:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270078.693910:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270078.693914:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270078.693936:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e0949c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101af8 expref: 14 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.693967:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1c00) 00010000:00010000:2.0:1788270078.693978:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270078.693993:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e094aa lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101aff expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.694112:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e094b1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.694124:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e094b1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.694206:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e094b1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270078.694218:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:2.0:1788270078.694302:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e094aa lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aff expref: 16 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.694316:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e094b1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aff expref: 15 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.694324:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:2.0:1788270078.694326:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270078.694329:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821da400, rc 0) 00000100:00100000:2.0:1788270078.694377:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:35309:x1875136253180544:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 490us (752us total) trans 30064771204 rc 0/0 00000100:00100000:2.0:1788270078.694384:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:1.0:1788270078.701539:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.701616:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253180672 00000100:00100000:0.0:1788270078.701625:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253180672 00000100:00100000:0.0:1788270078.701670:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:0.0:1788270078.701677:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:35309:x1875136253180672:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270078.701706:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.701726:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b06 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.701775:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.701786:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.701800:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:0.0:1788270078.701802:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270078.701805:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e600, rc 0) 00000100:00100000:0.0:1788270078.701852:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:35309:x1875136253180672:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 176us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.701857:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:1.0:1788270078.704846:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.704910:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253180800 00000100:00100000:3.0:1788270078.704917:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253180800 00000100:00100000:3.0:1788270078.704968:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788270078.704975:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253180800:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:3.0:1788270078.705009:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.705024:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.705030:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270078.705033:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270078.705036:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.705091:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 6 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.705100:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 6 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270078.705110:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262635648:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270078.705248:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23840 going to sleep for 11 seconds 00000100:00100000:3.0:1788270078.706486:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262635648:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270078.706502:0:47284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270078.706938:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.707056:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253180928 00000100:00100000:2.0:1788270078.707061:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253180928 00002000:00100000:2.0:1788270078.707094:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc4:0x0] (0->15) req@ffff98c26bf28700 x1875136253180928/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:494/0 lens 504/0 e 0 to 0 dl 1788270089 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270078.707103:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28700 with x1875136253180928 ext(0->15) 00010000:00010000:2.0:1788270078.707110:0:47287:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 7 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.707122:0:47287:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 7 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270078.707129:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c26bf28700 00000100:00100000:2.0:1788270078.707156:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788270078.707165:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253180928:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:2.0:1788270078.708279:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253180928:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 1111us (1338us total) trans 30064771088 rc 0/0 00000100:00100000:2.0:1788270078.708289:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00002000:00100000:2.0:1788270078.708297:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc4:0x0] (0->15) req@ffff98c26bf28700 x1875136253180928/t30064771088(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:494/0 lens 504/448 e 0 to 0 dl 1788270089 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270078.708306:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28700 with x1875136253180928 ext(0->15) 00010000:00010000:2.0:1788270078.708312:0:47287:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 9 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.708325:0:47287:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 9 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270078.708332:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c26bf28700 00000100:00100000:1.0:1788270078.712945:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.713579:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253181056 00000100:00100000:0.0:1788270078.713590:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253181056 00010000:00010000:0.0:1788270078.713630:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 9 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270078.713670:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788270078.713678:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2403:x1875136253181056:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270078.713690:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788270078.713705:0:45761:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:0.0:1788270078.713709:0:45761:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788270078 00002000:00010000:0.0:1788270078.713711:0:45761:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb atime from disk: 0 -> 1788270078 00002000:00010000:0.0:1788270078.713713:0:45761:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb ctime from disk: 0 -> 1788270078 00002000:00010000:0.0:1788270078.713715:0:45761:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788270078.713722:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 9 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.713736:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 9 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.713758:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541f7679/0xc5f5d7a016e09480 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aea expref: 9 pid: 48231 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.713774:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270078.713778:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270078.713784:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.713794:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.713825:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270078.713883:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2403:x1875136253181056:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 205us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.713890:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00010000:00010000:1.0:1788270078.714067:0:47284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714077:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714097:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714106:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714114:0:47284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714121:0:47284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270078.714125:0:47284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714134:0:47284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714146:0:47284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.714158:0:47284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000616431f9/0xc5f5d7a016e094c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270078.714206:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253180800:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 9231us (9366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270078.714214:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788270078.715743:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.715818:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253181312 00000100:00100000:2.0:1788270078.715825:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253181312 00000100:00100000:2.0:1788270078.715863:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788270078.715869:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144057050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:35309:x1875136253181312:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:2.0:1788270078.715910:0:45780:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x10:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e094b1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aff expref: 16 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270078.716174:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771205 00000001:00080000:2.0:1788270078.716198:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771206 00000001:00080000:2.0:1788270078.716698:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771207 00010000:00010000:2.0:1788270078.716734:0:45780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.716748:0:45780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 20 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.716756:0:45780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.716789:0:45780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 20 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.716801:0:45780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 20 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270078.716812:0:45780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:45780:1875136262635776:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270078.716902:0:45780:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788270078.720768:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.720795:0:45780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:45780:1875136262635776:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270078.720826:0:45780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270078.720840:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253181440 00000100:00100000:1.0:1788270078.720847:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253181440 00010000:00010000:1.0:1788270078.720878:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 21 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270078.720908:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:1.0:1788270078.720918:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253181440:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270078.720931:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270078.720938:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 21 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.720963:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 21 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.720984:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e094bf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b06 expref: 21 pid: 45777 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.721001:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:1.0:1788270078.721006:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.721014:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.721019:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.721062:0:45780:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270078.721064:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270078.721069:0:45780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270078.721114:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253181440:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270078.721120:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000001:00080000:2.0:1788270078.721160:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771208 00000001:00080000:2.0:1788270078.721279:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771209 00000100:00100000:2.0:1788270078.721361:0:45780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:45780:1875136262635904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788270078.721412:0:45780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270078.721434:0:45780:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248661cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270078.722367:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262635904 00000100:00100000:0.0:1788270078.722374:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262635904 00000100:00100000:0.0:1788270078.722419:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788270078.722432:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45780:x1875136262635904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788270078.722513:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45780:x1875136262635904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.722519:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788270078.722611:0:45780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:45780:1875136262635904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788270078.722734:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771210 00000100:00100000:2.0:1788270078.722781:0:45780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:45780:1875136262636032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788270078.722811:0:45780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270078.722842:0:45780:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246ed8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270078.722962:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262636032 00000100:00100000:1.0:1788270078.722967:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262636032 00000100:00100000:1.0:1788270078.723000:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788270078.723008:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45780:x1875136262636032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788270078.723128:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:45780:x1875136262636032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (316us total) trans 30064771089 rc 0/0 00000100:00100000:1.0:1788270078.723135:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788270078.723398:0:45780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:45780:1875136262636032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788270078.723446:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771211 00010000:00010000:2.0:1788270078.723476:0:45780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.723485:0:45780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.723493:0:45780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.723498:0:45780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270078.723502:0:45780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.723512:0:45780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.723527:0:45780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:2.0:1788270078.723530:0:45780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788270078.723534:0:45780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270078.723541:0:45780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e094cd lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270078.723634:0:45780:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788270078.723691:0:45780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].6, 64 off8624 00000004:00080000:2.0:1788270078.723702:0:45780:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 870430662713ns, next at 871430660504ns, rc = 0 00000001:00080000:2.0:1788270078.723709:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771212 00010000:00010000:2.0:1788270078.723730:0:45780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:2.0:1788270078.723733:0:45780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270078.723739:0:45780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e094b1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101aff expref: 24 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270078.723827:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144057050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:35309:x1875136253181312:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 7957us (8089us total) trans 30064771213 rc 0/0 00000100:00100000:2.0:1788270078.723836:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000020:00080000:2.0:1788270078.723839:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788270078.726743:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.726865:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253181568 00000100:00100000:3.0:1788270078.726875:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253181568 00000100:00100000:3.0:1788270078.727033:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:3.0:1788270078.727069:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:35309:x1875136253181568:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270078.727093:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270078.727118:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e094d4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b0d expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.727172:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e094d4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b0d expref: 24 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.727185:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e094d4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b0d expref: 24 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.727202:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fd100) 00010000:00010000:3.0:1788270078.727206:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270078.727209:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ea00, rc 0) 00000100:00100000:3.0:1788270078.727267:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:35309:x1875136253181568:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 201us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.727273:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:3.0:1788270078.730322:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.730466:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253181824 00000100:00100000:0.0:1788270078.730476:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253181824 00000100:00100000:0.0:1788270078.730536:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788270078.730546:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:35309:x1875136253181824:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270078.730801:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:35309:x1875136253181824:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 255us (487us total) trans 30064771214 rc 0/0 00000100:00100000:0.0:1788270078.730810:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270078.803831:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.804024:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253181952 00000100:00100000:2.0:1788270078.804036:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253181952 00000100:00100000:2.0:1788270078.804132:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:2.0:1788270078.804144:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:35319:x1875136253181952:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788270078.804300:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804319:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804335:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804347:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804353:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804359:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804432:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804440:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804447:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270078.804493:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804507:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804514:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804520:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804530:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270078.804535:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804555:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804567:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1300) 00010000:00010000:0.0:1788270078.804570:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270078.804575:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804581:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e094db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804593:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804598:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804604:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804609:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270078.804612:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804618:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804630:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f1900) 00010000:00010000:0.0:1788270078.804632:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270078.804635:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804640:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e094e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804650:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804655:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804661:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804666:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270078.804891:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804900:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804909:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fd100) 00010000:00010000:0.0:1788270078.804911:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270078.804914:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.804920:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e094e9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270078.805011:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:35319:x1875136253181952:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 869us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.805019:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:1.0:1788270078.840133:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.840277:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253182080 00000100:00100000:3.0:1788270078.840287:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253182080 00000100:00100000:3.0:1788270078.840335:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:3.0:1788270078.840345:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:35320:x1875136253182080:12345-192.168.201.42@tcp:101:mmap_cat.0 00010000:00010000:3.0:1788270078.840366:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270078.840386:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e094f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b14 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840461:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840475:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840487:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840498:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840505:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840511:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840584:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840592:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840598:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270078.840637:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1788270078.840641:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270078.840676:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840688:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840695:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840702:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840709:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840715:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270078.840719:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840726:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840739:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1300) 00010000:00010000:3.0:1788270078.840742:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270078.840747:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840753:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e094f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840768:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840774:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840780:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840784:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270078.840787:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840792:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840799:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f1900) 00010000:00010000:3.0:1788270078.840801:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270078.840804:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840810:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e094fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840833:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e094f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b14 expref: 27 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840846:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b14 expref: 26 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.840857:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fd100) 00010000:00010000:3.0:1788270078.840859:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270078.840861:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f200, rc 0) 00000100:00100000:3.0:1788270078.840923:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:35320:x1875136253182080:12345-192.168.201.42@tcp:101:mmap_cat.0 Request processed in 578us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.840930:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:3.0:1788270078.843615:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.843755:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253182336 00000100:00100000:0.0:1788270078.843764:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253182336 00000100:00100000:0.0:1788270078.843820:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 179 00000100:00100000:0.0:1788270078.843829:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:35320:x1875136253182336:12345-192.168.201.42@tcp:101:mmap_cat.0 00010000:00010000:0.0:1788270078.843848:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.843866:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0950c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b1b expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.843981:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09513 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.843995:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09513 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.844006:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09513 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270078.844016:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1788270078.844136:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0950c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b1b expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.844155:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09513 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b1b expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.844164:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fd100) 00010000:00010000:0.0:1788270078.844167:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270078.844171:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f000, rc 0) 00000100:00100000:0.0:1788270078.844226:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35320:x1875136253182336:12345-192.168.201.42@tcp:101:mmap_cat.0 Request processed in 398us (618us total) trans 30064771215 rc 0/0 00000100:00100000:0.0:1788270078.844346:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 179 00000100:00100000:1.0:1788270078.850601:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.850702:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253182464 00000100:00100000:3.0:1788270078.850713:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253182464 00000100:00100000:3.0:1788270078.850781:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788270078.850791:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2403:x1875136253182464:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270078.850810:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270078.850833:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09513 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b1b expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.850853:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fd100) 00010000:00010000:3.0:1788270078.850859:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270078.851144:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2403:x1875136253182464:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 353us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.851152:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788270078.854580:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270078.857132:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253182720 00000100:00100000:2.0:1788270078.857147:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253182720 00000100:00100000:2.0:1788270078.857208:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788270078.857218:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35320:x1875136253182720:12345-192.168.201.42@tcp:35:mmap_cat.0 00000100:00100000:2.0:1788270078.857652:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35320:x1875136253182720:12345-192.168.201.42@tcp:35:mmap_cat.0 Request processed in 434us (3079us total) trans 30064771216 rc 0/0 00000100:00100000:2.0:1788270078.857661:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788270078.878754:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270078.878838:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253182976 00000100:00100000:3.0:1788270078.878851:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253182976 00000100:00100000:3.0:1788270078.878964:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:3.0:1788270078.878976:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35321:x1875136253182976:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:3.0:1788270078.878993:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788270078.879024:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09505 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b14 expref: 28 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.879078:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e094d4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b0d expref: 27 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270078.879090:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429fd100) 00010000:00010000:3.0:1788270078.879100:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270078.879154:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:35321:x1875136253182976:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 180us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270078.879161:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788270078.882461:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.882549:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253183104 00000100:00100000:0.0:1788270078.882559:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253183104 00000100:00100000:0.0:1788270078.882614:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00100000:0.0:1788270078.882624:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:35321:x1875136253183104:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:0.0:1788270078.882733:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.882750:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.882762:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270078.882855:0:48110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].5, 136 off8872 00000100:00100000:0.0:1788270078.882933:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:35321:x1875136253183104:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 310us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.882941:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00100000:1.0:1788270078.902964:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270078.903075:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253183232 00000100:00100000:0.0:1788270078.903086:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253183232 00000100:00100000:0.0:1788270078.903150:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 181 00000100:00100000:0.0:1788270078.903161:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:35323:x1875136253183232:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270078.903182:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270078.903202:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b22 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903286:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903300:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903311:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903322:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903329:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903335:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903417:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903427:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903445:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270078.903487:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1788270078.903492:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270078.903510:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903526:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903534:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903540:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903547:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903553:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270078.903557:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903564:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903575:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1300) 00010000:00010000:0.0:1788270078.903579:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270078.903584:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903589:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0952f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903602:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903607:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903613:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903618:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270078.903620:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903626:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903632:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f1900) 00010000:00010000:0.0:1788270078.903634:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270078.903637:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903642:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09536 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903665:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903678:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 27 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270078.903685:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:0.0:1788270078.903686:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270078.903689:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e000, rc 0) 00000100:00100000:0.0:1788270078.903749:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35323:x1875136253183232:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 590us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270078.903758:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 181 00000040:00080000:1.0:1788270079.045072:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788270079.364372:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270079.364382:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270079.364411:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 6 count 6 00000040:00080000:3.0:1788270079.364418:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270079.364554:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262636160:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788270079.364641:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270079.371104:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262636160:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270079.371351:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.371545:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253183360 00000100:00100000:3.0:1788270079.371552:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253183360 00000100:00100000:3.0:1788270079.371606:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 182 00000100:00100000:3.0:1788270079.371616:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35334:x1875136253183360:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270079.371647:0:45777:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270079.371757:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35334:x1875136253183360:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 141us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270079.371765:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 182 00000100:00100000:3.0:1788270079.380294:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.380325:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253183488 00000100:00100000:1.0:1788270079.380337:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253183488 00000100:00100000:1.0:1788270079.380391:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 183 00000100:00100000:1.0:1788270079.380402:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35334:x1875136253183488:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788270079.380469:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380483:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380497:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380511:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380518:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380537:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380564:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380573:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380579:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270079.380625:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:1.0:1788270079.380629:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270079.380641:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380652:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380658:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380664:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380671:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270079.380675:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380682:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380695:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:1.0:1788270079.380698:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270079.380702:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380709:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e09544 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380721:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380726:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380731:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380736:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270079.380740:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380745:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380752:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x743283ca (ffff98c14387f100) 00010000:00010000:1.0:1788270079.380755:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270079.380757:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380763:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e0954b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380777:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380783:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380789:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380793:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270079.380796:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380801:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380812:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:1.0:1788270079.380814:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270079.380817:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.380822:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e09552 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270079.380900:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35334:x1875136253183488:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 500us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270079.380909:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 183 00000100:00100000:3.0:1788270079.382793:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.383025:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253183744 00000100:00100000:0.0:1788270079.383034:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253183744 00000100:00100000:0.0:1788270079.383119:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:0.0:1788270079.383130:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:35334:x1875136253183744:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270079.383148:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270079.383166:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09559 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b29 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383279:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383293:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383304:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270079.383315:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1788270079.383393:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383401:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383409:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383415:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270079.383420:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383427:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383452:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:0.0:1788270079.383456:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270079.383460:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383465:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09560 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383502:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09559 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b29 expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383512:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270079.383514:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270079.383517:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09559 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b29 expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.383527:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ec00, rc 0) 00000100:00100000:0.0:1788270079.383582:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35334:x1875136253183744:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 455us (794us total) trans 30064771217 rc 301/301 00000100:00100000:0.0:1788270079.383590:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:2.0:1788270079.386546:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.386606:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253183872 00000100:00100000:0.0:1788270079.386614:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253183872 00000100:00100000:0.0:1788270079.386699:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 185 00000100:00100000:0.0:1788270079.386709:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35334:x1875136253183872:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788270079.386741:0:48110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788270079.386850:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35334:x1875136253183872:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 143us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270079.386863:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 185 00000100:00100000:1.0:1788270079.394623:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.394663:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253184128 00000100:00100000:1.0:1788270079.394672:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253184128 00000100:00100000:1.0:1788270079.394719:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:1.0:1788270079.394728:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35334:x1875136253184128:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270079.394747:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270079.394750:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788270079.394773:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0948e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101af1 expref: 28 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.394790:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1300) 00010000:00010000:1.0:1788270079.394800:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270079.394810:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0956e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b30 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788270079.395278:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc4:0x0], index 1: 0 00010000:00010000:1.0:1788270079.395398:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09575 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.395407:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09575 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.395414:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09575 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.395450:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0956e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b30 expref: 30 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.395472:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09575 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b30 expref: 29 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.395477:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f300) 00010000:00010000:1.0:1788270079.395479:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270079.395481:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b600, rc 0) 00000100:00100000:1.0:1788270079.395541:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:35334:x1875136253184128:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 813us (929us total) trans 30064771218 rc 0/0 00000100:00100000:1.0:1788270079.395549:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:2.0:1788270079.400616:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.400661:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253184256 00000100:00100000:0.0:1788270079.400671:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253184256 00000100:00100000:0.0:1788270079.400725:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 187 00000100:00100000:0.0:1788270079.400736:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:35334:x1875136253184256:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270079.400759:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270079.400777:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b37 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.400827:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0958a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.400837:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0958a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.400844:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0958a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270079.400877:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270079.400880:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270079.400894:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0958a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.400911:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b37 expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.400926:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0958a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b37 expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.400932:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270079.400934:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270079.400949:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e400, rc 0) 00000100:00100000:0.0:1788270079.401195:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:35334:x1875136253184256:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 460us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270079.401203:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 187 00000100:00100000:2.0:1788270079.404894:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.404992:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253184512 00000100:00100000:0.0:1788270079.405003:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253184512 00000100:00100000:0.0:1788270079.405072:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:0.0:1788270079.405083:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:35334:x1875136253184512:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270079.405135:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788270079.405163:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09575 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b30 expref: 30 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405180:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f300) 00010000:00010000:0.0:1788270079.405196:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e0958a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b37 expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405206:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270079.405212:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270079.405233:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405249:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405258:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405271:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405278:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405285:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405328:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405335:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405340:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405346:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270079.405350:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405357:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405364:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1100) 00010000:00010000:0.0:1788270079.405367:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270079.405371:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405376:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09591 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405387:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405392:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405397:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405401:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270079.405404:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405410:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405415:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x73ae6e6d (ffff98c1429f1600) 00010000:00010000:0.0:1788270079.405417:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270079.405419:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.405424:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09598 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x73ae6e6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270079.405498:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35334:x1875136253184512:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 416us (612us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270079.405505:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:3.0:1788270079.410372:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.410533:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253184640 00000100:00100000:1.0:1788270079.410542:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253184640 00000100:00100000:1.0:1788270079.410591:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 189 00000100:00100000:1.0:1788270079.410600:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:35334:x1875136253184640:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270079.410617:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270079.410637:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0959f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b3e expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.410681:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.410692:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.410702:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.410796:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0959f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 30 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.410808:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 29 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.410815:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270079.410818:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270079.410820:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a000, rc 0) 00000100:00100000:1.0:1788270079.410883:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:35334:x1875136253184640:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 284us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270079.410889:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 189 00000100:00100000:2.0:1788270079.412861:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.412977:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253184896 00000100:00100000:0.0:1788270079.412986:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253184896 00000100:00100000:2.0:1788270079.413074:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:2.0:1788270079.413085:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:35334:x1875136253184896:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270079.413150:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.413166:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.413176:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270079.413316:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].6, 88 off8648 00000004:00080000:2.0:1788270079.413324:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 871120284258ns, next at 872120281881ns, rc = 0 00000004:00010000:2.0:1788270079.413365:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ceb76897 reply state 00000000b42c3631 transno 30064771219 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.413392:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.413398:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.413401:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270079.413404:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270079.413491:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:35334:x1875136253184896:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 409us (637us total) trans 30064771219 rc 0/0 00000100:00100000:2.0:1788270079.413498:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:2.0:1788270079.417287:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.421243:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253185024 00000100:00100000:1.0:1788270079.421256:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253185024 00000100:00100000:1.0:1788270079.421314:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 191 00000100:00100000:1.0:1788270079.421323:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:35334:x1875136253185024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270079.421344:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270079.421364:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b45 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.421416:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.421526:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.421546:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270079.421549:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270079.421552:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ac00, rc 0) 00000100:00100000:1.0:1788270079.421611:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:35334:x1875136253185024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 288us (4338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270079.421618:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 191 00000100:00100000:0.0:1788270079.427647:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.427713:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253185152 00000100:00100000:3.0:1788270079.427723:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253185152 00000100:00100000:3.0:1788270079.427782:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270079.427792:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253185152:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788270079.428007:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253185152:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 216us (370us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1788270079.428015:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:2.0:1788270079.431251:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.431328:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253185408 00000100:00100000:3.0:1788270079.431337:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253185408 00000100:00100000:3.0:1788270079.431386:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788270079.431397:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:35334:x1875136253185408:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270079.431609:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:35334:x1875136253185408:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 214us (367us total) trans 30064771220 rc 0/0 00000100:00100000:3.0:1788270079.431617:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00010000:00010000:0.0:1788270079.433749:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270079.437476:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270079.437545:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253185664 00000100:00100000:2.0:1788270079.437555:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253185664 00000100:00100000:2.0:1788270079.437612:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00100000:2.0:1788270079.437623:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:35334:x1875136253185664:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270079.437729:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:35334:x1875136253185664:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.437737:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00100000:1.0:1788270079.443340:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270079.443614:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253185792 00000100:00100000:2.0:1788270079.443625:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253185792 00000100:00100000:2.0:1788270079.443689:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 193 00000100:00100000:2.0:1788270079.443699:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:35334:x1875136253185792:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270079.443719:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270079.443738:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e095bb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b4c expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.443813:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e095c2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.443826:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e095c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.443837:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e095c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270079.445174:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270079.445203:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e095c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.445237:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e095bb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b4c expref: 35 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.445257:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e095c2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b4c expref: 34 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.445266:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.445269:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270079.445272:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821da200, rc 0) 00000100:00100000:2.0:1788270079.445335:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:35334:x1875136253185792:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1636us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.445343:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 193 00000100:00100000:2.0:1788270079.450092:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.450130:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253185920 00000100:00100000:0.0:1788270079.450141:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253185920 00000100:00100000:0.0:1788270079.450201:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:0.0:1788270079.450212:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253185920:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270079.450229:0:47283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270079.450250:0:47283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b53 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270079.450277:0:47283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d5ff, blocks: 0x0 00010000:00010000:0.0:1788270079.450295:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=871s v=(0 0) 00010000:00010000:0.0:1788270079.450300:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270079.450310:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 7 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.450330:0:47283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 7 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.450344:0:47283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e400, rc 0) 00000100:00100000:0.0:1788270079.450410:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253185920:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 199us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270079.450423:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:0.0:1788270079.454773:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.454859:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253186176 00000100:00100000:3.0:1788270079.454869:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253186176 00000100:00100000:3.0:1788270079.454923:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:3.0:1788270079.454934:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:35334:x1875136253186176:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788270079.455119:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:35334:x1875136253186176:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 186us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270079.455127:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:2.0:1788270079.458102:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.458132:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253186304 00000100:00100000:3.0:1788270079.458142:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253186304 00000100:00100000:3.0:1788270079.458199:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788270079.458210:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:35334:x1875136253186304:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270079.458228:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270079.458246:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b5a expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.458279:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.458289:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270079.458293:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270079.458298:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 8 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.458330:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.458352:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 971 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270079.458367:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262636288:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270079.458559:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788270079.461891:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262636288:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270079.461930:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 8 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.461964:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ea00, rc 0) 00000100:00100000:1.0:1788270079.462538:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:35334:x1875136253186304:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 4328us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270079.462548:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788270079.462827:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.464328:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253186432 00000100:00100000:1.0:1788270079.464344:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253186432 00010000:00010000:1.0:1788270079.464457:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 971 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270079.465901:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788270079.465912:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253186432:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270079.465926:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270079.465957:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 971 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.465976:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 971 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.465999:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8c5d4d/0xc5f5d7a016e095c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b53 expref: 8 pid: 47283 timeout: 971 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.466013:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270079.466017:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270079.466107:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.466118:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.466155:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270079.466169:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262636416:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788270079.466250:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2454d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788270079.469239:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262636416:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270079.469263:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270079.469365:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253186432:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3438us (6522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.469385:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788270079.474984:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.475028:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253186560 00000100:00100000:1.0:1788270079.476126:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253186560 00002000:00100000:1.0:1788270079.476182:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc4:0x0] (0->15) req@ffff98c26bf29c00 x1875136253186560/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:495/0 lens 504/0 e 0 to 0 dl 1788270090 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270079.476193:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf29c00 with x1875136253186560 ext(0->15) 00002000:00010000:1.0:1788270079.476199:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf29c00 00000100:00100000:1.0:1788270079.476233:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788270079.476242:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253186560:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788270079.478637:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253186560:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 2386us (3653us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1788270079.478651:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00002000:00100000:1.0:1788270079.478661:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc4:0x0] (0->15) req@ffff98c26bf29c00 x1875136253186560/t30064771092(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:495/0 lens 504/448 e 0 to 0 dl 1788270090 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270079.478671:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf29c00 with x1875136253186560 ext(0->15) 00002000:00010000:1.0:1788270079.478676:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf29c00 00000100:00100000:3.0:1788270079.484460:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.484571:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253186688 00000100:00100000:1.0:1788270079.484580:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253186688 00000100:00100000:1.0:1788270079.484629:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:1.0:1788270079.484637:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:35334:x1875136253186688:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788270079.485275:0:49079:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270079.485282:0:49079:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270079.485318:0:49079:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 6 count 6 00000040:00080000:0.0:1788270079.485325:0:49079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:00080000:1.0:1788270079.485849:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771220 is committed 00000004:00080000:1.0:1788270079.485861:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788270079.485903:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788270079.485925:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c246ed8f00 refcount 2 committed 0 result 0 batchid 25769803840 00000020:00080000:1.0:1788270079.485930:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c246ed8000 00000020:00080000:1.0:1788270079.485934:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c142804600 00000020:00080000:1.0:1788270079.485973:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803839 batchid updated 00000020:00080000:1.0:1788270079.486132:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803840 committed batchid 25769803839 00000100:00100000:2.0:1788270079.486145:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262636672:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788270079.486186:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803839 00000100:00100000:2.0:1788270079.486207:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270079.486261:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262636672 00000100:00100000:2.0:1788270079.486267:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262636672 00000100:00100000:1.0:1788270079.486280:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:35334:x1875136253186688:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 1641us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270079.486289:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:2.0:1788270079.486303:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788270079.486310:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262636672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788270079.486333:0:48231:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:196 count 1 00002000:00010000:2.0:1788270079.486361:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc4:0x0] initial LVB size: 16, mtime: 0x6a96d5fe, atime: 0x6a96d5fe, ctime: 0x6a96d5fe, blocks: 0x8 00010000:00010000:2.0:1788270079.486370:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.486387:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=871s v=(0 0) 00010000:00010000:2.0:1788270079.486392:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270079.486398:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.486413:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.486424:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.486438:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.486468:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788270079.486518:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270079.486531:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262636544:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788270079.486568:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788270079.486574:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788270079.486577:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.486584:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3607:x1875136262636672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 274us (377us total) trans 30064771090 rc 0/0 00010000:00010000:1.0:1788270079.486589:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc0e7f230) 00000100:00100000:2.0:1788270079.486591:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788270079.486593:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.486602:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.486606:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262636544 00000100:00100000:2.0:1788270079.486609:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262636544 00010000:00010000:1.0:1788270079.486619:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.486629:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f305dc/0xc5f5d7a016e095d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.486635:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788270079.486642:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262636544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788270079.486719:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:2.0:1788270079.486723:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788270079 00002000:00010000:2.0:1788270079.486725:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788270079.486727:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb ctime from disk: 1788270079 -> 1788270079 00002000:00010000:2.0:1788270079.486730:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788270079.486768:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262636544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (197us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1788270079.486774:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1788270079.486814:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1448f1500/2, rc 0, transno 30064771090 00000100:00100000:2.0:1788270079.486820:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262636672:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788270079.486865:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270079.486868:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270079.486870:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788270079.486891:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1448f2d80/2, rc 0, transno 30064771093 00000100:00100000:1.0:1788270079.486897:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262636544:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788270079.487201:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487211:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487217:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487223:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270079.487227:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487234:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487244:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f1900) 00010000:00010000:3.0:1788270079.487247:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270079.487250:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487256:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09464 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487273:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487280:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487285:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487290:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270079.487293:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487299:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487306:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270079.487309:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788270079.487311:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.487317:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e095ad lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270079.490337:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.490768:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253186816 00000100:00100000:3.0:1788270079.490777:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253186816 00000100:00100000:3.0:1788270079.490829:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:3.0:1788270079.490839:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253186816:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788270079.492413:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771093 is committed 00000001:00080000:2.0:1788270079.492426:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771092 is committed 00000100:00100000:3.0:1788270079.492543:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253186816:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1703us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270079.492553:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788270079.501360:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270079.501461:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253187072 00000100:00100000:2.0:1788270079.501471:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253187072 00000100:00100000:2.0:1788270079.501536:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:2.0:1788270079.501547:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:35334:x1875136253187072:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270079.501601:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270079.501631:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da200/0xc5f5d7a016e095c2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b4c expref: 11 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.501649:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.501654:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270079.501684:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.501698:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.501709:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270079.501826:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7f0ce06 reply state 0000000015208248 transno 30064771221 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.501838:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.501845:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.501848:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270079.501851:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270079.501966:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:35334:x1875136253187072:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 420us (611us total) trans 30064771221 rc 0/0 00000100:00100000:2.0:1788270079.501973:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:3.0:1788270079.504428:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.504531:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253187200 00000100:00100000:1.0:1788270079.504539:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253187200 00000100:00100000:1.0:1788270079.504751:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788270079.504764:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2402:x1875136253187200:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788270079.504948:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb size from disk: 16 -> 16 00002000:00010000:1.0:1788270079.504952:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb mtime from disk: 1788270079 -> 1788270078 00002000:00010000:1.0:1788270079.504955:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb atime from disk: 0 -> 1788270078 00002000:00010000:1.0:1788270079.504957:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb ctime from disk: 1788270079 -> 1788270078 00002000:00010000:1.0:1788270079.504960:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788270079.507463:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2402:x1875136253187200:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 2694us (3032us total) trans 30064771094 rc 0/0 00000100:00100000:1.0:1788270079.507478:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:3.0:1788270079.514272:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.514305:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253187456 00000100:00100000:3.0:1788270079.514314:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253187456 00000100:00100000:3.0:1788270079.514360:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 197 00000100:00100000:3.0:1788270079.514370:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:35334:x1875136253187456:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788270079.514433:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.514454:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 12 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.514465:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.514497:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 12 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.514512:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 12 pid: 45777 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270079.514527:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262636800:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270079.514601:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788270079.518283:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.518430:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262636800:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270079.518459:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.518569:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253187584 00000100:00100000:2.0:1788270079.518577:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253187584 00010000:00010000:2.0:1788270079.518613:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 13 pid: 45777 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.518676:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788270079.518683:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253187584:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270079.518694:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270079.518699:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 13 pid: 45777 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.518708:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 13 pid: 45777 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.518724:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a000/0xc5f5d7a016e095a6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b3e expref: 13 pid: 45777 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.518734:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.518738:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.518745:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.518750:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.518768:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270079.518806:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253187584:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 124us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.518813:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00010000:00010000:3.0:1788270079.518846:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518854:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518894:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518900:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518907:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518913:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270079.518916:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518923:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518932:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270079.518944:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788270079.518948:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.518953:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e095e5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270079.518992:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:35334:x1875136253187456:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 4624us (4729us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788270079.519001:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 197 00000100:00100000:3.0:1788270079.520582:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.520647:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253187712 00000100:00100000:0.0:1788270079.520653:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253187712 00000100:00100000:0.0:1788270079.520693:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788270079.520698:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253187712:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788270079.520730:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.520744:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.520750:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270079.520753:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270079.520757:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.520781:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 7 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.520791:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 7 pid: 47284 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270079.520801:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262636928:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270079.520854:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c144293180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270079.527434:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270079.527582:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262636928:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270079.527610:0:48230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.528000:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253187840 00000100:00100000:2.0:1788270079.528008:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253187840 00010000:00010000:2.0:1788270079.528064:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 8 pid: 47284 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.528103:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:2.0:1788270079.528113:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253187840:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270079.528128:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270079.528149:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 8 pid: 47284 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.528163:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 8 pid: 47284 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.528188:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087445fc/0xc5f5d7a016e095d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b5a expref: 8 pid: 47284 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.528201:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270079.528206:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270079.528212:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.528222:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.528255:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270079.528311:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253187840:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 199us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.528318:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00010000:00010000:0.0:1788270079.528404:0:48230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528413:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528431:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528439:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528453:0:48230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528461:0:48230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270079.528465:0:48230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528473:0:48230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528486:0:48230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.528494:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000184d179d/0xc5f5d7a016e095ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270079.528537:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253187712:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 7837us (7960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270079.528545:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788270079.533820:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270079.533917:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188096 00000100:00100000:1.0:1788270079.533927:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188096 00000100:00100000:1.0:1788270079.534035:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:1.0:1788270079.534077:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:35334:x1875136253188096:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788270079.534154:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534172:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534185:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534555:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534568:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 12 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534576:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534608:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 12 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.534622:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 12 pid: 48110 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270079.534637:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262637056:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270079.534767:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2454d9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270079.537489:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262637056:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270079.537515:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270079.537872:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270079.537962:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188224 00000100:00100000:2.0:1788270079.537969:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188224 00010000:00010000:2.0:1788270079.538102:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 13 pid: 48110 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.538139:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788270079.538149:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253188224:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270079.538164:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270079.538170:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 13 pid: 48110 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.538182:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 13 pid: 48110 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.538203:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e095b4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b45 expref: 13 pid: 48110 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.538215:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.538220:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.538228:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.538236:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.538254:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270079.538301:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253188224:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 153us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.538309:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00010000:00010000:1.0:1788270079.541221:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270079.541239:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788270079.541349:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771222 00000001:00080000:1.0:1788270079.541472:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771223 00000001:00080000:1.0:1788270079.541507:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771224 00000100:00100000:1.0:1788270079.541594:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262637184:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788270079.541664:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270079.541714:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2454d9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788270079.541748:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262637184 00000100:00100000:2.0:1788270079.541755:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262637184 00000100:00100000:2.0:1788270079.541812:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788270079.541822:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262637184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788270079.541919:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262637184:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270079.541927:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788270079.542218:0:45778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771093 gen 2 00000004:00080000:3.0:1788270079.542224:0:45778:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27a62e680, transno 30064771090 00000004:00080000:3.0:1788270079.542243:0:45778:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1448f2d80, transno 30064771093 00000100:00100000:3.0:1788270079.542249:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262637184:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788270079.542359:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771225 00000100:00100000:3.0:1788270079.542417:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262637312:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788270079.542446:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270079.542465:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2454d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270079.542479:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262637312 00000100:00100000:3.0:1788270079.542483:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262637312 00000100:00100000:3.0:1788270079.542507:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788270079.542515:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262637312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788270079.542611:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45778:x1875136262637312:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (163us total) trans 30064771095 rc 0/0 00000100:00100000:3.0:1788270079.542618:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788270079.542634:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262637312:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788270079.542739:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771226 00010000:00010000:2.0:1788270079.542763:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542773:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542781:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542787:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270079.542791:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542802:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542817:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.542820:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270079.542824:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542830:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e095fa lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542852:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542858:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542864:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542869:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270079.542946:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542953:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542962:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:2.0:1788270079.542965:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270079.542968:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.542977:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09521 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.543003:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.543017:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 16 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.543025:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.543067:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 16 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.543080:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 16 pid: 46770 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270079.543091:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262637440:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270079.543147:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788270079.544675:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262637440:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270079.544698:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270079.546084:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.546271:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188352 00000100:00100000:3.0:1788270079.546286:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188352 00010000:00010000:3.0:1788270079.546322:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 17 pid: 46770 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270079.546366:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788270079.546377:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253188352:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270079.546392:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270079.546399:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 17 pid: 46770 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.546413:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 17 pid: 46770 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.546454:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e0953d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b22 expref: 17 pid: 46770 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.546469:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:3.0:1788270079.546475:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.546485:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.546493:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.546525:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270079.546585:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270079.546594:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253188352:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 217us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270079.546610:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00010000:00010000:0.0:1788270079.546610:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.546624:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.546631:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.546639:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547063:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270079.547068:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547076:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547088:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:0.0:1788270079.547091:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270079.547094:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547100:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09601 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547113:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547119:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547126:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547132:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270079.547134:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547141:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547147:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f1000) 00010000:00010000:0.0:1788270079.547150:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270079.547153:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270079.547158:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e095f3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270079.547292:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:35334:x1875136253188096:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 13217us (13482us total) trans 30064771227 rc 0/0 00000100:00100000:0.0:1788270079.547302:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 198 00000020:00080000:0.0:1788270079.547306:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1788270079.547441:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270079.547445:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270079.547477:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 6 count 6 00000040:00080000:3.0:1788270079.547484:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270079.549590:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270079.550579:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188608 00000100:00100000:3.0:1788270079.550591:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188608 00000100:00100000:3.0:1788270079.552650:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788270079.552664:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:35334:x1875136253188608:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788270079.552896:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x12:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788270079.552926:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771228 00010000:00010000:3.0:1788270079.552970:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.552987:0:45779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.552999:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.553007:0:45779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.553014:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.553020:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270079.553160:0:45779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788270079.553241:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:35334:x1875136253188608:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 579us (3657us total) trans 30064771229 rc 0/0 00000100:00100000:3.0:1788270079.553250:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000020:00080000:3.0:1788270079.553255:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788270079.553310:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788270079.553317:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.553325:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270079.553330:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.553342:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.553355:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270079.553358:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788270079.553362:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.553378:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e09608 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270079.553391:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270079.553393:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270079.553394:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270080.452313:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270080.708277:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262637568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270080.708428:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270080.708557:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262637568 00000100:00100000:1.0:1788270080.708567:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262637568 00000100:00100000:1.0:1788270080.708644:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788270080.708655:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262637568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270080.708683:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49168064 pending 28672 free 3923496960 avail 3691974656 00000100:00080000:3.0:1788270080.708760:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270080.709172:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262637568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 519us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270080.709180:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788270080.709423:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262637568:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788270081.101033:0:49130:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270081.101081:0:49130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270081.101136:0:49130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 6 count 6 00000040:00080000:2.0:1788270081.101143:0:49130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270081.221691:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270081.222220:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188736 00000100:00100000:3.0:1788270081.222230:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188736 00000100:00100000:3.0:1788270081.222305:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 199 00000100:00100000:3.0:1788270081.222317:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:35352:x1875136253188736:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270081.222341:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270081.222362:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0960f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b61 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788270081.222532:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788270081.223215:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.223232:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.223357:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270081.223401:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270081.223406:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270081.223571:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.223601:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e0960f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b61 expref: 19 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.223621:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b61 expref: 18 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.223630:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270081.223633:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270081.223636:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e800, rc 0) 00000100:00100000:3.0:1788270081.223745:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:35352:x1875136253188736:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1429us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270081.223755:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 199 00000100:00100000:2.0:1788270081.227379:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270081.227459:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188864 00000100:00100000:3.0:1788270081.227470:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188864 00000100:00100000:3.0:1788270081.227527:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:3.0:1788270081.227537:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:35352:x1875136253188864:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788270081.227605:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227622:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227632:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227647:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227654:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227660:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227733:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227741:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227748:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270081.227793:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227806:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227813:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227820:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227827:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270081.227831:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227838:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227849:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270081.227852:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270081.227856:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227862:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0961d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227874:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227880:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227886:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227891:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270081.227894:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227900:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.227924:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f8e00) 00010000:00010000:3.0:1788270081.227927:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270081.228128:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228136:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09624 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228152:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228158:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228164:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228169:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270081.228172:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228178:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228186:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f8900) 00010000:00010000:3.0:1788270081.228188:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270081.228191:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.228196:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0962b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270081.228302:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:35352:x1875136253188864:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 766us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270081.228311:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:3.0:1788270081.230405:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270081.230426:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262637696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270081.230485:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270081.230862:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262637696 00000100:00100000:0.0:1788270081.230871:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262637696 00000100:00100000:0.0:1788270081.230929:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788270081.230938:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262637696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270081.230971:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1299947520 00000100:00100000:0.0:1788270081.231018:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262637696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270081.231025:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788270081.231083:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262637696:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788270081.234117:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771090 is committed 00000001:00080000:1.0:1788270081.234133:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771088 is committed 00000100:00100000:2.0:1788270081.257237:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270081.257306:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253188992 00000100:00100000:3.0:1788270081.257317:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253188992 00000100:00100000:3.0:1788270081.257417:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 201 00000100:00100000:3.0:1788270081.257429:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:35353:x1875136253188992:12345-192.168.201.42@tcp:101:mmap_cat.0 00010000:00010000:3.0:1788270081.257449:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270081.257471:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b68 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257632:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257647:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257659:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257673:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257681:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257688:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257758:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e09647 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257766:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e09647 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257772:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e09647 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270081.257809:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1788270081.257813:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270081.257830:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e09647 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257841:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e09647 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257848:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257854:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257861:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257870:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270081.257874:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257881:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257893:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270081.257896:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270081.257901:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257924:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257935:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257941:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257947:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257951:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270081.257954:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257960:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257971:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff98c1429f8900) 00010000:00010000:3.0:1788270081.257973:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270081.257976:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.257982:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e09640 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.258011:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b68 expref: 20 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.258024:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ee00/0xc5f5d7a016e09647 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b68 expref: 19 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.258031:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f8e00) 00010000:00010000:3.0:1788270081.258033:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270081.258035:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ee00, rc 0) 00000100:00100000:3.0:1788270081.258134:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:35353:x1875136253188992:12345-192.168.201.42@tcp:101:mmap_cat.0 Request processed in 707us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270081.258141:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 201 00000100:00100000:0.0:1788270081.260700:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270081.260769:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253189120 00000100:00100000:1.0:1788270081.260778:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253189120 00000100:00080000:0.0:1788270081.260861:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270081.260895:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788270081.260967:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253189120:12345-192.168.201.42@tcp:101:mmap_cat.0 00010000:00010000:1.0:1788270081.260985:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270081.261009:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e0964e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b6f expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270081.261035:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc4:0x0] initial LVB size: 16, mtime: 0x6a96d5fe, atime: 0x6a96d5fe, ctime: 0x6a96d5fe, blocks: 0x8 00010000:00010000:1.0:1788270081.261190:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=872s v=(0 0) 00010000:00010000:1.0:1788270081.261195:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270081.261204:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e0964e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b6f expref: 7 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270081.261223:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000452b6f7c/0xc5f5d7a016e0964e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b6f expref: 7 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270081.261236:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19bc00, rc 0) 00000100:00100000:1.0:1788270081.261291:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2403:x1875136253189120:12345-192.168.201.42@tcp:101:mmap_cat.0 Request processed in 387us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270081.261298:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788270081.265071:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270081.265449:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253189376 00000100:00100000:3.0:1788270081.265459:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253189376 00000100:00100000:3.0:1788270081.265641:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:3.0:1788270081.265653:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:35353:x1875136253189376:12345-192.168.201.42@tcp:101:mmap_cat.0 00010000:00010000:3.0:1788270081.265672:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270081.265690:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b76 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.265802:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0965c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.265817:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0965c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.265829:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0965c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270081.265842:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:3.0:1788270081.265958:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e09655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b76 expref: 22 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.265974:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f400/0xc5f5d7a016e0965c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b76 expref: 21 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270081.265983:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff98c1429f8e00) 00010000:00010000:3.0:1788270081.265986:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788270081.265990:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f400, rc 0) 00000100:00100000:3.0:1788270081.266067:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:35353:x1875136253189376:12345-192.168.201.42@tcp:101:mmap_cat.0 Request processed in 416us (1002us total) trans 30064771230 rc 0/0 00000100:00100000:3.0:1788270081.266075:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:3.0:1788270081.270658:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270081.270692:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253189504 00000100:00100000:3.0:1788270081.270701:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253189504 00002000:00100000:3.0:1788270081.270749:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc4:0x0] (0->4095) req@ffff98c26bf2b800 x1875136253189504/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:497/0 lens 488/0 e 0 to 0 dl 1788270092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270081.270767:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2b800 with x1875136253189504 ext(0->4095) 00002000:00010000:3.0:1788270081.270772:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2b800 00000100:00100000:3.0:1788270081.270795:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788270081.270804:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253189504:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:3.0:1788270081.270960:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253189504:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 156us (310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788270081.270969:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00002000:00100000:3.0:1788270081.270976:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc4:0x0] (0->4095) req@ffff98c26bf2b800 x1875136253189504/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:497/0 lens 488/4536 e 0 to 0 dl 1788270092 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270081.270984:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2b800 with x1875136253189504 ext(0->4095) 00002000:00010000:3.0:1788270081.270988:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2b800 00010000:00010000:0.0:1788270081.477754:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270082.500180:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270083.268368:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270083.268393:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262637824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270083.268662:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.268916:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262637824 00000100:00100000:0.0:1788270083.268925:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262637824 00000100:00100000:0.0:1788270083.269057:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788270083.269067:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262637824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270083.269100:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:0.0:1788270083.269159:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262637824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.269166:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788270083.269245:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262637824:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270083.524921:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270083.586172:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586285:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586336:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586381:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586404:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586440:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586464:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586488:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586506:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270083.586534:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253189888 00000100:00100000:1.0:1788270083.586544:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253189888 00000100:00100000:1.0:1788270083.586594:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190400 00000100:00100000:1.0:1788270083.586597:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190400 00000100:00100000:1.0:1788270083.586610:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253189760 00000100:00100000:1.0:1788270083.586612:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253189760 00000100:00100000:1.0:1788270083.586625:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190272 00000100:00100000:1.0:1788270083.586627:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190272 00000100:00100000:1.0:1788270083.586642:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:1.0:1788270083.586652:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253189888:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.586720:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253189888:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.586728:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:1.0:1788270083.586745:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:1.0:1788270083.586764:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190400:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.586787:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190400:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.586794:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:1.0:1788270083.586807:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788270083.586814:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2402:x1875136253189760:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.586839:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2402:x1875136253189760:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.586845:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788270083.586855:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788270083.586860:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190272:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.586910:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190272:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 49us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.586917:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788270083.586936:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190144 00000100:00100000:1.0:1788270083.586939:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190144 00000100:00100000:1.0:1788270083.586975:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190656 00000100:00100000:1.0:1788270083.586978:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190656 00000100:00100000:1.0:1788270083.586991:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190016 00000100:00100000:1.0:1788270083.586993:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190016 00000100:00100000:1.0:1788270083.587004:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190528 00000100:00100000:1.0:1788270083.587006:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190528 00000100:00100000:1.0:1788270083.587018:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788270083.587024:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2402:x1875136253190144:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.587070:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2402:x1875136253190144:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 46us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.587077:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788270083.587088:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788270083.587094:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190656:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.587117:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190656:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.587124:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788270083.587137:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788270083.587144:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253190016:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.587168:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253190016:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.587175:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788270083.587190:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788270083.587198:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190528:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270083.587218:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253190528:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.587225:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00080000:1.0:1788270083.587415:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270083.587419:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270083.587422:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270083.587424:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270083.587620:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253189632 00000100:00100000:0.0:1788270083.587625:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253189632 00000100:00100000:0.0:1788270083.587665:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:0.0:1788270083.587674:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253189632:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270083.587709:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253189632:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 38us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.587716:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788270083.781379:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262638208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270083.781532:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262638080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270083.781584:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.781630:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262638592:0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.781652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.781669:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262639104:0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.781699:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.781718:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262639616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.781741:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.781766:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788270083.781773:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262637952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270083.781793:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.781810:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262638464:0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.781830:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.781853:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262638976:0@lo:400:kworker.0 00000100:00100000:2.0:1788270083.781972:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638080 00000100:00100000:2.0:1788270083.781980:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638080 00000100:00100000:2.0:1788270083.782027:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262637952 00000100:00100000:2.0:1788270083.782031:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262637952 00000100:00100000:2.0:1788270083.782066:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788270083.782074:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262638080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270083.782104:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 74804928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:2.0:1788270083.782145:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262638080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270083.782152:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788270083.782169:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788270083.782175:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262637952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270083.782190:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49139392 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270083.782520:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782540:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14391a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262638720:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782576:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262639232:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782613:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262639744:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782635:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782654:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788270083.782660:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262638336:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782697:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782720:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262638848:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782742:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782759:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262639360:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782779:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782796:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262639872:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270083.782834:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270083.782840:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638592 00000100:00100000:3.0:1788270083.782844:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638592 00000100:00100000:0.0:1788270083.782852:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262639488:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.782883:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639104 00000100:00100000:3.0:1788270083.782887:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639104 00000100:00100000:3.0:1788270083.782901:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638720 00000100:00100000:3.0:1788270083.782903:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638720 00000100:00100000:3.0:1788270083.782914:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639232 00000100:00100000:3.0:1788270083.782917:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639232 00000100:00100000:3.0:1788270083.782928:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788270083.782935:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262638592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.782952:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270083.782985:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262637952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 810us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270083.782992:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788270083.783004:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638208 00000100:00100000:2.0:1788270083.783007:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638208 00000100:00100000:2.0:1788270083.783021:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788270083.783026:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262638208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270083.783034:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 74804928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:2.0:1788270083.783079:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262638208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270083.783086:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788270083.783100:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270083.783104:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270083.783116:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788270083.783123:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262639104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.784921:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262638592:12345-0@lo:400:kworker.0 Request processed in 1982us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270083.784932:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788270083.784957:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788270083.784961:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262638080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270083.784966:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262638720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.784977:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771090 gen 2 00000004:00080000:0.0:1788270083.784982:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c389880, transno 30064771087 00000004:00080000:0.0:1788270083.784996:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771089 committed transno 30064771090 00000100:00100000:3.0:1788270083.785009:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262638720:12345-0@lo:400:kworker.0 Request processed in 46us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270083.785014:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788270083.785019:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1448f1500, transno 30064771090 00000100:00100000:0.0:1788270083.785024:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262638592:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.785025:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788270083.785031:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262639232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270083.785071:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262639104:12345-0@lo:400:kworker.0 Request processed in 1948us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270083.785078:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788270083.785125:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14391a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262638720:0@lo:400:kworker.0 00000100:00100000:2.0:1788270083.785138:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262638208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270083.785522:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262639104:0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.785549:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262637952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270083.785588:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639616 00000100:00100000:0.0:1788270083.785593:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639616 00000100:00100000:3.0:1788270083.785596:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262639232:12345-0@lo:400:kworker.0 Request processed in 565us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270083.785602:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788270083.785623:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639744 00000100:00100000:0.0:1788270083.785626:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638848 00000100:00100000:3.0:1788270083.785627:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639744 00000100:00100000:0.0:1788270083.785628:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638848 00000100:00100000:0.0:1788270083.785639:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639360 00000100:00100000:3.0:1788270083.785641:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639872 00000100:00100000:0.0:1788270083.785642:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639360 00000100:00100000:3.0:1788270083.785644:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639872 00000100:00100000:0.0:1788270083.785650:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262639488 00000100:00100000:0.0:1788270083.785653:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262639488 00000100:00100000:3.0:1788270083.785655:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788270083.785660:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262639616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.785665:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788270083.785669:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262638848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.785695:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262639616:12345-0@lo:400:kworker.0 Request processed in 35us (3953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.785695:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262638848:12345-0@lo:400:kworker.0 Request processed in 25us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.785701:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788270083.785751:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262639232:0@lo:400:kworker.0 00000100:00100000:2.0:1788270083.785808:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262638848:0@lo:400:kworker.0 00000100:00080000:2.0:1788270083.785823:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270083.785826:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270083.786016:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638464 00000100:00100000:1.0:1788270083.786021:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638464 00000100:00100000:1.0:1788270083.786064:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638976 00000100:00100000:1.0:1788270083.786067:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638976 00000100:00100000:1.0:1788270083.786080:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788270083.786085:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262638464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270083.786117:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262638464:12345-0@lo:400:kworker.0 Request processed in 32us (4286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.786122:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788270083.786132:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788270083.786137:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262638976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270083.786155:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262638976:12345-0@lo:400:kworker.0 Request processed in 19us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270083.786160:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788270083.786304:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262638464:0@lo:400:kworker.0 00000100:00100000:1.0:1788270083.786316:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262638976:0@lo:400:kworker.0 00010000:00080000:1.0:1788270083.786328:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1428fe300 x1875136262639616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788270083.786339:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262639616:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.787589:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788270083.787597:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788270083.787610:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262639744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.787617:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788270083.787623:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262639360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.787679:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262639744:12345-0@lo:400:kworker.0 Request processed in 74us (5042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.787685:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788270083.787700:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788270083.787707:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262639872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.788417:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262639872:12345-0@lo:400:kworker.0 Request processed in 708us (5599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.788425:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788270083.788440:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788270083.788447:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262639488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270083.788491:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262639488:12345-0@lo:400:kworker.0 Request processed in 44us (5538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270083.788497:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788270083.788534:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262639488:0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.790531:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262639360:12345-0@lo:400:kworker.0 Request processed in 792us (5634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270083.790541:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788270083.790575:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262638336 00000100:00100000:3.0:1788270083.790581:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262638336 00000100:00100000:3.0:1788270083.790618:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788270083.790626:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262638336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270083.790685:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262638336:12345-0@lo:400:kworker.0 Request processed in 60us (7988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270083.790690:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788270083.790787:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262639360:0@lo:400:kworker.0 00010000:00080000:2.0:1788270083.790800:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1428fce00 x1875136262639872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270083.790807:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262639872:0@lo:400:kworker.0 00000100:00100000:2.0:1788270083.790815:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262639744:0@lo:400:kworker.0 00000100:00100000:2.0:1788270083.790831:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262638336:0@lo:400:kworker.0 00000100:00100000:1.0:1788270084.023600:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270084.023660:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190784 00000100:00100000:0.0:1788270084.023668:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190784 00000100:00100000:0.0:1788270084.023718:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 203 00000100:00100000:0.0:1788270084.023727:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:35288:x1875136253190784:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788270084.023834:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:35288:x1875136253190784:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 108us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270084.023840:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 203 00000100:00100000:3.0:1788270084.026768:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270084.026872:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253190912 00000100:00100000:1.0:1788270084.026881:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253190912 00000100:00100000:1.0:1788270084.026931:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:1.0:1788270084.026941:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:35288:x1875136253190912:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788270084.027028:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:35288:x1875136253190912:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270084.027034:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:1.0:1788270084.031821:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270084.031882:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253191168 00000100:00100000:3.0:1788270084.031892:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253191168 00000100:00100000:3.0:1788270084.031941:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:3.0:1788270084.031951:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:35288:x1875136253191168:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270084.032188:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:35288:x1875136253191168:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 238us (375us total) trans 30064771231 rc 0/0 00000100:00100000:3.0:1788270084.032204:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788270084.106269:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270084.106452:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253191296 00000100:00100000:3.0:1788270084.106462:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253191296 00000100:00100000:3.0:1788270084.106513:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 205 00000100:00100000:3.0:1788270084.106522:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:35800:x1875136253191296:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:3.0:1788270084.106540:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270084.106558:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0966a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b7d expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270084.106615:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270084.106627:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270084.106638:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270084.106676:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270084.106680:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270084.106697:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270084.106718:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0966a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 7 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270084.106735:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 6 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270084.106744:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270084.106747:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270084.106750:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f600, rc 0) 00000100:00100000:3.0:1788270084.106811:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:35800:x1875136253191296:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 290us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270084.106818:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 205 00010000:00010000:0.0:1788270084.549212:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788270085.236411:0:49327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_6 skipping ALWAYS excluded test 6 00000001:00080000:2.0:1788270085.318889:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771095 is committed 00000001:00080000:2.0:1788270085.318907:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771094 is committed 00000001:00080000:2.0:1788270085.319654:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771231 is committed 00000020:00080000:2.0:1788270085.319686:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c27260c840 refcount 2 committed 0 result 0 batchid 25769803841 00000020:00080000:2.0:1788270085.319692:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c27260c480 00000020:00080000:2.0:1788270085.319696:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c142804600 00000020:00080000:2.0:1788270085.319728:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803840 batchid updated 00010000:00010000:3.0:1788270085.319875:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270085.319887:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270085.319895:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270085.319900:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270085.319905:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270085.319911:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270085.319930:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270085.319933:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270085.319937:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270085.319943:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e095de lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788270085.320094:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803841 committed batchid 25769803840 00000020:00080000:1.0:1788270085.320149:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803840 00010000:00010000:2.0:1788270085.572165:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270085.829419:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262640000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270085.829504:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270085.829664:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262640000 00000100:00100000:3.0:1788270085.829673:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262640000 00000100:00100000:3.0:1788270085.829739:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788270085.829752:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262640000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270085.829779:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49139392 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270085.829842:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262640000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270085.829850:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788270085.829895:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262640000:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270085.829947:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788270085.989801:0:49376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7a skipping ALWAYS excluded test 7a 00000100:00100000:1.0:1788270086.340514:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262640128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270086.340589:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270086.340633:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262640128 00000100:00100000:3.0:1788270086.340641:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262640128 00000100:00100000:3.0:1788270086.340699:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788270086.340708:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c246769050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262640128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270086.340735:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1299947520 00000100:00100000:3.0:1788270086.340781:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c246769050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262640128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270086.340860:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262640128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270086.344904:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:3.0:1788270086.597178:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788270086.791731:0:49424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7b skipping ALWAYS excluded test 7b 00010000:00010000:0.0:1788270087.620214:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788270087.701293:0:49472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 09:41:27 (1788270087) 00000040:00080000:3.0:1788270088.261007:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788270088.389055:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270088.389081:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262640256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270088.389190:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270088.389421:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262640256 00000100:00100000:1.0:1788270088.389430:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262640256 00000100:00100000:1.0:1788270088.389482:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788270088.389493:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262640256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270088.389525:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270088.389621:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262640256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.389629:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788270088.389700:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262640256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270088.482849:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.482955:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253191552 00000100:00100000:0.0:1788270088.482966:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253191552 00000100:00100000:0.0:1788270088.483082:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:0.0:1788270088.483093:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:36482:x1875136253191552:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270088.483116:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270088.483136:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09678 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b84 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483213:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483227:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483240:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483256:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483263:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483270:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483359:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0968d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483367:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0968d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483378:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0968d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270088.483388:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788270088.483464:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483472:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483477:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483482:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270088.483487:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483493:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483506:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:0.0:1788270088.483509:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270088.483514:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483520:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e0967f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483534:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483540:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483546:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483551:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270088.483554:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483560:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483567:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429f1b00) 00010000:00010000:0.0:1788270088.483569:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270088.483571:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483577:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09686 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483902:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09678 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b84 expref: 13 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483918:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0968d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b84 expref: 12 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.483925:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270088.483927:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270088.483930:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fe00, rc 0) 00000100:00100000:0.0:1788270088.483998:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:36482:x1875136253191552:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 907us (1158us total) trans 30064771232 rc 0/0 00000100:00100000:0.0:1788270088.484010:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00080000:2.0:1788270088.484139:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270088.486885:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270088.487001:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253191680 00000100:00100000:2.0:1788270088.487012:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253191680 00000100:00100000:1.0:1788270088.487094:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270088.487201:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788270088.487212:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2403:x1875136253191680:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270088.487229:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270088.487250:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0968d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b84 expref: 12 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.487269:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270088.487273:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270088.487316:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253191680:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 106us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.487323:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788270088.488646:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253191808 00000100:00100000:3.0:1788270088.488658:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253191808 00000100:00100000:3.0:1788270088.488714:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:3.0:1788270088.488725:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:36482:x1875136253191808:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270088.492608:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:36482:x1875136253191808:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 3873us (5501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.492627:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:1.0:1788270088.498276:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.498319:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253191936 00000100:00100000:3.0:1788270088.498329:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253191936 00000100:00100000:3.0:1788270088.498428:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:3.0:1788270088.498439:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:36482:x1875136253191936:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270088.498552:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:36482:x1875136253191936:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.498560:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00080000:0.0:1788270088.498729:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270088.546589:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270088.546666:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253192192 00000100:00100000:1.0:1788270088.546677:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253192192 00000100:00100000:3.0:1788270088.549667:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 209 00000100:00100000:3.0:1788270088.549696:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:36251:x1875136253192192:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270088.549717:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.549720:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270088.549748:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e09616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b61 expref: 11 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.549769:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270088.549774:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270088.549800:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0969b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b8b expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.549907:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.549918:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 5 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.549928:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.549957:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 5 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.549966:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 5 pid: 45776 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270088.549976:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262640384:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270088.550081:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270088.553505:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.553582:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253192320 00000100:00100000:0.0:1788270088.553592:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253192320 00000100:00100000:3.0:1788270088.553609:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262640384:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270088.553632:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553650:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 6 pid: 45776 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788270088.553673:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270088.553691:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788270088.553701:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253192320:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270088.553714:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270088.553720:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 6 pid: 45776 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553731:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 6 pid: 45776 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553751:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e09671 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b7d expref: 6 pid: 45776 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553775:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270088.553790:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553799:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553806:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.553832:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270088.553894:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253192320:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 194us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.553902:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00010000:00010000:3.0:1788270088.554079:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554085:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554103:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554110:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554115:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270088.554449:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc5:0x0], index 0: 0 00010000:00010000:3.0:1788270088.554571:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554578:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554583:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554606:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554611:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554615:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554619:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270088.554622:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554627:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554633:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270088.554634:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270088.554637:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554644:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e096a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270088.554652:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000426abf53 reply state 00000000e177c951 transno 30064771233 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554659:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554662:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff98c1429f8d00) 00010000:00010000:3.0:1788270088.554664:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270088.554665:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270088.554687:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0969b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 13 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554702:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 12 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.554709:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.554711:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270088.554713:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be800, rc 0) 00000100:00100000:3.0:1788270088.554745:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:36251:x1875136253192192:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5065us (8164us total) trans 30064771233 rc 0/0 00000100:00100000:3.0:1788270088.554752:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 209 00000100:00100000:2.0:1788270088.558122:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.561269:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253192448 00000100:00100000:0.0:1788270088.561283:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253192448 00000100:00100000:0.0:1788270088.561360:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788270088.561375:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:36251:x1875136253192448:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270088.561395:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270088.561419:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b92 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270088.561446:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270088.561468:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=880s v=(0 0) 00010000:00010000:0.0:1788270088.561474:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270088.561484:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 6 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.561503:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 6 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.561515:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fa00, rc 0) 00000100:00100000:0.0:1788270088.561597:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:36251:x1875136253192448:12345-192.168.201.42@tcp:101:bash.0 Request processed in 226us (3483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.561605:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00080000:1.0:1788270088.561894:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270088.563603:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.563856:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253192704 00000100:00100000:0.0:1788270088.563866:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253192704 00000100:00100000:0.0:1788270088.563991:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788270088.563999:0:45780:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788270088.564003:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:36251:x1875136253192704:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:3.0:1788270088.564009:0:45780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788270088.564324:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:36251:x1875136253192704:12345-192.168.201.42@tcp:35:bash.0 Request processed in 323us (725us total) trans 30064771234 rc 0/0 00000100:00100000:0.0:1788270088.564333:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788270088.613979:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270088.614070:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253192832 00000100:00100000:1.0:1788270088.614078:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253192832 00000100:00100000:1.0:1788270088.614128:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:1.0:1788270088.614147:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:36496:x1875136253192832:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270088.614172:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270088.614192:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e096c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101b99 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.614246:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e096cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.614257:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e096cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.614264:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e096cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270088.614300:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270088.614303:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270088.614321:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e096cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.614338:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e096c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b99 expref: 16 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.614351:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e096cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b99 expref: 15 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.614357:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878d00) 00010000:00010000:1.0:1788270088.614359:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270088.614361:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b200, rc 0) 00000100:00100000:1.0:1788270088.614425:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:36496:x1875136253192832:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 279us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.614436:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:2.0:1788270088.617178:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.617227:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193088 00000100:00100000:3.0:1788270088.617237:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193088 00000100:00100000:3.0:1788270088.617305:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 211 00000100:00100000:3.0:1788270088.617313:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:36496:x1875136253193088:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270088.617331:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.617352:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ba0 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.617474:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.617488:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 16 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.617497:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.617531:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 16 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.617540:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 16 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270088.617550:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262640512:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270088.617613:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270088.619317:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.619403:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262640512:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270088.619436:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270088.623004:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193216 00000100:00100000:2.0:1788270088.623019:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193216 00010000:00010000:2.0:1788270088.623090:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 17 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270088.623130:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:2.0:1788270088.623141:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253193216:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270088.623156:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270088.623164:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 17 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.623178:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 17 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.623201:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e096b0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b8b expref: 17 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.623218:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:2.0:1788270088.623224:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.623233:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.623240:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.623276:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270088.623306:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.623315:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270088.623332:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00000100:00100000:2.0:1788270088.623345:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253193216:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 204us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.623354:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00010000:00010000:3.0:1788270088.623467:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba0 expref: 17 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.623484:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba0 expref: 16 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.623490:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.623492:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788270088.623494:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bea00, rc 0) 00000100:00100000:3.0:1788270088.623514:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:36496:x1875136253193088:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 6203us (6348us total) trans 30064771235 rc 0/0 00000100:00100000:3.0:1788270088.623519:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 211 00000100:00100000:2.0:1788270088.626583:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.626630:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193472 00000100:00100000:3.0:1788270088.626640:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193472 00000100:00100000:3.0:1788270088.626727:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:3.0:1788270088.626737:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:36496:x1875136253193472:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270088.626761:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.626764:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270088.626806:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e096da lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba0 expref: 16 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.626830:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.626838:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270088.626851:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e096e8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ba7 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.626951:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e096ef lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.626964:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e096ef lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.626974:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e096ef lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270088.626985:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:3.0:1788270088.627131:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e096e8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba7 expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.627147:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e096ef lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba7 expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.627154:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270088.627156:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788270088.627158:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfc00, rc 0) 00000100:00100000:3.0:1788270088.627212:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:36496:x1875136253193472:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 477us (640us total) trans 30064771236 rc 0/0 00000100:00100000:3.0:1788270088.627219:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:1.0:1788270088.630722:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.630807:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193600 00000100:00100000:3.0:1788270088.630817:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193600 00000100:00100000:3.0:1788270088.630867:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:3.0:1788270088.630875:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:36496:x1875136253193600:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270088.630895:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.630910:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bae expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.630960:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 18 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.630970:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 18 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.630984:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270088.630986:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270088.630989:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be200, rc 0) 00000100:00100000:3.0:1788270088.631079:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:36496:x1875136253193600:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 204us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.631086:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:0.0:1788270088.634267:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270088.634342:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193728 00000100:00100000:1.0:1788270088.634350:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193728 00000100:00100000:1.0:1788270088.634397:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:1.0:1788270088.634407:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253193728:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:1.0:1788270088.634528:0:47283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.634548:0:47283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 6 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.634557:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270088.634562:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270088.634566:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.634599:0:47283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 6 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.634612:0:47283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 6 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270088.634626:0:47283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:47283:1875136262640640:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270088.634700:0:47283:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270088.638824:0:47283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:47283:1875136262640640:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270088.638855:0:47283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270088.639246:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.639321:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193856 00000100:00100000:3.0:1788270088.639330:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193856 00002000:00100000:3.0:1788270088.639376:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc5:0x0] (0->5) req@ffff98c27a62ea00 x1875136253193856/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:504/0 lens 496/0 e 0 to 0 dl 1788270099 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270088.639387:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a62ea00 with x1875136253193856 ext(0->5) 00010000:00010000:3.0:1788270088.639395:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 7 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.639417:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 7 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270088.639425:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27a62ea00 00000100:00100000:3.0:1788270088.639461:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788270088.639472:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253193856:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:3.0:1788270088.640657:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253193856:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 1181us (1408us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1788270088.640665:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00002000:00100000:3.0:1788270088.640673:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc5:0x0] (0->5) req@ffff98c27a62ea00 x1875136253193856/t30064771091(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:504/0 lens 496/448 e 0 to 0 dl 1788270099 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270088.640679:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a62ea00 with x1875136253193856 ext(0->5) 00010000:00010000:3.0:1788270088.640684:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 9 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.640932:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 9 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270088.640942:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27a62ea00 00010000:00010000:2.0:1788270088.644223:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270088.646941:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.647178:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253193984 00000100:00100000:0.0:1788270088.647189:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253193984 00010000:00010000:0.0:1788270088.647230:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 9 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.647277:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:0.0:1788270088.647287:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253193984:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270088.647301:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788270088.647319:0:46531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788270088.647322:0:46531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb mtime from disk: 0 -> 1788270088 00002000:00010000:0.0:1788270088.647324:0:46531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb atime from disk: 0 -> 1788270088 00002000:00010000:0.0:1788270088.647327:0:46531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb ctime from disk: 0 -> 1788270088 00002000:00010000:0.0:1788270088.647329:0:46531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788270088.647335:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 9 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.647350:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 9 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.647374:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1f1de6/0xc5f5d7a016e096be lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b92 expref: 9 pid: 47281 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.647390:0:46531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270088.647395:0:46531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270088.647401:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.647411:0:46531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.647449:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270088.647548:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2402:x1875136253193984:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 261us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.647557:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00010000:00010000:1.0:1788270088.647624:0:47283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647631:0:47283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647647:0:47283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647652:0:47283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647658:0:47283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647662:0:47283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270088.647665:0:47283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647670:0:47283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647681:0:47283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.647685:0:47283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b160ecb/0xc5f5d7a016e09704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270088.647719:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253193728:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 13315us (13461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.647724:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:0.0:1788270088.656257:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.656308:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253194240 00000100:00100000:3.0:1788270088.656317:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253194240 00000100:00100000:3.0:1788270088.656366:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788270088.656374:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:36496:x1875136253194240:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788270088.656435:0:45779:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x13:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e096ef lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba7 expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270088.656607:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771237 00000001:00080000:3.0:1788270088.656628:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771238 00000001:00080000:3.0:1788270088.656915:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771239 00010000:00010000:3.0:1788270088.656950:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.656960:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 22 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.656967:0:45779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.657007:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 22 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.657022:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 22 pid: 45777 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270088.657066:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262640768:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270088.657279:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270088.661400:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262640768:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270088.661401:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:3.0:1788270088.661437:0:45779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.661472:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253194368 00000100:00100000:0.0:1788270088.661480:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253194368 00010000:00010000:0.0:1788270088.661514:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 23 pid: 45777 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.661552:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788270088.661560:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253194368:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270088.661573:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270088.661580:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 23 pid: 45777 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.661593:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 23 pid: 45777 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.661616:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e096fd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bae expref: 23 pid: 45777 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.661630:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270088.661635:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.661644:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.661652:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.661675:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270088.661694:0:45779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.661702:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.661736:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:2401:x1875136253194368:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 176us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.661744:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000001:00080000:3.0:1788270088.661814:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771240 00000001:00080000:3.0:1788270088.661945:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771241 00000100:00100000:3.0:1788270088.662070:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262640896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270088.662102:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270088.662735:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270088.662768:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262640896 00000100:00100000:1.0:1788270088.662773:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262640896 00000100:00100000:1.0:1788270088.662910:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788270088.662916:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262640896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788270088.663017:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262640896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.663021:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788270088.663068:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270088.663101:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262640896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788270088.663218:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771242 00000100:00100000:3.0:1788270088.663259:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262641024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270088.663280:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270088.663322:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788270088.663429:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262641024 00000100:00100000:1.0:1788270088.663433:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262641024 00000100:00100000:1.0:1788270088.663455:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788270088.663459:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262641024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788270088.663539:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262641024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (258us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1788270088.663544:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788270088.663592:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262641024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788270088.663616:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771243 00010000:00010000:3.0:1788270088.663638:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.663645:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.663650:0:45779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.663654:0:45779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270088.663657:0:45779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.663665:0:45779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.663676:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270088.663678:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788270088.663681:0:45779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.663685:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0970b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270088.663743:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788270088.663815:0:45779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].7, 64 off8688 00000004:00080000:3.0:1788270088.663825:0:45779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880370785665ns, next at 881370783483ns, rc = 0 00000001:00080000:3.0:1788270088.663832:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771244 00010000:00010000:3.0:1788270088.663851:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270088.663854:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788270088.663860:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e096ef lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ba7 expref: 26 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270088.663978:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:36496:x1875136253194240:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 7604us (7733us total) trans 30064771245 rc 0/0 00000100:00100000:3.0:1788270088.663984:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000020:00080000:3.0:1788270088.663987:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788270088.665628:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.665688:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253194496 00000100:00100000:3.0:1788270088.665695:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253194496 00000100:00100000:3.0:1788270088.665731:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:3.0:1788270088.665738:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:36496:x1875136253194496:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270088.665758:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.665839:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09712 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bb5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.665891:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09712 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bb5 expref: 26 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.665905:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09712 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bb5 expref: 26 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.665921:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.665923:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270088.665926:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bea00, rc 0) 00000100:00100000:3.0:1788270088.665967:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:36496:x1875136253194496:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 230us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.665972:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:1.0:1788270088.667629:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270088.667697:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253194752 00000100:00100000:2.0:1788270088.667703:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253194752 00000100:00100000:2.0:1788270088.667742:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788270088.667748:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:36496:x1875136253194752:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788270088.668025:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:36496:x1875136253194752:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 276us (402us total) trans 30064771246 rc 0/0 00000100:00100000:2.0:1788270088.668031:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788270088.706265:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270088.706307:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.706332:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253194880 00000100:00100000:2.0:1788270088.706336:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.706342:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253194880 00000100:00100000:2.0:1788270088.706370:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270088.706388:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.706391:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 170 00000100:00100000:0.0:1788270088.706401:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253194880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270088.706435:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253195008 00000100:00100000:2.0:1788270088.706439:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253195008 00000100:00100000:1.0:1788270088.706465:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253195264 00000100:00100000:2.0:1788270088.706470:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253195392 00000100:00100000:1.0:1788270088.706470:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253195264 00000100:00100000:2.0:1788270088.706471:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253195392 00000100:00100000:2.0:1788270088.706488:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788270088.706543:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253195008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270088.706600:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253195008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.706705:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270088.706715:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253195392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270088.706744:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253195392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.706751:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270088.706769:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788270088.706800:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253195264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270088.706824:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253195264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 49us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.706831:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788270088.706985:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253195136 00000100:00100000:3.0:1788270088.706989:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253195136 00000100:00100000:3.0:1788270088.707028:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788270088.707035:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253195136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270088.707066:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253194880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 665us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.707072:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 170 00000100:00100000:3.0:1788270088.707092:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253195136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 58us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.707099:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00080000:0.0:1788270088.707111:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270088.707122:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270088.707124:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270088.707252:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:1.0:1788270088.707493:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.707561:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253195520 00000100:00100000:0.0:1788270088.707566:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253195520 00000100:00100000:0.0:1788270088.707594:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00100000:0.0:1788270088.707602:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:36506:x1875136253195520:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788270088.707667:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707685:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707696:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707707:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707714:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707721:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707814:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707823:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707830:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270088.707877:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707890:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707897:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707904:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707910:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270088.707915:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707923:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707935:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878d00) 00010000:00010000:0.0:1788270088.707938:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270088.707943:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707949:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707963:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707968:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707975:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707980:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270088.707983:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707989:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.707996:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff98c1429f8d00) 00010000:00010000:0.0:1788270088.707999:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270088.708001:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708007:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09720 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708017:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708022:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708028:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708033:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270088.708035:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708502:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708511:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270088.708514:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270088.708517:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.708523:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09727 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.708591:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:36506:x1875136253195520:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 987us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.708598:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00100000:3.0:1788270088.742610:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270088.742676:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253195776 00000100:00100000:1.0:1788270088.742689:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253195776 00000100:00100000:1.0:1788270088.742753:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:1.0:1788270088.742763:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:36513:x1875136253195776:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788270088.742792:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270088.742813:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0972e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bbc expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.742903:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.742917:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.742928:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.742940:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.742945:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.742949:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743072:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743082:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743089:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270088.743098:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:1.0:1788270088.743170:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743189:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743197:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743203:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270088.743208:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743220:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743231:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878d00) 00010000:00010000:1.0:1788270088.743234:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270088.743237:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743241:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743250:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743254:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743258:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743260:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270088.743262:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743272:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743279:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff98c1429f8d00) 00010000:00010000:1.0:1788270088.743281:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270088.743284:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743293:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0973c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743343:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0972e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743352:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.743358:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:1.0:1788270088.743359:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270088.743361:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ba00, rc 0) 00000100:00100000:1.0:1788270088.743413:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:36513:x1875136253195776:12345-192.168.201.42@tcp:101:cat.0 Request processed in 651us (813us total) trans 30064771247 rc 0/0 00000100:00100000:1.0:1788270088.743441:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:2.0:1788270088.746270:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.749025:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253196032 00000100:00100000:3.0:1788270088.749066:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253196032 00000100:00100000:3.0:1788270088.749142:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:3.0:1788270088.749155:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:36513:x1875136253196032:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:3.0:1788270088.749400:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:36513:x1875136253196032:12345-192.168.201.42@tcp:35:cat.0 Request processed in 246us (3137us total) trans 30064771248 rc 0/0 00000100:00100000:3.0:1788270088.749409:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000040:00080000:3.0:1788270088.774975:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270088.774984:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270088.775005:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 6 count 6 00000040:00080000:3.0:1788270088.775013:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270088.820123:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.821791:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253196288 00000100:00100000:3.0:1788270088.821805:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253196288 00000100:00100000:3.0:1788270088.821877:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:3.0:1788270088.821885:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:36525:x1875136253196288:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270088.821905:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.821908:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270088.821930:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e096cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101b99 expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.821944:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c143878d00) 00010000:00010000:3.0:1788270088.821952:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270088.821963:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09751 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bc3 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.822092:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.822106:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.822120:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.822152:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.822161:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 30 pid: 45778 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270088.822172:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262641152:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270088.822253:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270088.824026:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262641152:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270088.824088:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270088.824356:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.824488:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253196416 00000100:00100000:3.0:1788270088.824493:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253196416 00010000:00010000:3.0:1788270088.824519:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 31 pid: 45778 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270088.824574:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788270088.824581:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:2401:x1875136253196416:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270088.824590:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270088.824595:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 31 pid: 45778 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.824607:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 31 pid: 45778 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.824622:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09743 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bbc expref: 31 pid: 45778 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.824633:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.824636:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.824642:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.824647:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.824664:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270088.824703:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:2401:x1875136253196416:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.824710:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00010000:00010000:0.0:1788270088.824833:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.824843:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270088.824859:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1788270088.824987:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09751 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 31 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.825009:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 30 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.825018:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270088.825021:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788270088.825024:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfc00, rc 0) 00000100:00100000:0.0:1788270088.825083:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:36525:x1875136253196288:12345-192.168.201.42@tcp:101:bash.0 Request processed in 3198us (4970us total) trans 30064771249 rc 0/0 00000100:00100000:0.0:1788270088.825091:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:2.0:1788270088.829176:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.829227:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253196544 00000100:00100000:0.0:1788270088.829237:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253196544 00000100:00100000:0.0:1788270088.829295:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:0.0:1788270088.829305:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:36525:x1875136253196544:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270088.829327:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270088.829345:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09766 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bca expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.829378:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.829392:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.829402:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.829512:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09766 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.829530:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 31 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.829539:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270088.829541:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270088.829545:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f600, rc 0) 00000100:00100000:0.0:1788270088.829597:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:36525:x1875136253196544:12345-192.168.201.42@tcp:101:bash.0 Request processed in 293us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.829605:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:2.0:1788270088.831001:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270088.831140:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253196800 00000100:00100000:1.0:1788270088.831148:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253196800 00000100:00100000:1.0:1788270088.831188:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:1.0:1788270088.831197:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:36525:x1875136253196800:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:1.0:1788270088.831379:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.831393:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.831403:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788270088.831449:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771250 00000004:00010000:1.0:1788270088.831470:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bda15802 reply state 000000008653069d transno 30064771251 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.831483:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270088.831491:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:1.0:1788270088.831493:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270088.831497:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270088.831565:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36525:x1875136253196800:12345-192.168.201.42@tcp:36:bash.0 Request processed in 369us (569us total) trans 30064771251 rc 0/0 00000100:00100000:1.0:1788270088.831573:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 219 00000020:00080000:1.0:1788270088.831577:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270088.834299:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.834508:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253196928 00000100:00100000:0.0:1788270088.834518:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253196928 00000100:00100000:0.0:1788270088.834582:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:0.0:1788270088.834594:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36525:x1875136253196928:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270088.834618:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270088.834639:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e0977b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bd1 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.834743:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.834758:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 35 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.834768:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.834817:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 35 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.834829:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 35 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.834843:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262641280:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270088.834928:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788270088.836899:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262641280:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270088.836927:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270088.837173:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270088.837796:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253197056 00000100:00100000:0.0:1788270088.837804:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253197056 00010000:00010000:0.0:1788270088.837838:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 36 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270088.837879:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:0.0:1788270088.837889:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:2401:x1875136253197056:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270088.837903:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270088.837909:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 36 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.837922:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 36 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.837942:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09758 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bc3 expref: 36 pid: 46770 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.837957:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270088.837962:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.837971:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.837980:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270088.838012:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270088.838097:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:2401:x1875136253197056:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 209us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.838105:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00010000:00010000:3.0:1788270088.838421:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.838430:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270088.838482:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:3.0:1788270088.838487:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270088.838507:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.838538:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e0977b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd1 expref: 35 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.838554:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd1 expref: 34 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.838562:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.838565:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270088.838569:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fc00, rc 0) 00000100:00100000:3.0:1788270088.838651:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36525:x1875136253196928:12345-192.168.201.42@tcp:101:bash.0 Request processed in 4060us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.838658:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:1.0:1788270088.847704:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270088.847765:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253197312 00000100:00100000:2.0:1788270088.847838:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253197312 00000100:00100000:2.0:1788270088.847947:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788270088.847963:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36525:x1875136253197312:12345-192.168.201.42@tcp:103:bash.0 00010000:00010000:2.0:1788270088.847980:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270088.848003:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09782 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd1 expref: 34 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.848020:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09712 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bb5 expref: 33 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270088.848028:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:2.0:1788270088.848031:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270088.848105:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:36525:x1875136253197312:12345-192.168.201.42@tcp:103:bash.0 Request processed in 149us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.848112:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788270088.850566:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.850789:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253197440 00000100:00100000:3.0:1788270088.850799:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253197440 00000100:00100000:3.0:1788270088.850858:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 221 00000100:00100000:3.0:1788270088.850869:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:36525:x1875136253197440:12345-192.168.201.42@tcp:58:bash.0 00010000:00010000:3.0:1788270088.850983:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.851001:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.851012:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270088.851495:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].6, 136 off9008 00000100:00100000:0.0:1788270088.851622:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:36525:x1875136253197440:12345-192.168.201.42@tcp:58:bash.0 Request processed in 753us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270088.851632:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 221 00000100:00100000:1.0:1788270088.853285:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270088.853353:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253197568 00000100:00100000:3.0:1788270088.853360:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253197568 00000100:00100000:3.0:1788270088.853396:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 222 00000100:00100000:3.0:1788270088.853406:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:36525:x1875136253197568:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270088.853422:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270088.853441:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bd8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.853484:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.853492:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 33 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.853505:0:45776:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.853513:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 33 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.853523:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270088.853525:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270088.853527:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 33 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270088.853532:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfe00, rc 0) 00000100:00100000:3.0:1788270088.853599:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:36525:x1875136253197568:12345-192.168.201.42@tcp:101:bash.0 Request processed in 194us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.853603:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 222 00000100:00100000:0.0:1788270088.900242:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270088.900264:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262641408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270088.900324:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270088.900446:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262641408 00000100:00100000:1.0:1788270088.900455:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262641408 00000100:00100000:1.0:1788270088.900516:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788270088.900526:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262641408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270088.900552:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 74804928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1788270088.900598:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262641408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.900604:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788270088.900792:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262641536:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.900827:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.900850:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262642048:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.900876:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.900893:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262642560:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.900914:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.900933:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788270088.900939:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262641664:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.900945:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262641536 00000100:00100000:3.0:1788270088.900951:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262641536 00000100:00100000:2.0:1788270088.900961:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.900977:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262642176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.900989:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788270088.900996:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270088.901001:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262641536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901012:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262642688:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901061:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270088.901077:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262641536:12345-0@lo:400:kworker.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.901085:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788270088.901093:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262641536:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901122:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642560 00000100:00100000:3.0:1788270088.901127:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642560 00000100:00100000:2.0:1788270088.901128:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642048 00000100:00100000:2.0:1788270088.901133:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642048 00000100:00100000:3.0:1788270088.901169:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642176 00000100:00100000:2.0:1788270088.901169:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262641664 00000100:00100000:2.0:1788270088.901172:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262641664 00000100:00100000:3.0:1788270088.901175:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642176 00000100:00100000:2.0:1788270088.901195:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788270088.901204:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642688 00000100:00100000:2.0:1788270088.901205:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262642048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901208:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642688 00000100:00100000:3.0:1788270088.901231:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788270088.901241:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262642560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901247:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262642048:12345-0@lo:400:kworker.0 Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.901254:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788270088.901268:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788270088.901276:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262641664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901282:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262642560:12345-0@lo:400:kworker.0 Request processed in 43us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.901290:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788270088.901309:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262641664:12345-0@lo:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.901310:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788270088.901320:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788270088.901322:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262642176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901345:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262641920:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901367:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.901381:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262642432:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901397:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.901407:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788270088.901413:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262641792:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901438:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262642176:12345-0@lo:400:kworker.0 Request processed in 117us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.901445:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270088.901451:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788270088.901459:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262642304:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901467:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642432 00000100:00100000:3.0:1788270088.901472:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642432 00000100:00100000:2.0:1788270088.901479:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270088.901491:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262642816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270088.901492:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262641792 00000100:00100000:3.0:1788270088.901498:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262641792 00000100:00100000:3.0:1788270088.901515:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642304 00000100:00100000:2.0:1788270088.901519:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270088.901520:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642304 00000100:00100000:3.0:1788270088.901545:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788270088.901547:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642816 00000100:00100000:2.0:1788270088.901551:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642816 00000100:00100000:3.0:1788270088.901553:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262642688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901576:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788270088.901585:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262642816:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270088.901593:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262642688:12345-0@lo:400:kworker.0 Request processed in 40us (530us total) trans 0 rc 0/0 00002000:00000024:2.0:1788270088.901597:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57577152 pending 28672 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270088.901602:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788270088.901617:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788270088.901625:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262642432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901635:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262642816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.901642:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788270088.901660:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262642432:12345-0@lo:400:kworker.0 Request processed in 35us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270088.901667:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788270088.901672:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771095 gen 2 00000004:00080000:2.0:1788270088.901678:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771095 committed transno 30064771095 00000100:00100000:3.0:1788270088.901682:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788270088.901690:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262641792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901697:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262641664:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901709:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262642176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901724:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262641792:12345-0@lo:400:kworker.0 Request processed in 34us (280us total) trans 0 rc 0/0 00010000:00080000:2.0:1788270088.901725:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c26b603b80 x1875136262642688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270088.901739:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788270088.901745:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262642688:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901757:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788270088.901760:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262642048:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901767:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262642304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901784:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901813:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262642304:12345-0@lo:400:kworker.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.901815:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262641920 00000100:00100000:2.0:1788270088.901820:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262641920 00000100:00100000:3.0:1788270088.901824:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788270088.901849:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788270088.901856:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262641920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901877:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262641792:0@lo:400:kworker.0 00000100:00100000:3.0:1788270088.901894:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262642304:0@lo:400:kworker.0 00000100:00100000:2.0:1788270088.901894:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262641920:12345-0@lo:400:kworker.0 Request processed in 37us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270088.901907:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788270088.901921:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262642816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270088.901935:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262641920:0@lo:400:kworker.0 00000100:00080000:0.0:1788270088.902169:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270088.902174:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270088.902176:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270088.902178:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270088.902202:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262641408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270088.902213:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270088.902218:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262642944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270088.902240:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270088.902311:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262642944 00000100:00100000:1.0:1788270088.902315:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262642944 00000100:00100000:1.0:1788270088.902342:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788270088.902348:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262642944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270088.902357:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 74804928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1788270088.902396:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262642944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270088.902411:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788270088.902505:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262642944:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788270088.902560:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c26b601c00 x1875136262642432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270088.902571:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262642432:0@lo:400:kworker.0 00000040:00080000:3.0:1788270089.284848:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788270089.668960:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270089.797009:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270089.797019:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270089.797074:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 7 count 7 00000040:00080000:2.0:1788270089.797084:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270089.797225:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262643072:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788270089.797317:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788270089.803214:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.803242:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262643072:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788270089.803333:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253197696 00000100:00100000:3.0:1788270089.803341:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253197696 00000100:00100000:3.0:1788270089.803406:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 223 00000100:00100000:3.0:1788270089.803416:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:36526:x1875136253197696:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270089.803443:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270089.803517:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:36526:x1875136253197696:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.803522:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 223 00000100:00100000:1.0:1788270089.805966:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.806540:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253197824 00000100:00100000:2.0:1788270089.806549:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253197824 00000100:00100000:2.0:1788270089.806600:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:2.0:1788270089.806610:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:36526:x1875136253197824:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270089.806678:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806701:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806712:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806728:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806740:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806744:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806796:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806806:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806813:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270089.806853:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:2.0:1788270089.806858:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270089.806875:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806887:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806894:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806901:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806906:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270089.806909:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806915:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806925:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270089.806926:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270089.806929:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806933:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09797 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806942:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806946:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806950:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806952:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270089.806954:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806957:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806960:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb4468db5 (ffff98c1429fa800) 00010000:00010000:2.0:1788270089.806962:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270089.806963:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806969:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e0979e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806978:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806981:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806985:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806988:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270089.806989:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806992:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.806995:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:2.0:1788270089.806997:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270089.806998:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.807001:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e097a5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.807132:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:36526:x1875136253197824:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 524us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.807137:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:2.0:1788270089.809933:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.809982:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253198080 00000100:00100000:0.0:1788270089.809990:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253198080 00000100:00100000:0.0:1788270089.810035:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:0.0:1788270089.810058:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:36526:x1875136253198080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270089.810077:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270089.810096:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e097ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bdf expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810189:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810203:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810216:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270089.810226:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00010000:00010000:0.0:1788270089.810295:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810300:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810305:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810308:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270089.810311:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810315:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810323:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270089.810325:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270089.810328:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810332:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097b3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810359:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e097ac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bdf expref: 35 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810365:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270089.810366:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270089.810369:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e097ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bdf expref: 35 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.810374:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ec00, rc 0) 00000100:00100000:0.0:1788270089.810420:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36526:x1875136253198080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 365us (493us total) trans 30064771252 rc 301/301 00000100:00100000:0.0:1788270089.810425:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:3.0:1788270089.813955:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.814145:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253198208 00000100:00100000:0.0:1788270089.814155:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253198208 00000100:00100000:0.0:1788270089.814200:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:0.0:1788270089.814209:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36526:x1875136253198208:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788270089.814466:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788270089.814558:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36526:x1875136253198208:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 350us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.814564:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:1.0:1788270089.815741:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.815840:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253198336 00000100:00100000:2.0:1788270089.815847:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253198336 00000100:00100000:2.0:1788270089.815930:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 227 00000100:00100000:2.0:1788270089.815940:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:36526:x1875136253198336:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270089.815954:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270089.815975:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101be6 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.816031:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e097c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.816073:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e097c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.816086:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e097c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270089.816121:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270089.816125:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270089.816148:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e097c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.816172:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101be6 expref: 36 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.816189:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e097c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101be6 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.816198:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:2.0:1788270089.816202:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270089.816206:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbe00, rc 0) 00000100:00100000:2.0:1788270089.816260:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:36526:x1875136253198336:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 322us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.816268:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 227 00000100:00100000:2.0:1788270089.817726:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.817824:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253198592 00000100:00100000:3.0:1788270089.817832:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253198592 00000100:00100000:3.0:1788270089.817874:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:3.0:1788270089.817883:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:36526:x1875136253198592:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270089.817897:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270089.817900:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270089.817921:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e097c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101be6 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.817938:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:3.0:1788270089.817946:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270089.817958:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e097cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bed expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270089.818335:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc5:0x0], index 1: 0 00010000:00010000:3.0:1788270089.818464:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e097d6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.818480:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e097d6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.818489:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e097d6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.818538:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e097cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bed expref: 37 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.818555:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e097d6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bed expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.818563:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8300) 00010000:00010000:3.0:1788270089.818565:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270089.818568:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be000, rc 0) 00000100:00100000:3.0:1788270089.818616:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:36526:x1875136253198592:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 734us (892us total) trans 30064771253 rc 0/0 00000100:00100000:3.0:1788270089.818624:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:3.0:1788270089.821633:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.821936:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253198720 00000100:00100000:0.0:1788270089.821945:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253198720 00000100:00100000:0.0:1788270089.822016:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 229 00000100:00100000:0.0:1788270089.822026:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:36526:x1875136253198720:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270089.822088:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270089.822112:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e097e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bf4 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.822174:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.822187:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.822198:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270089.822235:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270089.822239:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270089.822259:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.822283:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e097e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bf4 expref: 38 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.822299:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bf4 expref: 37 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.822309:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1700) 00010000:00010000:0.0:1788270089.822311:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270089.822314:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e400, rc 0) 00000100:00100000:0.0:1788270089.822387:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:36526:x1875136253198720:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 361us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.822394:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 229 00000100:00100000:1.0:1788270089.828300:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.830873:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253198976 00000100:00100000:2.0:1788270089.830888:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253198976 00000100:00100000:2.0:1788270089.830959:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:2.0:1788270089.830970:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:36526:x1875136253198976:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270089.831023:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270089.831065:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e097d6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bed expref: 37 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831086:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8300) 00010000:00010000:2.0:1788270089.831103:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e097eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bf4 expref: 36 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831112:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1700) 00010000:00010000:2.0:1788270089.831117:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270089.831140:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831153:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831161:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831177:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831184:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831189:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831249:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831257:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831264:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831270:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270089.831274:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831282:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831290:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fad00) 00010000:00010000:2.0:1788270089.831292:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270089.831296:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831302:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e097f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831315:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831321:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831326:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831331:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270089.831334:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831340:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831347:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xadfb9529 (ffff98c1429fa900) 00010000:00010000:2.0:1788270089.831350:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270089.831352:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.831358:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e097f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xadfb9529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.831441:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:36526:x1875136253198976:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 472us (3155us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270089.831449:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:2.0:1788270089.837063:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.837189:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253199104 00000100:00100000:3.0:1788270089.837198:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253199104 00000100:00100000:3.0:1788270089.837254:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 231 00000100:00100000:3.0:1788270089.837265:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:36526:x1875136253199104:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270089.837284:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270089.837305:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09800 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101bfb expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.837356:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be600/0xc5f5d7a016e09807 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.837369:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be600/0xc5f5d7a016e09807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.837379:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be600/0xc5f5d7a016e09807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.837482:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09800 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bfb expref: 37 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.837498:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be600/0xc5f5d7a016e09807 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bfb expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.837506:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:3.0:1788270089.837509:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788270089.837513:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be600, rc 0) 00000100:00100000:3.0:1788270089.837615:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:36526:x1875136253199104:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 351us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.837623:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 231 00000100:00100000:1.0:1788270089.843030:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.843124:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253199360 00000100:00100000:0.0:1788270089.843133:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253199360 00000100:00100000:0.0:1788270089.843182:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 232 00000100:00100000:0.0:1788270089.843194:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:36526:x1875136253199360:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270089.843285:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.843303:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.843315:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270089.843476:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].7, 88 off8736 00000004:00080000:0.0:1788270089.843487:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 881550446791ns, next at 882550444405ns, rc = 0 00000004:00010000:0.0:1788270089.843534:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041e20991 reply state 000000005e0fc8dd transno 30064771254 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.843548:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.843555:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:0.0:1788270089.843558:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788270089.843561:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270089.843653:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:36526:x1875136253199360:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 461us (628us total) trans 30064771254 rc 0/0 00000100:00100000:0.0:1788270089.843660:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 232 00000100:00100000:1.0:1788270089.846001:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.846127:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253199488 00000100:00100000:2.0:1788270089.846136:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253199488 00000100:00100000:2.0:1788270089.846242:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 233 00000100:00100000:2.0:1788270089.846252:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:36526:x1875136253199488:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270089.846275:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270089.846294:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c02 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.846453:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 39 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.846468:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 39 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.846487:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:2.0:1788270089.846491:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270089.846495:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbc00, rc 0) 00000100:00100000:2.0:1788270089.846548:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:36526:x1875136253199488:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 297us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.846555:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 233 00000100:00100000:2.0:1788270089.853729:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.853806:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253199616 00000100:00100000:0.0:1788270089.853816:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253199616 00000100:00100000:0.0:1788270089.853934:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:0.0:1788270089.853945:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2401:x1875136253199616:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788270089.854217:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253199616:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 273us (494us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1788270089.854225:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788270089.856679:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.857314:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253199872 00000100:00100000:2.0:1788270089.857324:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253199872 00000100:00100000:2.0:1788270089.857374:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788270089.857381:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:36526:x1875136253199872:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270089.857577:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:36526:x1875136253199872:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 196us (974us total) trans 30064771255 rc 0/0 00000100:00100000:2.0:1788270089.857582:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:1.0:1788270089.860336:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.860476:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253200128 00000100:00100000:3.0:1788270089.860484:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253200128 00000100:00100000:3.0:1788270089.860582:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:3.0:1788270089.860590:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:36526:x1875136253200128:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788270089.860674:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:36526:x1875136253200128:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 86us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.860682:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:1.0:1788270089.862019:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.862245:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253200256 00000100:00100000:0.0:1788270089.862252:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253200256 00000100:00100000:0.0:1788270089.862303:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:0.0:1788270089.862312:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:36526:x1875136253200256:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270089.862327:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270089.862347:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0981c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c09 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.862409:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09823 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.862424:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09823 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.862435:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09823 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270089.862477:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270089.862496:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09823 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.862521:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e0981c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c09 expref: 42 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.862537:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09823 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c09 expref: 41 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.862546:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:0.0:1788270089.862549:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788270089.862553:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ea00, rc 0) 00000100:00100000:0.0:1788270089.862613:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:36526:x1875136253200256:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 302us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.862622:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:2.0:1788270089.865866:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.865964:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253200384 00000100:00100000:3.0:1788270089.865974:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253200384 00000100:00100000:3.0:1788270089.866102:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:3.0:1788270089.866114:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253200384:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270089.866132:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270089.866152:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c10 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270089.866178:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d60a, blocks: 0x0 00010000:00010000:3.0:1788270089.866215:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=881s v=(0 0) 00010000:00010000:3.0:1788270089.866220:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270089.866230:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 8 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.866247:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 8 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.866260:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be400, rc 0) 00000100:00100000:3.0:1788270089.866318:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253200384:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 206us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.866325:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788270089.871365:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.871451:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253200640 00000100:00100000:2.0:1788270089.871461:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253200640 00000100:00100000:2.0:1788270089.871518:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:2.0:1788270089.871528:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:36526:x1875136253200640:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270089.871639:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:36526:x1875136253200640:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.871646:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:1.0:1788270089.876907:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.877017:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253200768 00000100:00100000:3.0:1788270089.877027:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253200768 00000100:00100000:3.0:1788270089.877109:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 237 00000100:00100000:3.0:1788270089.877121:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:36526:x1875136253200768:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788270089.878978:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771255 is committed 00000004:00080000:2.0:1788270089.878994:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:3.0:1788270089.879069:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879082:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879090:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879097:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9ea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.879102:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879110:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879127:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff98c1429f8d00) 00010000:00010000:3.0:1788270089.879130:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270089.879134:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879141:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e096a9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879163:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879169:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879175:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879181:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.879185:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879191:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879198:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270089.879210:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270089.879213:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879219:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09774 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879229:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879236:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879243:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879248:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.879250:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879256:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879268:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:3.0:1788270089.879270:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788270089.879273:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.879279:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0980e lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270089.880060:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270089.880079:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262643200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788270089.880144:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270089.880225:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262643200 00000100:00100000:3.0:1788270089.880232:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262643200 00000100:00100000:3.0:1788270089.880278:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788270089.880288:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262643200:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1788270089.880305:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1788270089.880405:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00010000:3.0:1788270089.880411:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1788270089.880414:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262643328:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1788270089.880417:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788270089.880421:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270089.880424:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb ctime from disk: 1788270090 -> 1788270090 00002000:00010000:3.0:1788270089.880427:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788270089.880442:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788270089.880497:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c1440a6cc0 refcount 2 committed 0 result 0 batchid 25769803842 00000020:00080000:2.0:1788270089.880501:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c1440a63c0 00000020:00080000:2.0:1788270089.880504:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c26bedb000 00000100:00100000:0.0:1788270089.880510:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262643328 00000100:00100000:0.0:1788270089.880516:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262643328 00000020:00080000:2.0:1788270089.880521:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803841 batchid updated 00000100:00100000:0.0:1788270089.880551:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788270089.880559:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262643328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788270089.880575:0:47281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:197 count 1 00000020:00080000:1.0:1788270089.880588:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803842 committed batchid 25769803841 00002000:00010000:0.0:1788270089.880601:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc5:0x0] initial LVB size: 6, mtime: 0x6a96d608, atime: 0x6a96d608, ctime: 0x6a96d608, blocks: 0x8 00010000:00010000:0.0:1788270089.880611:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788270089.880622:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803841 00010000:00010000:0.0:1788270089.880626:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=881s v=(0 0) 00010000:00010000:0.0:1788270089.880633:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270089.880641:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.880660:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.880670:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.880679:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.880706:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270089.880721:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270089.880728:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.880735:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270089.880739:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.880745:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.880770:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.880820:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262643200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 533us (676us total) trans 30064771097 rc 0/0 00000100:00100000:3.0:1788270089.880828:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788270089.880834:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262643328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 273us (389us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1788270089.880842:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:0.0:1788270089.880885:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1448f2d80/2, rc 0, transno 30064771093 00000004:00080000:2.0:1788270089.880892:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1448f0700/2, rc 0, transno 30064771097 00000100:00100000:0.0:1788270089.880893:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262643328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788270089.880900:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262643200:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788270089.880928:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753840cb/0xc5f5d7a016e09831 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.880943:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270089.880944:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270089.880946:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270089.881010:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:36526:x1875136253200768:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 3890us (4111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.881020:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 237 00000100:00100000:3.0:1788270089.882598:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.882668:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253200896 00000100:00100000:2.0:1788270089.882673:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253200896 00000100:00100000:2.0:1788270089.882707:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:2.0:1788270089.882715:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253200896:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788270089.882845:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253200896:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 132us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.882851:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:1.0:1788270089.886166:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.887244:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253201152 00000100:00100000:2.0:1788270089.887254:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253201152 00000100:00100000:2.0:1788270089.887307:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:2.0:1788270089.887319:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:36526:x1875136253201152:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270089.887372:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270089.887399:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09823 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c09 expref: 14 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.887417:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:2.0:1788270089.887421:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270089.887445:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.887455:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.887461:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270089.887552:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f26f2340 reply state 000000002affc9f0 transno 30064771256 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.887560:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.887564:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:2.0:1788270089.887566:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270089.887567:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270089.887643:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:36526:x1875136253201152:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 326us (1485us total) trans 30064771256 rc 0/0 00000100:00100000:2.0:1788270089.887650:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:1.0:1788270089.888878:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.889005:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253201280 00000100:00100000:0.0:1788270089.889012:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253201280 00000100:00100000:0.0:1788270089.889085:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:0.0:1788270089.889106:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:36526:x1875136253201280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270089.889121:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270089.889136:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c17 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.889164:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.889172:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270089.889176:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270089.889182:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 9 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.889215:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.889229:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 981 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270089.889244:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262643456:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270089.889310:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270089.890571:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262643456:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270089.890604:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 9 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.890620:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f000, rc 0) 00000100:00100000:0.0:1788270089.890679:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:36526:x1875136253201280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1585us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.890688:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788270089.890766:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.890852:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253201408 00000100:00100000:3.0:1788270089.890858:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253201408 00010000:00010000:3.0:1788270089.890920:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 981 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.890957:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788270089.890966:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253201408:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270089.890978:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270089.890997:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 981 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.891010:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 981 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.891029:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057b10b2d/0xc5f5d7a016e0982a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c10 expref: 9 pid: 47284 timeout: 981 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.891069:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270089.891074:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270089.891081:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 8 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.891091:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 8 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.891121:0:48804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 8 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.891134:0:48804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262643584:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270089.891189:0:48804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788270089.895288:0:48804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262643584:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270089.895314:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270089.895361:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.895374:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253201408:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 4406us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.895386:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788270089.895391:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253201536 00000100:00100000:3.0:1788270089.895398:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253201536 00000100:00100000:3.0:1788270089.895480:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:3.0:1788270089.895487:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253201536:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788270089.895969:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788270089.895973:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb mtime from disk: 0 -> 1788270089 00002000:00010000:3.0:1788270089.895975:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb atime from disk: 0 -> 1788270088 00002000:00010000:3.0:1788270089.895977:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb ctime from disk: 1788270090 -> 1788270089 00002000:00010000:3.0:1788270089.895980:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788270089.896059:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253201536:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 571us (700us total) trans 30064771098 rc 0/0 00000100:00100000:3.0:1788270089.896064:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:1.0:1788270089.898075:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.898112:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253201664 00000100:00100000:2.0:1788270089.898121:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253201664 00000100:00100000:2.0:1788270089.898168:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:2.0:1788270089.898178:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2403:x1875136253201664:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788270089.898222:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.898242:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 9 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.898251:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270089.898255:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270089.898260:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.898314:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 9 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.898341:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 9 pid: 47281 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.898361:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262643712:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270089.898427:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27260c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270089.900170:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262643712:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270089.900196:0:47284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270089.900379:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.900422:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253201792 00000100:00100000:2.0:1788270089.900428:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253201792 00010000:00010000:2.0:1788270089.900456:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 10 pid: 47281 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.900491:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788270089.900501:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253201792:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270089.900516:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270089.900536:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 10 pid: 47281 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.900549:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 10 pid: 47281 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.900571:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7196520/0xc5f5d7a016e0983f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c17 expref: 10 pid: 47281 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.900590:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270089.900594:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270089.900599:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.900609:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.900650:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270089.900692:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253201792:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 192us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.900699:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00010000:00010000:3.0:1788270089.900862:0:47284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.900918:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.900941:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.900950:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.900967:0:47284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.900976:0:47284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270089.900981:0:47284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.900991:0:47284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.901002:0:47284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.901009:0:47284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09846 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.901442:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2403:x1875136253201664:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 3264us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.901452:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:1.0:1788270089.902703:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.902747:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202048 00000100:00100000:2.0:1788270089.902767:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202048 00000100:00100000:2.0:1788270089.902813:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00100000:2.0:1788270089.902884:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:36526:x1875136253202048:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788270089.903502:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.903515:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 15 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.903522:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.903548:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 15 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.903557:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 15 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270089.903571:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262643840:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270089.903647:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270089.906035:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262643840:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270089.906089:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270089.906560:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.906614:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202176 00000100:00100000:2.0:1788270089.906623:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202176 00010000:00010000:2.0:1788270089.906657:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.906817:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788270089.906828:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253202176:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270089.906843:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270089.906851:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906865:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906886:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e0976d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bca expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906899:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:2.0:1788270089.906906:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 15 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906915:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906922:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906928:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.906952:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270089.906986:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.906996:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253202176:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 170us (437us total) trans 0 rc 0/0 00010000:00010000:1.0:1788270089.906997:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.907006:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00010000:00010000:1.0:1788270089.907199:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.907212:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 15 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.907220:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.907252:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 15 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.907266:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 15 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270089.907279:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262643968:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270089.907328:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270089.908550:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262643968:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270089.908569:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.910239:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.910374:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202304 00000100:00100000:2.0:1788270089.910383:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202304 00010000:00010000:2.0:1788270089.910417:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.910452:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:2.0:1788270089.910462:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253202304:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270089.910476:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270089.910482:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.910495:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.910515:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09815 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c02 expref: 16 pid: 48110 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.910528:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:2.0:1788270089.910531:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.910539:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.910544:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.910566:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270089.910596:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.910604:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.910621:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253202304:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.910631:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000001:00080000:1.0:1788270089.910730:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771257 00000001:00080000:1.0:1788270089.910852:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771258 00000001:00080000:1.0:1788270089.910885:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771259 00000100:00100000:1.0:1788270089.910957:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262644096:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788270089.911000:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270089.911068:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270089.911095:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644096 00000100:00100000:2.0:1788270089.911101:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644096 00000100:00100000:2.0:1788270089.911137:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788270089.911145:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45778:x1875136262644096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788270089.911248:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45778:x1875136262644096:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.911256:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788270089.911292:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262644096:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788270089.911396:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771260 00000100:00100000:3.0:1788270089.911436:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262644224:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788270089.911467:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270089.911490:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270089.911516:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644224 00000100:00100000:0.0:1788270089.911522:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644224 00000100:00100000:0.0:1788270089.911551:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788270089.911564:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45778:x1875136262644224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788270089.911670:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:45778:x1875136262644224:12345-0@lo:1000:mdt00_002.0 Request processed in 112us (202us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1788270089.911683:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788270089.911782:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262644224:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788270089.911802:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911811:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911822:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911829:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.911833:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911840:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911852:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:3.0:1788270089.911855:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270089.911859:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911865:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09854 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911885:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911890:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911895:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911900:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.911902:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911911:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911919:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270089.911921:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270089.911926:0:45778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911937:0:45778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911945:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.911968:0:45778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfe00/0xc5f5d7a016e09790 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101bd8 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.911979:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262644352:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270089.912028:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14417cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270089.913231:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262644352:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788270089.913250:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913258:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09789 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913279:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913298:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913308:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913316:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913322:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913329:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913333:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270089.913335:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913341:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913354:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:1.0:1788270089.913356:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270089.913359:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913365:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0985b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913374:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913381:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913386:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913391:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270089.913394:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913400:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913407:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:1.0:1788270089.913409:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270089.913412:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270089.913429:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e0984d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270089.913498:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.913554:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202432 00000100:00100000:1.0:1788270089.913560:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:36526:x1875136253202048:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 10738us (10872us total) trans 30064771261 rc 0/0 00000100:00100000:3.0:1788270089.913561:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202432 00000100:00100000:1.0:1788270089.913569:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 239 00000020:00080000:1.0:1788270089.913574:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788270089.913598:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788270089.913608:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:36525:x1875136253202432:12345-192.168.201.42@tcp:49:bash.0 00000040:00080000:2.0:1788270089.913639:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270089.913645:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270089.913666:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 7 count 7 00000040:00080000:2.0:1788270089.913673:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270089.913712:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:36525:x1875136253202432:12345-192.168.201.42@tcp:49:bash.0 Request processed in 104us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.913721:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788270089.915155:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.915204:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202688 00000100:00100000:2.0:1788270089.915210:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202688 00000100:00100000:2.0:1788270089.915261:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:2.0:1788270089.915271:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:36526:x1875136253202688:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788270089.915501:0:49484:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788270089.915535:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771262 00010000:00010000:2.0:1788270089.915566:0:49484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.915581:0:49484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.915604:0:49484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.915616:0:49484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.915623:0:49484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.915629:0:49484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.915662:0:49484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270089.915696:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270089.915704:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.915713:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270089.915716:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.915722:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:36526:x1875136253202688:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 453us (570us total) trans 30064771263 rc 0/0 00010000:00010000:0.0:1788270089.915725:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270089.915733:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000020:00080000:2.0:1788270089.915739:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270089.915740:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:0.0:1788270089.915744:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270089.915747:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.915751:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09862 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.915777:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270089.915779:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270089.915781:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270089.916907:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270089.916953:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202816 00000100:00100000:2.0:1788270089.916969:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202816 00000100:00100000:2.0:1788270089.917011:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:2.0:1788270089.917020:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:36525:x1875136253202816:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270089.917031:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270089.917064:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e09869 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c1e expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270089.917090:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc5:0x0] initial LVB size: 0, mtime: 0x6a96d609, atime: 0x6a96d608, ctime: 0x6a96d609, blocks: 0x0 00010000:00010000:2.0:1788270089.917108:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=881s v=(0 0) 00010000:00010000:2.0:1788270089.917112:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270089.917121:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e09869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c1e expref: 9 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.917142:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082984bb9/0xc5f5d7a016e09869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c1e expref: 9 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270089.917151:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821da200, rc 0) 00000100:00100000:2.0:1788270089.917183:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:36525:x1875136253202816:12345-192.168.201.42@tcp:101:bash.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270089.917187:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:1.0:1788270089.918236:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.918291:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253202944 00000100:00100000:0.0:1788270089.918297:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253202944 00000100:00100000:0.0:1788270089.918345:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:0.0:1788270089.918355:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:36525:x1875136253202944:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270089.918372:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270089.918387:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09870 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c25 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.918431:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09877 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.918444:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09877 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.918454:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09877 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.918558:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09870 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c25 expref: 22 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.918574:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f600/0xc5f5d7a016e09877 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c25 expref: 21 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.918582:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270089.918585:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270089.918588:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f600, rc 0) 00000100:00100000:0.0:1788270089.918632:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:36525:x1875136253202944:12345-192.168.201.42@tcp:101:bash.0 Request processed in 278us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.918639:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:0.0:1788270089.920143:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.920398:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253203200 00000100:00100000:3.0:1788270089.920405:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253203200 00000100:00100000:3.0:1788270089.920441:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788270089.920450:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:36525:x1875136253203200:12345-192.168.201.42@tcp:35:bash.0 00000001:00080000:3.0:1788270089.920629:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771264 00000001:00080000:3.0:1788270089.920672:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771265 00000100:00100000:3.0:1788270089.920739:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:36525:x1875136253203200:12345-192.168.201.42@tcp:35:bash.0 Request processed in 290us (597us total) trans 30064771266 rc 0/0 00000100:00100000:3.0:1788270089.920747:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000020:00080000:3.0:1788270089.920750:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788270089.963241:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270089.963390:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253203328 00000100:00100000:0.0:1788270089.963400:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253203328 00000100:00100000:0.0:1788270089.963472:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 241 00000100:00100000:0.0:1788270089.963484:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:36536:x1875136253203328:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270089.963507:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270089.963529:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e0987e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c2c expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.963591:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.963604:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.963623:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270089.963671:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270089.963674:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270089.963693:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.963716:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e0987e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c2c expref: 26 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.963734:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c2c expref: 25 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270089.963742:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270089.963745:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270089.963749:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e200, rc 0) 00000100:00100000:0.0:1788270089.963825:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:36536:x1875136253203328:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 343us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270089.963836:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 241 00000100:00100000:1.0:1788270089.967910:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270089.968313:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253203456 00000100:00100000:3.0:1788270089.968322:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253203456 00000100:00100000:3.0:1788270089.968369:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00100000:3.0:1788270089.968385:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:36536:x1875136253203456:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788270089.968454:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968470:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968479:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968491:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968495:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968499:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968559:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968565:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968569:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270089.968608:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968620:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968628:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968634:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968641:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.968644:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968658:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968667:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:3.0:1788270089.968669:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270089.968673:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968677:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0988c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968686:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968689:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968693:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968696:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.968697:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968700:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968704:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff98c1429f8500) 00010000:00010000:3.0:1788270089.968706:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270089.968707:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968711:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09893 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968720:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968723:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968728:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968731:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270089.968733:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968736:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968739:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:3.0:1788270089.968741:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270089.968742:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270089.968745:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0989a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270089.968819:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:36536:x1875136253203456:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 443us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270089.968831:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00100000:2.0:1788270090.013714:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270090.014000:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253203712 00000100:00100000:0.0:1788270090.014011:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253203712 00000100:00100000:0.0:1788270090.014120:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 243 00000100:00080000:2.0:1788270090.014282:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270090.014360:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:36543:x1875136253203712:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:0.0:1788270090.014382:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270090.014402:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c33 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014521:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014536:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014547:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014561:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014569:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014576:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014686:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e098b6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014699:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e098b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014705:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e098b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270090.014714:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 12 00010000:00010000:0.0:1788270090.014809:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014817:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014844:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014850:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270090.014855:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014863:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014877:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270090.014880:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270090.014892:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014898:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e098a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014911:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014917:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014923:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014928:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270090.014931:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014937:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014944:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff98c1429f1d00) 00010000:00010000:0.0:1788270090.014946:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270090.014949:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014955:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e098af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.014995:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c33 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.015008:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e000/0xc5f5d7a016e098b6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c33 expref: 27 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270090.015016:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff98c1429f8c00) 00010000:00010000:0.0:1788270090.015018:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270090.015021:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e000, rc 0) 00000100:00100000:0.0:1788270090.015127:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:36543:x1875136253203712:12345-192.168.201.42@tcp:101:cat.0 Request processed in 996us (1420us total) trans 30064771267 rc 0/0 00000100:00100000:0.0:1788270090.015144:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 243 00000100:00100000:2.0:1788270090.019401:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270090.019792:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253203968 00000100:00100000:3.0:1788270090.019802:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253203968 00000100:00100000:3.0:1788270090.019913:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788270090.019925:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:36543:x1875136253203968:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:3.0:1788270090.020283:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:36543:x1875136253203968:12345-192.168.201.42@tcp:35:cat.0 Request processed in 360us (891us total) trans 30064771268 rc 0/0 00000100:00100000:3.0:1788270090.020292:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00010000:00010000:3.0:1788270090.692539:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270090.955983:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262644480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270090.956075:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270090.959496:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644480 00000100:00100000:2.0:1788270090.959507:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644480 00000100:00100000:2.0:1788270090.959562:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788270090.959572:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262644480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270090.959601:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57577152 pending 28672 free 3923496960 avail 3691974656 00000100:00100000:2.0:1788270090.959670:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262644480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (3596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270090.959677:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788270090.959716:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270090.959722:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262644480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270091.460998:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262644608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270091.461101:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270091.461186:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644608 00000100:00100000:2.0:1788270091.461195:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644608 00000100:00100000:2.0:1788270091.461251:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788270091.461263:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262644608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270091.461332:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1299947520 00000100:00100000:2.0:1788270091.461393:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262644608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270091.461402:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788270091.461624:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262644608:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270091.719053:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270092.740283:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270092.766817:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270092.766881:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204096 00000100:00100000:0.0:1788270092.766891:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204096 00000100:00080000:1.0:1788270092.766945:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270092.766979:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 244 00000100:00100000:0.0:1788270092.766990:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:36482:x1875136253204096:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788270092.767142:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:36482:x1875136253204096:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 154us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270092.767149:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 244 00000100:00100000:2.0:1788270092.774263:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270092.774456:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204224 00000100:00100000:3.0:1788270092.774467:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204224 00000100:00080000:1.0:1788270092.774534:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270092.774546:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 245 00000100:00100000:3.0:1788270092.774558:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:36482:x1875136253204224:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788270092.774774:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:36482:x1875136253204224:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 214us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270092.774781:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 245 00000100:00100000:3.0:1788270092.776099:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270092.776152:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204480 00000100:00100000:0.0:1788270092.776159:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204480 00000100:00100000:0.0:1788270092.776210:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788270092.776230:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:36482:x1875136253204480:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788270092.776458:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:36482:x1875136253204480:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 239us (364us total) trans 30064771269 rc 0/0 00000100:00100000:0.0:1788270092.776467:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788270092.890897:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270092.891062:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204608 00000100:00100000:0.0:1788270092.891073:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204608 00000100:00100000:0.0:1788270092.891155:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 246 00000100:00100000:0.0:1788270092.891165:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:36989:x1875136253204608:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:0.0:1788270092.891184:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788270092.891763:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788270092.891916:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e098c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c3a expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270092.891975:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270092.891992:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270092.892000:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270092.892035:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270092.892054:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270092.892072:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270092.892090:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e098c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270092.892102:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 6 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270092.892108:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270092.892110:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270092.892113:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270092.892167:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:36989:x1875136253204608:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 1004us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270092.892172:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 246 00000100:00100000:0.0:1788270093.508386:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262644736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270093.508469:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270093.508521:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644736 00000100:00100000:1.0:1788270093.508528:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644736 00000100:00100000:1.0:1788270093.508578:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788270093.508584:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262644736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270093.508612:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270093.508765:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262644736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270093.508772:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788270093.508813:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262644736:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270093.768977:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270093.831544:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831667:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831716:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831753:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831797:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831821:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270093.831841:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253205248 00000100:00100000:3.0:1788270093.831847:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270093.831858:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253205248 00000100:00100000:3.0:1788270093.831869:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831896:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270093.831928:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253205120 00000100:00100000:3.0:1788270093.831936:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253205120 00000100:00100000:1.0:1788270093.831954:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253205632 00000100:00100000:1.0:1788270093.831959:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253205632 00000100:00100000:3.0:1788270093.831980:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253205760 00000100:00100000:3.0:1788270093.831985:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253205760 00000100:00100000:1.0:1788270093.832011:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:1.0:1788270093.832024:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253205248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270093.832073:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204992 00000100:00100000:2.0:1788270093.832079:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204992 00000100:00100000:2.0:1788270093.832115:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253205504 00000100:00100000:2.0:1788270093.832119:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253205504 00000100:00100000:2.0:1788270093.832137:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204864 00000100:00100000:2.0:1788270093.832139:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204864 00000100:00100000:2.0:1788270093.832155:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253205376 00000100:00100000:2.0:1788270093.832157:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253205376 00000100:00100000:2.0:1788270093.832176:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:1.0:1788270093.832186:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253205248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 157us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270093.832196:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253204992:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270093.832264:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2401:x1875136253204992:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 72us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270093.832272:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:2.0:1788270093.832295:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:2.0:1788270093.832302:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253205504:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270093.832326:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253205504:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270093.832332:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:2.0:1788270093.832344:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788270093.832349:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2401:x1875136253204864:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270093.832378:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2401:x1875136253204864:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270093.832384:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788270093.832392:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:2.0:1788270093.832397:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253205376:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270093.832413:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253205376:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 16us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270093.832419:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:3.0:1788270093.833679:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788270093.833708:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253205120:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270093.833760:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:3.0:1788270093.833772:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253205120:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270093.833802:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788270093.833815:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2399:x1875136253205632:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:1.0:1788270093.833840:0:47283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e08a1c 00000100:00080000:1.0:1788270093.833857:0:47283:0:(import.c:65:import_set_state_nolock()) ffff98c14379d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788270093.833904:0:47283:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771093 00000100:00100000:0.0:1788270093.833949:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253204736 00000100:00100000:0.0:1788270093.833958:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253204736 00000100:00100000:0.0:1788270093.834005:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:0.0:1788270093.834017:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253204736:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270093.834069:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253204736:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 57us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270093.834077:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:1.0:1788270093.834117:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+2:2399:x1875136253205632:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 302us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270093.834127:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788270093.834145:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:1.0:1788270093.834155:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2399:x1875136253205760:12345-192.168.201.42@tcp:9:kworker.0 00010000:00010000:0.0:1788270093.834159:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788270093.834168:0:47283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc5f5d7a016e08a23 00000100:00080000:0.0:1788270093.834173:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270093.834179:0:47283:0:(import.c:65:import_set_state_nolock()) ffff98c2491ec000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788270093.834182:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270093.834187:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1788270093.834213:0:47283:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771099 00000100:00100000:1.0:1788270093.834575:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+2:2399:x1875136253205760:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 420us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270093.834583:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:3.0:1788270093.834733:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00010000:00010000:0.0:1788270093.834916:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788270093.836004:0:47278:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000020:00000080:0.0:1788270093.836016:0:47278:0:(genops.c:885:class_export_put()) final put ffff98c14379c000/04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000001:00080000:0.0:1788270093.836031:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771093 is committed 00000001:00080000:0.0:1788270093.836055:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771091 is committed 00000020:00000080:0.0:1788270093.836081:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c14379c000/04ecb0d1-118e-4eab-bf07-e32490d1fd1f for lustre-OST0000 00000020:00000080:0.0:1788270093.836116:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c14379d000 for lustre-OST0000 00000100:00100000:0.0:1788270094.020508:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270094.020531:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262644864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270094.020638:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270094.021932:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644864 00000100:00100000:1.0:1788270094.021941:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644864 00000100:00080000:0.0:1788270094.022006:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270094.022018:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788270094.022029:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262644864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270094.022076:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41541312 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1788270094.022136:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262644864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270094.022144:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788270094.022191:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262644864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270094.022505:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262645376:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.022544:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270094.022575:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262645888:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.022607:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270094.022635:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788270094.022643:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262645248:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.022672:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270094.022716:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262645760:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.022742:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270094.022765:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262646272:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.022791:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270094.023022:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645376 00000100:00100000:0.0:1788270094.023028:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645376 00000100:00100000:0.0:1788270094.023220:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788270094.023228:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262645376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.023281:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262645376:12345-0@lo:400:kworker.0 Request processed in 53us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270094.023288:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788270094.023302:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645888 00000100:00100000:1.0:1788270094.023308:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645888 00000100:00100000:0.0:1788270094.023316:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645248 00000100:00100000:0.0:1788270094.023321:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645248 00000100:00100000:0.0:1788270094.023343:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645760 00000100:00100000:1.0:1788270094.023346:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262646272 00000100:00100000:0.0:1788270094.023346:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645760 00000100:00100000:1.0:1788270094.023353:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262646272 00000100:00100000:0.0:1788270094.023367:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788270094.023376:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262645888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270094.023383:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788270094.023393:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262645248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.023413:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262645888:12345-0@lo:400:kworker.0 Request processed in 39us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270094.023420:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788270094.023438:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788270094.023443:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262645248:12345-0@lo:400:kworker.0 Request processed in 49us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270094.023450:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262645760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270094.023454:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788270094.023473:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788270094.023482:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262646272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.023489:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262645760:12345-0@lo:400:kworker.0 Request processed in 42us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270094.023497:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788270094.023518:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262646272:12345-0@lo:400:kworker.0 Request processed in 37us (727us total) trans 0 rc 0/0 00000100:00080000:0.0:1788270094.023523:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270094.023525:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788270094.023528:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270094.023554:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262645248:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.023566:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262645760:0@lo:400:kworker.0 00010000:00080000:0.0:1788270094.023578:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27a6a0700 x1875136262646272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270094.023588:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262646272:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.023597:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262645376:0@lo:400:kworker.0 00000100:00100000:0.0:1788270094.023605:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262645888:0@lo:400:kworker.0 00000100:00100000:1.0:1788270094.024503:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270094.024531:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262644992:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024572:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.024603:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262645504:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024623:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.024638:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262646016:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.024671:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788270094.024676:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262645120:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024707:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.024721:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262645632:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024736:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.024748:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262646144:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024763:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.024788:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262644992 00000100:00100000:3.0:1788270094.024792:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262644992 00000100:00100000:3.0:1788270094.024849:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788270094.024856:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262644992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.024887:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262644992:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.024893:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788270094.024919:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645504 00000100:00100000:3.0:1788270094.024922:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645504 00000100:00100000:3.0:1788270094.024945:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645120 00000100:00100000:3.0:1788270094.024947:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645120 00000100:00100000:3.0:1788270094.024962:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262645632 00000100:00100000:3.0:1788270094.024964:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262645632 00000100:00100000:3.0:1788270094.024977:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788270094.024982:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262645504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025006:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262645504:12345-0@lo:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.025011:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788270094.025021:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788270094.025026:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262645120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025062:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262645120:12345-0@lo:400:kworker.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.025067:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788270094.025076:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788270094.025081:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262645632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025102:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262645632:12345-0@lo:400:kworker.0 Request processed in 21us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.025107:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788270094.025142:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262646528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270094.025162:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270094.025203:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771093 gen 2 00000004:00080000:3.0:1788270094.025208:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771092 committed transno 30064771093 00000004:00080000:3.0:1788270094.025221:0:3609:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1448f2d80, transno 30064771093 00000100:00100000:3.0:1788270094.025232:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262645120:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025241:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262645632:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025248:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262644992:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025256:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262645504:0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025285:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262646528 00000100:00100000:3.0:1788270094.025288:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262646528 00000100:00100000:3.0:1788270094.025307:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788270094.025312:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262646528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270094.025330:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41541312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1788270094.025361:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262646528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.025367:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788270094.025469:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262646528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270094.025484:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262646016 00000100:00100000:3.0:1788270094.025486:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262646016 00000100:00100000:3.0:1788270094.025506:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262646144 00000100:00100000:3.0:1788270094.025509:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262646144 00000100:00100000:3.0:1788270094.025523:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788270094.025528:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262646016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025555:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262646016:12345-0@lo:400:kworker.0 Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.025561:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788270094.025571:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788270094.025576:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262646144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270094.025595:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262646144:12345-0@lo:400:kworker.0 Request processed in 19us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270094.025600:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788270094.025617:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262646144:0@lo:400:kworker.0 00010000:00080000:3.0:1788270094.025630:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c27f290000 x1875136262646016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788270094.025640:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262646016:0@lo:400:kworker.0 00000100:00080000:3.0:1788270094.025659:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270094.025662:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270094.025664:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270094.025666:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270094.026171:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262646400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270094.026200:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270094.026262:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262646400 00000100:00100000:0.0:1788270094.026266:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262646400 00000100:00100000:0.0:1788270094.026318:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788270094.026323:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262646400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270094.026333:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41541312 pending 0 free 3923484672 avail 3691962368 00000100:00100000:0.0:1788270094.026365:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262646400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270094.026369:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788270094.026416:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262646400:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788270094.331566:0:49668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 09:41:33 (1788270093) 00010000:00010000:3.0:1788270094.789603:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788270095.049884:0:48095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000020:00000080:2.0:1788270095.049892:0:48095:0:(genops.c:885:class_export_put()) final put ffff98c2491eb800/04ecb0d1-118e-4eab-bf07-e32490d1fd1f 00000001:00080000:2.0:1788270095.049923:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771099 is committed 00000001:00080000:2.0:1788270095.049931:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771098 is committed 00000001:00080000:3.0:1788270095.051115:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771269 is committed 00000020:00080000:3.0:1788270095.051139:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c1440a6480 refcount 2 committed 0 result 0 batchid 25769803843 00000020:00080000:3.0:1788270095.051145:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c1440a6f00 00000020:00080000:3.0:1788270095.051148:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14422d000 00000020:00080000:3.0:1788270095.051215:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803842 batchid updated 00000020:00080000:2.0:1788270095.051429:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803843 committed batchid 25769803842 00000020:00080000:2.0:1788270095.051490:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803842 00010000:00010000:0.0:1788270095.051940:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.051953:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.051961:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.051967:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270095.051971:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.051976:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.051990:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff98c1429f8600) 00010000:00010000:0.0:1788270095.051992:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270095.051995:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.052000:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09838 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788270095.056020:0:466:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2491eb800/04ecb0d1-118e-4eab-bf07-e32490d1fd1f for lustre-OST0001 00000020:00000080:1.0:1788270095.056125:0:466:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c2491ec000 for lustre-OST0001 00000100:00100000:3.0:1788270095.137699:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.137810:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253206016 00000100:00100000:1.0:1788270095.137821:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253206016 00000100:00100000:1.0:1788270095.137904:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 247 00000100:00100000:1.0:1788270095.137915:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:37248:x1875136253206016:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270095.137939:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270095.137961:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e098d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c41 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138036:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138090:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138101:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138115:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138122:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138128:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138218:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e098e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138227:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e098e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138234:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e098e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270095.138243:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788270095.138322:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138329:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138334:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138340:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270095.138344:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138352:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138364:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:1.0:1788270095.138367:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270095.138372:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138377:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e098d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138391:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138396:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138402:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138411:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270095.138413:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138419:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138426:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c14387f500) 00010000:00010000:1.0:1788270095.138429:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270095.138431:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138437:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e098e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138714:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e098d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c41 expref: 17 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138742:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e098e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c41 expref: 16 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.138749:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:1.0:1788270095.138751:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270095.138754:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b200, rc 0) 00000100:00100000:1.0:1788270095.138820:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:37248:x1875136253206016:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 907us (1164us total) trans 30064771270 rc 0/0 00000100:00100000:1.0:1788270095.138827:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 247 00000100:00080000:3.0:1788270095.138964:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270095.141509:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.142892:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253206144 00000100:00100000:3.0:1788270095.142905:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253206144 00000100:00100000:3.0:1788270095.142978:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:3.0:1788270095.142988:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:37248:x1875136253206144:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788270095.143336:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:37248:x1875136253206144:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 349us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270095.143345:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:2.0:1788270095.148483:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270095.148716:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253206272 00000100:00100000:0.0:1788270095.148727:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253206272 00000100:00100000:0.0:1788270095.148797:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788270095.148809:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2403:x1875136253206272:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270095.148825:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270095.148852:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e098e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c41 expref: 16 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.148877:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270095.148882:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270095.148953:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2403:x1875136253206272:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 146us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270095.148960:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788270095.149468:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.149707:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253206400 00000100:00100000:1.0:1788270095.149713:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253206400 00000100:00100000:1.0:1788270095.149771:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 249 00000100:00100000:1.0:1788270095.149780:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:37248:x1875136253206400:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270095.149880:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:37248:x1875136253206400:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 101us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270095.149888:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 249 00000100:00080000:3.0:1788270095.149964:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270095.245309:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270095.245412:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253206656 00000100:00100000:0.0:1788270095.245424:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253206656 00000100:00100000:0.0:1788270095.245493:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 250 00000100:00100000:0.0:1788270095.245503:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:37263:x1875136253206656:12345-192.168.201.42@tcp:101:touch.0 00010000:00010000:0.0:1788270095.245525:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270095.245529:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788270095.245554:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c2c expref: 15 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.245574:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270095.245578:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270095.245589:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e098f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c48 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.245707:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.245720:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 5 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.245729:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.245775:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 5 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.245788:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 5 pid: 46770 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270095.245801:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262646656:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270095.245878:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c241359780 going to sleep for 11 seconds 00000100:00100000:2.0:1788270095.251416:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.251477:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253206784 00000100:00100000:3.0:1788270095.251488:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253206784 00010000:00010000:3.0:1788270095.251547:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 6 pid: 46770 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270095.251587:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788270095.251596:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253206784:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788270095.251597:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27f290000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262646656:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270095.251609:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270095.251615:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 6 pid: 46770 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.251619:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.251628:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 6 pid: 46770 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788270095.251680:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788270095.258076:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e098cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c3a expref: 6 pid: 46770 timeout: 986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.258103:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:3.0:1788270095.258108:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.258118:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.258125:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.258153:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270095.258232:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253206784:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 6635us (6824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.258242:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00010000:00010000:0.0:1788270095.259124:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259137:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259162:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259174:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259183:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270095.259615:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc6:0x0], index 0: 0 00010000:00010000:0.0:1788270095.259905:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0990a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259916:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0990a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259924:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0990a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259959:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259966:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259973:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259979:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270095.259983:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.259990:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.260001:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270095.260004:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270095.260008:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.260013:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e098fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270095.260026:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005616cd75 reply state 0000000022e35df7 transno 30064771271 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.260336:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.260346:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1400) 00010000:00010000:0.0:1788270095.260349:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270095.260352:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270095.260386:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e098f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c48 expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.260406:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0990a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c48 expref: 16 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.260414:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c1429f1800) 00010000:00010000:0.0:1788270095.260549:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270095.260552:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f800, rc 0) 00000100:00100000:0.0:1788270095.260647:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:37263:x1875136253206656:12345-192.168.201.42@tcp:101:touch.0 Request processed in 15144us (15348us total) trans 30064771271 rc 0/0 00000100:00100000:0.0:1788270095.260655:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 250 00000100:00100000:3.0:1788270095.269548:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.269643:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207040 00000100:00100000:1.0:1788270095.269653:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207040 00000100:00100000:1.0:1788270095.269726:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 251 00000100:00100000:1.0:1788270095.269736:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:37263:x1875136253207040:12345-192.168.201.42@tcp:36:touch.0 00010000:00010000:1.0:1788270095.269789:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270095.269814:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e0990a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c48 expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.269833:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c1429f1800) 00010000:00010000:1.0:1788270095.269843:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270095.269896:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.269908:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.269916:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270095.270014:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000262aed2f reply state 00000000081e33e8 transno 30064771272 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.270033:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.270066:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270095.270069:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270095.270072:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270095.270170:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:37263:x1875136253207040:12345-192.168.201.42@tcp:36:touch.0 Request processed in 434us (632us total) trans 30064771272 rc 0/0 00000100:00100000:1.0:1788270095.270177:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 251 00000100:00100000:3.0:1788270095.273185:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.273275:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207168 00000100:00100000:1.0:1788270095.273285:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207168 00000100:00100000:1.0:1788270095.273342:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 252 00000100:00100000:1.0:1788270095.273350:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:37263:x1875136253207168:12345-192.168.201.42@tcp:101:touch.0 00010000:00010000:1.0:1788270095.273369:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270095.273385:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c4f expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.273426:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 19 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.273436:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 19 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.273449:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270095.273451:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270095.273454:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a600, rc 0) 00000100:00100000:1.0:1788270095.273499:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:37263:x1875136253207168:12345-192.168.201.42@tcp:101:touch.0 Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270095.273504:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 252 00000100:00100000:2.0:1788270095.275458:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.277210:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207296 00000100:00100000:3.0:1788270095.277223:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207296 00000100:00100000:2.0:1788270095.277815:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:2.0:1788270095.277827:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253207296:12345-192.168.201.42@tcp:2:touch.0 00000100:00100000:2.0:1788270095.278166:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2402:x1875136253207296:12345-192.168.201.42@tcp:2:touch.0 Request processed in 341us (2713us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1788270095.278178:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00080000:1.0:1788270095.279167:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270095.282461:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.282545:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207552 00000100:00100000:3.0:1788270095.282555:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207552 00000100:00100000:3.0:1788270095.282610:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788270095.282622:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:37263:x1875136253207552:12345-192.168.201.42@tcp:35:touch.0 00000100:00100000:3.0:1788270095.283023:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:37263:x1875136253207552:12345-192.168.201.42@tcp:35:touch.0 Request processed in 403us (572us total) trans 30064771273 rc 0/0 00000100:00100000:3.0:1788270095.283031:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788270095.321798:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270095.321965:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207680 00000100:00100000:0.0:1788270095.321976:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207680 00000100:00100000:0.0:1788270095.322083:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 253 00000100:00100000:0.0:1788270095.322094:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:37269:x1875136253207680:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270095.322117:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270095.322139:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.322206:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0992d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.322231:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0992d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.322243:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0992d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270095.322283:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270095.322286:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270095.322304:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0992d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.322327:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c56 expref: 22 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.322343:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0992d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c56 expref: 21 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.322351:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:0.0:1788270095.322354:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270095.322357:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ec00, rc 0) 00000100:00100000:0.0:1788270095.322409:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:37269:x1875136253207680:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 318us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270095.322415:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 253 00000100:00100000:2.0:1788270095.325222:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.325305:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207808 00000100:00100000:3.0:1788270095.325315:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207808 00000100:00100000:3.0:1788270095.325374:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 254 00000100:00100000:3.0:1788270095.325384:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:37269:x1875136253207808:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270095.325401:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270095.325419:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c5d expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325475:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325488:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325498:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325508:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325514:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325520:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325586:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325593:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325600:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270095.325639:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:3.0:1788270095.325644:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270095.325672:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325685:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325702:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325710:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325717:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325722:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270095.325726:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325734:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325747:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:3.0:1788270095.325749:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270095.325753:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325760:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0993b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325773:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325779:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325785:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325789:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270095.325791:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325797:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325804:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1400) 00010000:00010000:3.0:1788270095.325806:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270095.325810:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325819:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09942 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325843:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 23 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325856:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 22 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.325863:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.325865:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270095.325867:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf200, rc 0) 00000100:00100000:3.0:1788270095.326010:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:37269:x1875136253207808:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 626us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.326017:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 254 00000100:00100000:2.0:1788270095.331496:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.331573:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253207936 00000100:00100000:3.0:1788270095.331583:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253207936 00000100:00100000:3.0:1788270095.331695:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:3.0:1788270095.331706:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253207936:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270095.331722:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270095.331741:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c64 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270095.331764:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6:0x0] initial LVB size: 0, mtime: 0x6a96d60f, atime: 0x6a96d60f, ctime: 0x6a96d60f, blocks: 0x0 00010000:00010000:3.0:1788270095.331783:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=887s v=(0 0) 00010000:00010000:3.0:1788270095.331786:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270095.331796:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 7 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.331815:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 7 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.331827:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf600, rc 0) 00000100:00100000:3.0:1788270095.331883:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253207936:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 179us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.331891:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:1.0:1788270095.339405:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.339709:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253208192 00000100:00100000:3.0:1788270095.339719:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253208192 00000100:00100000:3.0:1788270095.339769:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 255 00000100:00100000:3.0:1788270095.339780:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:37269:x1875136253208192:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270095.339800:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270095.339819:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c6b expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.339906:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.339917:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 23 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.339924:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.339950:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 23 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.339960:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 23 pid: 48110 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270095.339970:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262646784:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270095.340166:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270095.343002:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270095.343082:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253208320 00000100:00100000:3.0:1788270095.343139:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262646784:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270095.343162:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253208320 00010000:00010000:3.0:1788270095.343166:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343201:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 24 pid: 48110 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270095.343325:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:0.0:1788270095.343335:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:2401:x1875136253208320:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270095.343350:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270095.343358:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 24 pid: 48110 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343370:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 24 pid: 48110 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343392:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09949 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c5d expref: 24 pid: 48110 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343408:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270095.343413:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343552:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343560:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270095.343630:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270095.343698:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253208320:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 363us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270095.343705:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00010000:00010000:3.0:1788270095.343847:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.343855:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270095.343919:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:3.0:1788270095.344448:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e09957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c6b expref: 24 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.344466:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c6b expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.344473:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.344476:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788270095.344479:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bee00, rc 0) 00000100:00100000:2.0:1788270095.344856:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:37269:x1875136253208192:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 5075us (5459us total) trans 30064771274 rc 0/0 00000100:00100000:2.0:1788270095.344865:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 255 00000100:00100000:2.0:1788270095.347021:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.347176:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253208576 00000100:00100000:1.0:1788270095.347187:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253208576 00000100:00100000:1.0:1788270095.347439:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:1.0:1788270095.347451:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:37269:x1875136253208576:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270095.347479:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270095.347482:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788270095.347510:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0995e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c6b expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.347531:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270095.347535:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270095.347547:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0996c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c72 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.347644:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09973 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.347686:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09973 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.347707:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09973 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270095.347719:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:1.0:1788270095.347811:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0996c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c72 expref: 25 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.347825:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09973 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c72 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.347832:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270095.347836:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788270095.347838:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19be00, rc 0) 00000100:00100000:1.0:1788270095.347903:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:37269:x1875136253208576:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 454us (888us total) trans 30064771275 rc 0/0 00000100:00100000:1.0:1788270095.347911:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:3.0:1788270095.352368:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270095.352461:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253208704 00000100:00100000:2.0:1788270095.352472:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253208704 00002000:00100000:2.0:1788270095.352541:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc6:0x0] (0->4095) req@ffff98c14262dc00 x1875136253208704/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:511/0 lens 488/0 e 0 to 0 dl 1788270106 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270095.352554:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262dc00 with x1875136253208704 ext(0->4095) 00002000:00010000:2.0:1788270095.352560:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262dc00 00000100:00100000:2.0:1788270095.352591:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788270095.352601:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253208704:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:2.0:1788270095.352808:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253208704:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 208us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270095.352816:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00002000:00100000:2.0:1788270095.352824:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc6:0x0] (0->4095) req@ffff98c14262dc00 x1875136253208704/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:511/0 lens 488/440 e 0 to 0 dl 1788270106 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270095.352832:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262dc00 with x1875136253208704 ext(0->4095) 00002000:00010000:2.0:1788270095.352835:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262dc00 00000100:00100000:2.0:1788270095.355750:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.355861:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253208832 00000100:00100000:3.0:1788270095.355871:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253208832 00000100:00100000:3.0:1788270095.355931:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:3.0:1788270095.355942:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253208832:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:3.0:1788270095.355983:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.356015:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 7 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.356025:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270095.356030:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270095.356034:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.356115:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 7 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.356130:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 7 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270095.356145:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262646912:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270095.356216:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788270095.359645:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262646912:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270095.359691:0:48231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270095.360518:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.360620:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253208960 00000100:00100000:1.0:1788270095.360629:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253208960 00010000:00010000:1.0:1788270095.360679:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 8 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270095.360723:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:1.0:1788270095.360733:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253208960:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270095.360748:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270095.360769:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 8 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.360794:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 8 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.360816:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e09950 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c64 expref: 8 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.360839:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270095.360844:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270095.360849:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.360860:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.360886:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270095.360947:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253208960:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 215us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270095.360954:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00010000:00010000:3.0:1788270095.361344:0:48231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361355:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361376:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361384:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361392:0:48231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361400:0:48231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfa00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270095.361404:0:48231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361413:0:48231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361426:0:48231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.361439:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d140c2/0xc5f5d7a016e09981 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270095.361487:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253208832:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 5547us (5747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.361495:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:2.0:1788270095.364526:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.364607:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253209216 00000100:00100000:1.0:1788270095.364618:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253209216 00000100:00100000:1.0:1788270095.364683:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788270095.364693:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:37269:x1875136253209216:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:1.0:1788270095.364751:0:49484:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x16:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09973 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c72 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788270095.364965:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771276 00000001:00080000:1.0:1788270095.364997:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771277 00000001:00080000:1.0:1788270095.365380:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771278 00010000:00010000:1.0:1788270095.365417:0:49484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.365433:0:49484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 28 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.365443:0:49484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.365478:0:49484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 28 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.365491:0:49484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 28 pid: 45777 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270095.365505:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:49484:1875136262647040:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270095.365585:0:49484:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802480 going to sleep for 11 seconds 00000100:00100000:1.0:1788270095.367887:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:49484:1875136262647040:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270095.367914:0:49484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270095.368573:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.368692:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253209344 00000100:00100000:3.0:1788270095.368699:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253209344 00010000:00010000:3.0:1788270095.368735:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 29 pid: 45777 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270095.368774:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788270095.368784:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2401:x1875136253209344:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270095.368797:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270095.368805:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 29 pid: 45777 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.368817:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 29 pid: 45777 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.368836:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0991f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c4f expref: 29 pid: 45777 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.368851:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.368856:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.368866:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.368875:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.368905:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270095.368952:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2401:x1875136253209344:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 169us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.368959:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00010000:00010000:2.0:1788270095.369327:0:49484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.369335:0:49484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270095.369438:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771279 00000001:00080000:2.0:1788270095.369548:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771280 00000100:00100000:2.0:1788270095.369630:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:49484:1875136262647168:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788270095.369728:0:49484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270095.369760:0:49484:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c241359780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270095.370237:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262647168 00000100:00100000:1.0:1788270095.370244:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262647168 00000100:00100000:1.0:1788270095.370276:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788270095.370284:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:49484:x1875136262647168:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788270095.370373:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:49484:x1875136262647168:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 90us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270095.370380:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788270095.370563:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:49484:1875136262647168:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788270095.370683:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771281 00000100:00100000:2.0:1788270095.370730:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:49484:1875136262647296:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788270095.370758:0:49484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270095.370820:0:49484:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270095.371558:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262647296 00000100:00100000:0.0:1788270095.371566:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262647296 00000100:00100000:0.0:1788270095.371639:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788270095.371647:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:49484:x1875136262647296:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788270095.371793:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:49484:x1875136262647296:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 147us (1034us total) trans 30064771095 rc 0/0 00000100:00100000:0.0:1788270095.371801:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788270095.371862:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:49484:1875136262647296:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788270095.371907:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771282 00010000:00010000:2.0:1788270095.371941:0:49484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.371952:0:49484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.371960:0:49484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.371971:0:49484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270095.371976:0:49484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.371984:0:49484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.372013:0:49484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270095.372017:0:49484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788270095.372022:0:49484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.372028:0:49484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09988 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270095.372159:0:49484:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x17:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788270095.372218:0:49484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].8, 64 off8752 00000004:00080000:2.0:1788270095.372229:0:49484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 887079189625ns, next at 888079187539ns, rc = 0 00000001:00080000:2.0:1788270095.372235:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771283 00010000:00010000:2.0:1788270095.372256:0:49484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270095.372259:0:49484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270095.372266:0:49484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09973 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c72 expref: 32 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270095.372350:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:37269:x1875136253209216:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 7658us (7832us total) trans 30064771284 rc 0/0 00000100:00100000:2.0:1788270095.372358:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000020:00080000:2.0:1788270095.372362:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788270095.373995:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.374349:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253209472 00000100:00100000:3.0:1788270095.374359:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253209472 00000100:00100000:3.0:1788270095.374496:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 257 00000100:00100000:3.0:1788270095.374506:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:37269:x1875136253209472:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270095.374528:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270095.374548:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0998f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c79 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.374603:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0998f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c79 expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.374617:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0998f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c79 expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.374632:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.374635:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270095.374638:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be400, rc 0) 00000100:00100000:3.0:1788270095.374709:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:37269:x1875136253209472:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 204us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.374715:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 257 00000100:00100000:3.0:1788270095.378495:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270095.378593:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253209728 00000100:00100000:0.0:1788270095.378603:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253209728 00000100:00100000:0.0:1788270095.378669:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:0.0:1788270095.378680:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:37269:x1875136253209728:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270095.379011:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:37269:x1875136253209728:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 322us (514us total) trans 30064771285 rc 0/0 00000100:00100000:0.0:1788270095.379019:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000040:00080000:0.0:1788270095.428896:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788270095.441901:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270095.442075:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253209856 00000100:00100000:2.0:1788270095.442086:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253209856 00000100:00100000:2.0:1788270095.442146:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 258 00000100:00100000:2.0:1788270095.442157:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:37279:x1875136253209856:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270095.442236:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442257:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442270:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442281:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442288:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442295:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442395:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442404:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442410:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270095.442467:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442480:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442486:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442493:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442499:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270095.442503:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442510:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442522:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:2.0:1788270095.442525:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270095.442529:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442535:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442548:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442555:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442560:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442566:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270095.442569:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442574:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442581:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1400) 00010000:00010000:2.0:1788270095.442583:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270095.442586:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442591:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e0999d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442601:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442607:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442612:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442617:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270095.442620:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442625:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442635:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270095.442637:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270095.442640:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270095.442644:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099a4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270095.442725:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:37279:x1875136253209856:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 568us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270095.442732:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 258 00000100:00100000:2.0:1788270095.506220:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270095.506322:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253210112 00000100:00100000:1.0:1788270095.506339:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253210112 00000100:00100000:1.0:1788270095.506435:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 259 00000100:00100000:1.0:1788270095.506447:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:37285:x1875136253210112:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270095.506469:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270095.506472:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788270095.506498:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e0992d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c56 expref: 33 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506520:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f1200) 00010000:00010000:1.0:1788270095.506531:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270095.506549:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e099ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c80 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506788:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506802:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506811:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506823:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506829:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506836:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506896:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e099c0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506904:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e099c0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.506911:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e099c0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270095.506921:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:1.0:1788270095.506996:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507004:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507011:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507017:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270095.507021:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507028:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507084:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387ff00) 00010000:00010000:1.0:1788270095.507088:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270095.507092:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507099:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e099b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507479:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507486:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507492:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507497:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270095.507500:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507505:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507513:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1400) 00010000:00010000:1.0:1788270095.507515:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270095.507518:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507524:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b000/0xc5f5d7a016e099b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507579:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e099ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c80 expref: 35 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507597:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e099c0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c80 expref: 34 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270095.507603:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270095.507606:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270095.507609:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b400, rc 0) 00000100:00100000:1.0:1788270095.508092:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:37285:x1875136253210112:12345-192.168.201.42@tcp:101:dd.0 Request processed in 1645us (2814us total) trans 30064771286 rc 0/0 00000100:00100000:1.0:1788270095.508101:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 259 00000100:00100000:0.0:1788270095.510428:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.510583:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253210240 00000100:00100000:3.0:1788270095.510592:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253210240 00000100:00100000:3.0:1788270095.510709:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 260 00000100:00100000:3.0:1788270095.510720:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:37285:x1875136253210240:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270095.510743:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270095.510763:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e099ce lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c87 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.510805:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.510819:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.510830:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.510943:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e099ce lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 36 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.510960:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.510968:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.510970:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788270095.510974:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bec00, rc 0) 00000100:00100000:3.0:1788270095.511032:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:37285:x1875136253210240:12345-192.168.201.42@tcp:101:dd.0 Request processed in 314us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.511068:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 260 00000100:00100000:0.0:1788270095.513812:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.513888:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253210496 00000100:00100000:3.0:1788270095.513897:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253210496 00000100:00100000:3.0:1788270095.513983:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 261 00000100:00100000:3.0:1788270095.513994:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:37285:x1875136253210496:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:3.0:1788270095.514072:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270095.514097:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e099c0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c80 expref: 35 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.514115:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.514120:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270095.514276:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.514289:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.514299:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270095.514340:0:45777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771287 00000004:00010000:3.0:1788270095.514360:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066887dd9 reply state 00000000e5aafb3a transno 30064771288 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.514384:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.514394:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.514396:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270095.514399:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270095.514491:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:37285:x1875136253210496:12345-192.168.201.42@tcp:36:dd.0 Request processed in 499us (685us total) trans 30064771288 rc 0/0 00000100:00100000:3.0:1788270095.514498:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 261 00000020:00080000:3.0:1788270095.514502:0:45777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270095.812448:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270095.998322:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270095.998443:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253210752 00000100:00100000:3.0:1788270095.998452:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253210752 00000100:00100000:3.0:1788270095.998563:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788270095.998574:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:37285:x1875136253210752:12345-192.168.201.42@tcp:103:dd.0 00010000:00010000:3.0:1788270095.998589:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270095.998613:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e0998f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c79 expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270095.998632:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270095.998636:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270095.998749:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:37285:x1875136253210752:12345-192.168.201.42@tcp:103:dd.0 Request processed in 177us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270095.998756:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788270096.000422:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.000506:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253210880 00000100:00100000:2.0:1788270096.000514:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253210880 00000100:00100000:2.0:1788270096.000601:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 262 00000100:00100000:2.0:1788270096.000609:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:37285:x1875136253210880:12345-192.168.201.42@tcp:58:dd.0 00010000:00010000:2.0:1788270096.000714:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.000727:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.000735:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270096.000810:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].7, 136 off9144 00000100:00100000:2.0:1788270096.000865:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:37285:x1875136253210880:12345-192.168.201.42@tcp:58:dd.0 Request processed in 256us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.000872:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 262 00000100:00100000:0.0:1788270096.007370:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.007459:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253211008 00000100:00100000:3.0:1788270096.007470:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253211008 00000100:00100000:3.0:1788270096.007531:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 263 00000100:00100000:3.0:1788270096.007541:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:37285:x1875136253211008:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270096.007560:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270096.007580:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c8e expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.007628:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.007638:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.007672:0:48110:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.007686:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.007700:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270096.007703:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270096.007707:0:48110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.007715:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be400, rc 0) 00000100:00100000:3.0:1788270096.007775:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:37285:x1875136253211008:12345-192.168.201.42@tcp:101:dd.0 Request processed in 235us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270096.007782:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 263 00000100:00100000:2.0:1788270096.069178:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270096.069201:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262647424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270096.069270:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270096.069578:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262647424 00000100:00100000:0.0:1788270096.069586:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262647424 00000100:00100000:0.0:1788270096.069674:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788270096.069690:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262647424:12345-0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788270096.069709:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270096.069715:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00002000:00000024:0.0:1788270096.069721:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41541312 pending 0 free 3923496960 avail 3691974656 00000040:00080000:1.0:1788270096.069746:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 8 count 8 00000040:00080000:1.0:1788270096.069754:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270096.069851:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262647552:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270096.069910:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270096.069957:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262647424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 273us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270096.069971:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788270096.070143:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270096.070461:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262647424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270096.074467:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.074663:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253211136 00000100:00100000:3.0:1788270096.074672:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253211136 00000100:00100000:3.0:1788270096.074731:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:3.0:1788270096.074741:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:37287:x1875136253211136:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270096.074782:0:45777:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270096.074891:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:37287:x1875136253211136:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 151us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270096.074900:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:1.0:1788270096.075339:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262647552:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270096.080017:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.080141:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253211264 00000100:00100000:2.0:1788270096.080151:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253211264 00000100:00100000:2.0:1788270096.080249:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 265 00000100:00100000:2.0:1788270096.080261:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:37287:x1875136253211264:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270096.080333:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080350:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080363:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080378:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080386:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080392:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080415:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080437:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080448:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270096.080493:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1788270096.080497:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270096.080511:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080521:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080527:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080533:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080539:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.080542:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080549:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080561:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270096.080564:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.080568:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080574:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e099f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080592:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080598:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080603:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080608:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.080611:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080617:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080624:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1989a751 (ffff98c1429fb900) 00010000:00010000:2.0:1788270096.080626:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.080629:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080634:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e099f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080661:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080668:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080674:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080680:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.080683:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080689:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080696:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270096.080698:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.080701:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.080706:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e099ff lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270096.080777:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:37287:x1875136253211264:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 519us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.080785:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 265 00000100:00100000:2.0:1788270096.086194:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.086341:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253211520 00000100:00100000:0.0:1788270096.086350:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253211520 00000100:00100000:0.0:1788270096.086410:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:0.0:1788270096.086430:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:37287:x1875136253211520:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270096.086449:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270096.086468:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09a06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c95 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086568:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086583:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086594:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270096.086604:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1788270096.086856:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086864:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086870:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086876:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9ee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270096.086881:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086889:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086901:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270096.086903:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270096.086907:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086912:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a0d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086947:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09a06 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c95 expref: 39 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086956:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270096.086958:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270096.086961:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09a06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c95 expref: 39 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.086970:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270096.087030:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:37287:x1875136253211520:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 611us (846us total) trans 30064771289 rc 301/301 00000100:00100000:0.0:1788270096.087088:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:0.0:1788270096.095144:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.095288:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253211648 00000100:00100000:2.0:1788270096.095298:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253211648 00000100:00100000:2.0:1788270096.095353:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:2.0:1788270096.095363:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:37287:x1875136253211648:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270096.095393:0:45778:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270096.095488:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:37287:x1875136253211648:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 127us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.095495:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:1.0:1788270096.097875:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.098490:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253211776 00000100:00100000:2.0:1788270096.098501:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253211776 00000100:00100000:2.0:1788270096.098553:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00100000:2.0:1788270096.098563:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:37287:x1875136253211776:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270096.098580:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270096.098601:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101c9c expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.098684:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.098696:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.098708:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270096.098747:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270096.098752:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270096.098831:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.098854:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c9c expref: 40 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.098870:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c9c expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.098878:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fb900) 00010000:00010000:2.0:1788270096.098880:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270096.098884:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821db400, rc 0) 00000100:00100000:2.0:1788270096.098991:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:37287:x1875136253211776:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 429us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.098999:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00100000:1.0:1788270096.104125:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.104382:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253212032 00000100:00100000:0.0:1788270096.104392:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253212032 00000100:00100000:0.0:1788270096.104453:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 269 00000100:00100000:0.0:1788270096.104464:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:37287:x1875136253212032:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270096.104483:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270096.104486:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788270096.104512:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c9c expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.104529:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fb900) 00010000:00010000:0.0:1788270096.104539:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270096.104554:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ca3 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270096.105224:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc6:0x0], index 1: 0 00010000:00010000:0.0:1788270096.105383:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09a30 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.105396:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09a30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.105407:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09a30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.105456:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09a29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ca3 expref: 41 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.105474:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09a30 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ca3 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.105482:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429f1a00) 00010000:00010000:0.0:1788270096.105485:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270096.105488:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e600, rc 0) 00000100:00100000:0.0:1788270096.105541:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:37287:x1875136253212032:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1079us (1424us total) trans 30064771290 rc 0/0 00000100:00100000:0.0:1788270096.105549:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 269 00000100:00100000:0.0:1788270096.109720:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.113748:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253212160 00000100:00100000:3.0:1788270096.113763:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253212160 00000100:00100000:3.0:1788270096.113884:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 270 00000100:00100000:3.0:1788270096.113896:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:37287:x1875136253212160:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270096.113923:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270096.113949:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101caa expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.114028:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09a45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.114064:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.114076:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270096.114132:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270096.114136:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270096.114154:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.114179:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101caa expref: 42 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.114202:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101caa expref: 41 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.114211:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:3.0:1788270096.114214:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270096.114218:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf600, rc 0) 00000100:00100000:3.0:1788270096.114291:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:37287:x1875136253212160:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 398us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270096.114298:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 270 00000100:00100000:1.0:1788270096.120883:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.121002:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253212416 00000100:00100000:2.0:1788270096.121012:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253212416 00000100:00100000:2.0:1788270096.121229:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 271 00000100:00100000:2.0:1788270096.121241:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:37287:x1875136253212416:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270096.121306:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270096.121334:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09a30 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ca3 expref: 41 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121366:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429f1a00) 00010000:00010000:2.0:1788270096.121384:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e09a45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101caa expref: 40 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121395:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:2.0:1788270096.121402:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270096.121425:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121437:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121446:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121509:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121521:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121528:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121568:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121575:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121582:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121588:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.121593:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121601:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121620:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429fbe00) 00010000:00010000:2.0:1788270096.121624:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.121628:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121634:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a4c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121658:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121665:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121671:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121676:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.121679:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121685:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121693:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d5fc61 (ffff98c1429fb700) 00010000:00010000:2.0:1788270096.121696:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.121698:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.121704:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a53 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d5fc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270096.121796:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:37287:x1875136253212416:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 557us (921us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270096.121803:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 271 00000100:00100000:0.0:1788270096.124379:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.124494:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253212544 00000100:00100000:3.0:1788270096.124504:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253212544 00000100:00100000:3.0:1788270096.124560:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 272 00000100:00100000:3.0:1788270096.124571:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:37287:x1875136253212544:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270096.124590:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270096.124620:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09a5a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cb1 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.124674:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.124688:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.124698:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.124810:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e09a5a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 41 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.124830:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.124840:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:3.0:1788270096.124843:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788270096.124846:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf200, rc 0) 00000100:00100000:3.0:1788270096.124904:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:37287:x1875136253212544:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 336us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270096.124911:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 272 00000100:00100000:1.0:1788270096.130332:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.130539:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253212800 00000100:00100000:3.0:1788270096.130549:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253212800 00000100:00100000:3.0:1788270096.130609:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 273 00000100:00100000:3.0:1788270096.130619:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:37287:x1875136253212800:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788270096.130863:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.130879:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.130891:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270096.131726:0:48110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].8, 88 off8824 00000004:00080000:3.0:1788270096.131739:0:48110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 887838699571ns, next at 888838696135ns, rc = 0 00000004:00010000:3.0:1788270096.131803:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000059f88f1 reply state 000000006b9c1b94 transno 30064771291 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.131823:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.131830:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:3.0:1788270096.131834:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788270096.131837:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270096.131933:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:37287:x1875136253212800:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1314us (1610us total) trans 30064771291 rc 0/0 00000100:00100000:3.0:1788270096.131941:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 273 00000100:00100000:0.0:1788270096.136407:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.140065:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253212928 00000100:00100000:2.0:1788270096.140130:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253212928 00000100:00100000:2.0:1788270096.140195:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:2.0:1788270096.140203:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:37287:x1875136253212928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270096.140223:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270096.140240:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cb8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.140331:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.140342:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.140397:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:2.0:1788270096.140400:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270096.140403:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821daa00, rc 0) 00000100:00100000:2.0:1788270096.140459:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:37287:x1875136253212928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 257us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.140464:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:0.0:1788270096.142596:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.142701:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253213056 00000100:00100000:2.0:1788270096.142709:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253213056 00000100:00100000:2.0:1788270096.142777:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:2.0:1788270096.142786:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2400:x1875136253213056:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788270096.143010:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253213056:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 223us (419us total) trans 30064771100 rc 0/0 00000100:00100000:2.0:1788270096.143018:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00080000:1.0:1788270096.143116:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270096.146107:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.146293:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253213312 00000100:00100000:2.0:1788270096.146303:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253213312 00000100:00100000:2.0:1788270096.146417:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788270096.146428:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:37287:x1875136253213312:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270096.146628:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:37287:x1875136253213312:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 202us (529us total) trans 30064771292 rc 0/0 00000100:00100000:2.0:1788270096.146635:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:3.0:1788270096.150301:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270096.150569:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253213568 00000100:00100000:1.0:1788270096.150578:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253213568 00000100:00100000:1.0:1788270096.150637:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 275 00000100:00100000:1.0:1788270096.150763:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:37287:x1875136253213568:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788270096.150885:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:37287:x1875136253213568:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 238us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270096.150892:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 275 00000100:00100000:0.0:1788270096.153905:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.156841:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253213696 00000100:00100000:3.0:1788270096.156856:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253213696 00000100:00100000:2.0:1788270096.156986:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:2.0:1788270096.156996:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:37287:x1875136253213696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270096.157015:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270096.157034:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09a76 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cbf expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.157115:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a7d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.157818:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a7d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.157833:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a7d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270096.157875:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270096.157892:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a7d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.157918:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09a76 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cbf expref: 46 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.157938:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a7d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cbf expref: 45 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.157947:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:2.0:1788270096.157950:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270096.157954:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821db600, rc 0) 00000100:00100000:2.0:1788270096.158028:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:37287:x1875136253213696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1033us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.158035:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:2.0:1788270096.167404:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.167696:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253213824 00000100:00100000:3.0:1788270096.167707:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253213824 00000100:00100000:3.0:1788270096.167770:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:3.0:1788270096.167779:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253213824:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270096.167795:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270096.167815:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cc6 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270096.167838:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d610, blocks: 0x0 00010000:00010000:3.0:1788270096.167855:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=887s v=(0 0) 00010000:00010000:3.0:1788270096.167859:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270096.167867:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 9 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.167882:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 9 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.167894:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bee00, rc 0) 00000100:00100000:3.0:1788270096.167952:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253213824:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 175us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270096.167958:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:3.0:1788270096.178993:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.179187:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214080 00000100:00100000:0.0:1788270096.179197:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214080 00000100:00100000:0.0:1788270096.179258:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:0.0:1788270096.179267:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:37287:x1875136253214080:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788270096.179374:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:37287:x1875136253214080:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 107us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270096.179382:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:1.0:1788270096.188309:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.188441:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214208 00000100:00100000:3.0:1788270096.188451:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214208 00000100:00100000:3.0:1788270096.188503:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:3.0:1788270096.188512:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:37287:x1875136253214208:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270096.188528:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270096.188545:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ccd expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.188574:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 10 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.188583:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270096.188587:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270096.188591:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 10 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.188620:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 10 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270096.188636:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 10 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270096.188669:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262647680:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270096.188856:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788270096.197876:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.197929:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214336 00000100:00100000:3.0:1788270096.197939:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214336 00010000:00010000:3.0:1788270096.197992:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 11 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270096.198246:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:0.0:1788270096.198689:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262647680:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270096.198719:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 11 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.198738:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf800, rc 0) 00000100:00100000:0.0:1788270096.198801:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:37287:x1875136253214208:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 10290us (10500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270096.198809:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:2.0:1788270096.201884:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253214336:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270096.201916:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270096.202127:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 10 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.202147:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 10 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.202171:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dc1e657/0xc5f5d7a016e09a84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cc6 expref: 10 pid: 47281 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.202188:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270096.202193:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270096.202200:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.202210:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.202252:0:48804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270096.202266:0:48804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262647808:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788270096.204449:0:48804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248109780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270096.210947:0:48804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262647808:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788270096.210977:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270096.211123:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253214336:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 12866us (13255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270096.211145:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:3.0:1788270096.303324:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270096.303538:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214464 00000100:00100000:1.0:1788270096.303547:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214464 00002000:00100000:1.0:1788270096.303589:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (0->4194303) req@ffff98c1448f1f80 x1875136253214464/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.303607:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f1f80 with x1875136253214464 ext(0->4194303) 00002000:00010000:1.0:1788270096.303615:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1448f1f80 00000100:00100000:1.0:1788270096.303662:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:1.0:1788270096.303669:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2403:x1875136253214464:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270096.366685:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253214464:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 62997us (63350us total) trans 30064771101 rc 0/0 00000100:00100000:2.0:1788270096.366703:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00002000:00100000:2.0:1788270096.366720:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (0->4194303) req@ffff98c1448f1f80 x1875136253214464/t30064771101(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270096.366732:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f1f80 with x1875136253214464 ext(0->4194303) 00002000:00010000:2.0:1788270096.366740:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1448f1f80 00000100:00100000:2.0:1788270096.372508:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.372634:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214592 00000100:00100000:3.0:1788270096.372661:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214592 00002000:00100000:3.0:1788270096.372725:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (4194304->8388607) req@ffff98c1440c0700 x1875136253214592/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270096.372734:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c0700 with x1875136253214592 ext(4194304->8388607) 00002000:00010000:3.0:1788270096.372739:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c0700 00000100:00100000:3.0:1788270096.372797:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788270096.372806:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2402:x1875136253214592:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270096.424192:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253214592:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 51375us (51684us total) trans 30064771102 rc 0/0 00000100:00100000:0.0:1788270096.424211:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00002000:00100000:0.0:1788270096.424223:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (4194304->8388607) req@ffff98c1440c0700 x1875136253214592/t30064771102(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270096.424234:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c0700 with x1875136253214592 ext(4194304->8388607) 00002000:00010000:0.0:1788270096.424240:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c0700 00000100:00100000:1.0:1788270096.436617:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.436696:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214720 00000100:00100000:2.0:1788270096.436706:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214720 00002000:00100000:2.0:1788270096.436760:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (8388608->12582911) req@ffff98c275904380 x1875136253214720/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270096.436769:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275904380 with x1875136253214720 ext(8388608->12582911) 00002000:00010000:2.0:1788270096.436775:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275904380 00000100:00100000:2.0:1788270096.436870:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:2.0:1788270096.436879:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253214720:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788270096.482106:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253214720:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 45162us (45434us total) trans 30064771103 rc 0/0 00000100:00100000:1.0:1788270096.482125:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00002000:00100000:1.0:1788270096.482144:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (8388608->12582911) req@ffff98c275904380 x1875136253214720/t30064771103(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.482156:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275904380 with x1875136253214720 ext(8388608->12582911) 00002000:00010000:1.0:1788270096.482176:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275904380 00000100:00100000:2.0:1788270096.499248:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.499446:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214848 00000100:00100000:0.0:1788270096.499458:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214848 00002000:00100000:0.0:1788270096.499514:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (12582912->16777215) req@ffff98c1440c2d80 x1875136253214848/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270096.499528:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c2d80 with x1875136253214848 ext(12582912->16777215) 00002000:00010000:0.0:1788270096.499590:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c2d80 00000100:00100000:0.0:1788270096.499666:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788270096.499673:0:47287:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788270096.499679:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253214848:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270096.499684:0:47287:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788270096.548072:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253214848:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 48351us (48794us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1788270096.548090:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00002000:00100000:1.0:1788270096.548104:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (12582912->16777215) req@ffff98c1440c2d80 x1875136253214848/t30064771104(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.548115:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c2d80 with x1875136253214848 ext(12582912->16777215) 00002000:00010000:1.0:1788270096.548122:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c2d80 00000100:00100000:2.0:1788270096.552107:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270096.552246:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253214976 00000100:00100000:1.0:1788270096.552256:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253214976 00002000:00100000:1.0:1788270096.552307:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (16777216->20971519) req@ffff98c1440c0000 x1875136253214976/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.552319:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c0000 with x1875136253214976 ext(16777216->20971519) 00002000:00010000:1.0:1788270096.552325:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c0000 00000100:00100000:1.0:1788270096.552358:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788270096.552369:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253214976:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788270096.581298:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270096.581323:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262647936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270096.581392:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270096.581524:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262647936 00000100:00100000:2.0:1788270096.581535:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262647936 00000100:00100000:2.0:1788270096.581590:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788270096.581600:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262647936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270096.581632:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1299947520 00000100:00100000:2.0:1788270096.581691:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262647936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270096.581699:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788270096.582215:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262647936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270096.590822:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253214976:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 38443us (38713us total) trans 30064771105 rc 0/0 00000100:00100000:0.0:1788270096.590838:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00002000:00100000:0.0:1788270096.590854:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (16777216->20971519) req@ffff98c1440c0000 x1875136253214976/t30064771105(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270096.590867:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c0000 with x1875136253214976 ext(16777216->20971519) 00002000:00010000:0.0:1788270096.590876:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c0000 00000100:00100000:1.0:1788270096.624164:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.624263:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215104 00000100:00100000:3.0:1788270096.624274:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215104 00002000:00100000:3.0:1788270096.624327:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc6:0x0] (20971520->25165823) req@ffff98c275905880 x1875136253215104/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270096.624342:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275905880 with x1875136253215104 ext(20971520->25165823) 00002000:00010000:3.0:1788270096.624349:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275905880 00000100:00100000:3.0:1788270096.624387:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788270096.624399:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2403:x1875136253215104:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788270096.682713:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253215104:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 58304us (58548us total) trans 30064771106 rc 0/0 00000100:00100000:1.0:1788270096.682729:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00002000:00100000:1.0:1788270096.682743:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc6:0x0] (20971520->25165823) req@ffff98c275905880 x1875136253215104/t30064771106(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.682754:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275905880 with x1875136253215104 ext(20971520->25165823) 00002000:00010000:1.0:1788270096.682761:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275905880 00000100:00100000:2.0:1788270096.725750:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.725875:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215232 00000100:00100000:0.0:1788270096.725884:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215232 00002000:00100000:0.0:1788270096.725935:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (25165824->29360127) req@ffff98c1440c3480 x1875136253215232/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270096.725947:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c3480 with x1875136253215232 ext(25165824->29360127) 00002000:00010000:0.0:1788270096.725953:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c3480 00000100:00100000:0.0:1788270096.726078:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788270096.726089:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253215232:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788270096.769080:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253215232:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 42945us (43292us total) trans 30064771107 rc 0/0 00000100:00100000:3.0:1788270096.769096:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00002000:00100000:3.0:1788270096.769109:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (25165824->29360127) req@ffff98c1440c3480 x1875136253215232/t30064771107(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270096.769120:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c3480 with x1875136253215232 ext(25165824->29360127) 00002000:00010000:3.0:1788270096.769127:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c3480 00000100:00100000:1.0:1788270096.825815:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.826346:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215360 00000100:00100000:0.0:1788270096.826356:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215360 00002000:00100000:0.0:1788270096.826398:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (29360128->33554431) req@ffff98c1451c2d80 x1875136253215360/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270096.826406:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c2d80 with x1875136253215360 ext(29360128->33554431) 00002000:00010000:0.0:1788270096.826411:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1451c2d80 00000100:00100000:0.0:1788270096.826465:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788270096.826473:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2402:x1875136253215360:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00010000:00010000:0.0:1788270096.837590:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270096.864588:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2402:x1875136253215360:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 38103us (38768us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1788270096.864602:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00002000:00100000:1.0:1788270096.864616:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (29360128->33554431) req@ffff98c1451c2d80 x1875136253215360/t30064771108(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.864627:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c2d80 with x1875136253215360 ext(29360128->33554431) 00002000:00010000:1.0:1788270096.864646:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1451c2d80 00000100:00100000:2.0:1788270096.889753:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270096.889840:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215488 00000100:00100000:1.0:1788270096.889848:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215488 00002000:00100000:1.0:1788270096.889891:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (33554432->37748735) req@ffff98c1440c2680 x1875136253215488/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.889900:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c2680 with x1875136253215488 ext(33554432->37748735) 00002000:00010000:1.0:1788270096.889904:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c2680 00000100:00100000:1.0:1788270096.889936:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788270096.889945:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2400:x1875136253215488:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270096.927022:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2400:x1875136253215488:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 37065us (37267us total) trans 30064771109 rc 0/0 00000100:00100000:0.0:1788270096.927036:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00002000:00100000:0.0:1788270096.927460:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (33554432->37748735) req@ffff98c1440c2680 x1875136253215488/t30064771109(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270096.927472:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c2680 with x1875136253215488 ext(33554432->37748735) 00002000:00010000:0.0:1788270096.927478:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c2680 00000100:00100000:2.0:1788270096.945255:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270096.945415:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215616 00000100:00100000:1.0:1788270096.945428:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215616 00002000:00100000:1.0:1788270096.945486:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc6:0x0] (37748736->41943039) req@ffff98c1440c1500 x1875136253215616/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270096.945501:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c1500 with x1875136253215616 ext(37748736->41943039) 00002000:00010000:1.0:1788270096.945507:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c1500 00000100:00100000:1.0:1788270096.945547:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:1.0:1788270096.945559:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2401:x1875136253215616:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270096.954892:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270096.955525:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215744 00000100:00100000:3.0:1788270096.955535:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215744 00002000:00100000:3.0:1788270096.955587:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (41943040->42811391) req@ffff98c276264000 x1875136253215744/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/0 e 0 to 0 dl 1788270107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270096.955598:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276264000 with x1875136253215744 ext(41943040->42811391) 00002000:00010000:3.0:1788270096.955604:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c276264000 00000100:00100000:3.0:1788270096.959303:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:3.0:1788270096.959323:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2400:x1875136253215744:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788270096.983161:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:2401:x1875136253215616:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 37595us (37907us total) trans 30064771110 rc 0/0 00000100:00100000:3.0:1788270096.983179:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00002000:00100000:3.0:1788270096.983193:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc6:0x0] (37748736->41943039) req@ffff98c1440c1500 x1875136253215616/t30064771110(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270096.983204:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c1500 with x1875136253215616 ext(37748736->41943039) 00002000:00010000:3.0:1788270096.983211:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1440c1500 00000100:00100000:3.0:1788270096.987921:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:2400:x1875136253215744:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 28593us (33025us total) trans 30064771111 rc 0/0 00000100:00100000:3.0:1788270096.987935:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00002000:00100000:3.0:1788270096.987950:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (41943040->42811391) req@ffff98c276264000 x1875136253215744/t30064771111(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:512/0 lens 488/448 e 0 to 0 dl 1788270107 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270096.987961:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276264000 with x1875136253215744 ext(41943040->42811391) 00002000:00010000:3.0:1788270096.987967:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c276264000 00000100:00100000:2.0:1788270096.990288:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.990473:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253215872 00000100:00100000:0.0:1788270096.990482:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253215872 00000100:00100000:0.0:1788270096.990533:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 278 00000100:00100000:0.0:1788270096.990542:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:37287:x1875136253215872:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788270096.991837:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771292 is committed 00000004:00080000:3.0:1788270096.991852:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788270096.991887:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788270096.991911:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c1429b8540 refcount 2 committed 0 result 0 batchid 25769803844 00000020:00080000:3.0:1788270096.991916:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c2585d4600 00000020:00080000:3.0:1788270096.991920:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c24300da00 00000020:00080000:3.0:1788270096.991951:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803843 batchid updated 00000100:00100000:3.0:1788270096.992106:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:37287:x1875136253215872:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 1561us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270096.992119:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 278 00000100:00100000:0.0:1788270096.992217:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262648064:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788270096.992255:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803844 committed batchid 25769803843 00000100:00100000:0.0:1788270096.992261:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270096.992295:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262648064 00000100:00100000:0.0:1788270096.992299:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262648064 00000020:00080000:3.0:1788270096.992317:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803843 00000100:00100000:0.0:1788270096.992383:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788270096.992390:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262648064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788270096.992406:0:48230:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:198 count 1 00002000:00010000:0.0:1788270096.992432:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc6:0x0] initial LVB size: 0, mtime: 0x6a96d60f, atime: 0x6a96d60f, ctime: 0x6a96d60f, blocks: 0x0 00010000:00010000:0.0:1788270096.992441:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788270096.992442:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270096.992452:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788270096.992456:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=888s v=(0 0) 00010000:00010000:0.0:1788270096.992460:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788270096.992467:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262648192:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788270096.992467:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.992486:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.992495:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.992504:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270096.992512:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270096.992538:0:48230:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270096.992547:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262648192 00000100:00100000:1.0:1788270096.992552:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262648192 00000100:00100000:1.0:1788270096.992589:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788270096.992597:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262648192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788270096.992666:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262648064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 276us (406us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1788270096.992674:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00002000:00010000:1.0:1788270096.992686:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb size from disk: 0 -> 42811392 00002000:00010000:1.0:1788270096.992691:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb mtime from disk: 0 -> 1788270097 00002000:00010000:1.0:1788270096.992694:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1788270096.992694:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788270096.992698:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb ctime from disk: 1788270096 -> 1788270097 00010000:00010000:0.0:1788270096.992702:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270096.992704:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb blocks from disk: 0 -> 83616 00010000:00010000:0.0:1788270096.992716:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270096.992721:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.992730:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270096.992744:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262648192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (234us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1788270096.992751:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788270096.992772:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270096.992795:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771099 gen 2 00000004:00080000:1.0:1788270096.992800:0:3610:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1448f0700, transno 30064771097 00000004:00080000:1.0:1788270096.992808:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771099 committed transno 30064771099 00000100:00100000:1.0:1788270096.992828:0:3610:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c1451c3800 x1875136262648192/t30064771112(30064771112) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788270112 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788270096.992840:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1451c3800/2, rc 0, transno 30064771112 00000100:00100000:1.0:1788270096.992845:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262648192:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788270096.992897:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.992905:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000184d179d/0xc5f5d7a016e09a92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270096.992930:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270096.992933:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270096.992935:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788270096.992941:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c2b5180/2, rc 0, transno 30064771096 00000100:00100000:1.0:1788270096.992948:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262648064:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788270096.993562:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993572:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993579:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993585:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.993590:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993596:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993608:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1400) 00010000:00010000:2.0:1788270096.993611:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.993616:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993621:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09903 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993651:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993658:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993664:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993669:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.993672:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993677:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993685:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270096.993687:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.993690:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993695:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09918 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993706:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993716:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993721:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993726:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.993729:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993734:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993743:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:2.0:1788270096.993745:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270096.993748:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993753:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e099dc lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993764:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993769:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993775:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993780:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270096.993783:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993789:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993796:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:2.0:1788270096.993799:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270096.993802:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.993808:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09a68 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270096.995299:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270096.995410:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253216000 00000100:00100000:0.0:1788270096.995418:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253216000 00000100:00100000:0.0:1788270096.995467:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:0.0:1788270096.995478:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:2403:x1875136253216000:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788270096.996682:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771112 is committed 00000001:00080000:2.0:1788270096.996693:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771111 is committed 00000100:00100000:0.0:1788270096.996987:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2403:x1875136253216000:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1508us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270096.996997:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:3.0:1788270096.999346:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270096.999396:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253216256 00000100:00100000:2.0:1788270096.999405:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253216256 00000100:00100000:2.0:1788270096.999463:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 279 00000100:00100000:2.0:1788270096.999474:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:37287:x1875136253216256:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270096.999523:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270096.999548:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09a7d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cbf expref: 18 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.999568:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:2.0:1788270096.999574:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270096.999605:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.999618:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.999648:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270096.999768:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c32da9c3 reply state 000000009b4ef84c transno 30064771293 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.999780:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270096.999786:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:2.0:1788270096.999789:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270096.999792:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270096.999890:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:37287:x1875136253216256:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 418us (552us total) trans 30064771293 rc 0/0 00000100:00100000:2.0:1788270096.999897:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 279 00000100:00100000:2.0:1788270097.001515:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.001569:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253216384 00000100:00100000:1.0:1788270097.001576:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253216384 00000100:00100000:1.0:1788270097.001619:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:1.0:1788270097.001691:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253216384:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788270097.001809:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb size from disk: 42811392 -> 42811392 00002000:00010000:1.0:1788270097.001813:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb mtime from disk: 1788270097 -> 1788270095 00002000:00010000:1.0:1788270097.001816:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb atime from disk: 0 -> 1788270095 00002000:00010000:1.0:1788270097.001818:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb ctime from disk: 1788270097 -> 1788270095 00002000:00010000:1.0:1788270097.001821:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc6:0x0] updating lvb blocks from disk: 83616 -> 83616 00000100:00100000:1.0:1788270097.001865:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253216384:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 237us (353us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1788270097.001872:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:1.0:1788270097.002946:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270097.003024:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253216640 00000100:00100000:3.0:1788270097.003030:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253216640 00000100:00100000:3.0:1788270097.003113:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 280 00000100:00080000:1.0:1788270097.003116:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270097.003125:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:37287:x1875136253216640:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788270097.003174:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.003191:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 19 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.003201:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.003232:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 19 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.003245:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 19 pid: 46770 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270097.003259:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262648320:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270097.003320:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788270097.005021:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.005119:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253216768 00000100:00100000:0.0:1788270097.005126:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253216768 00010000:00010000:0.0:1788270097.005155:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 20 pid: 46770 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.005187:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:0.0:1788270097.005197:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253216768:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270097.005211:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270097.005218:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 20 pid: 46770 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.005232:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 20 pid: 46770 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.005252:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:0.0:1788270097.005257:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.005265:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.005273:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.005289:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270097.005696:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09a61 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb1 expref: 20 pid: 46770 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.005713:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262648320:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270097.005730:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005740:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005746:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.005767:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253216768:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 570us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270097.005775:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00010000:00010000:1.0:1788270097.005791:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005804:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005811:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005817:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270097.005821:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005829:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005839:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:1.0:1788270097.005842:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788270097.005846:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.005851:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09aa0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.005891:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:37287:x1875136253216640:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 2770us (2947us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788270097.005900:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 280 00000100:00100000:3.0:1788270097.007347:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.007446:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253216896 00000100:00100000:1.0:1788270097.007453:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253216896 00000100:00100000:1.0:1788270097.007494:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:1.0:1788270097.007503:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253216896:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788270097.007540:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.007560:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.007569:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xc6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788270097.007573:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270097.007577:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.007607:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.007621:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 9 pid: 48231 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.007647:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262648448:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270097.007705:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270097.012367:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262648448:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270097.012405:0:47281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270097.052530:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.052786:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253217024 00000100:00100000:0.0:1788270097.052801:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253217024 00010000:00010000:0.0:1788270097.052842:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 10 pid: 48231 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.052889:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788270097.052900:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253217024:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270097.052917:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270097.052939:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 10 pid: 48231 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.052954:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 10 pid: 48231 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.052980:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09a8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ccd expref: 10 pid: 48231 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.052997:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270097.053002:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270097.053008:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.053024:0:45763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.053115:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270097.053170:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253217024:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 270us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270097.053178:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00010000:00010000:1.0:1788270097.053235:0:47281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053306:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053328:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053341:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053350:0:47281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053356:0:47281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270097.053361:0:47281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053369:0:47281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053380:0:47281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.053388:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b2ae94c/0xc5f5d7a016e09aa7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.053437:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253216896:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 45934us (46094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270097.053449:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:3.0:1788270097.054842:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.054899:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253217280 00000100:00100000:0.0:1788270097.054904:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253217280 00000100:00100000:0.0:1788270097.054939:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 281 00000100:00100000:0.0:1788270097.054947:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:37287:x1875136253217280:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788270097.055017:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.055028:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 18 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.055034:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.055087:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 18 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.055105:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 18 pid: 48110 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.055119:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262648576:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270097.055175:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249eb1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788270097.056602:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.056647:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253217408 00000100:00100000:1.0:1788270097.056654:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253217408 00000100:00100000:0.0:1788270097.056679:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262648576:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270097.056680:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 19 pid: 48110 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.056698:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.056716:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788270097.056724:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253217408:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270097.056734:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270097.056739:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 19 pid: 48110 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056763:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 19 pid: 48110 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056783:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e099d5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c87 expref: 19 pid: 48110 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056798:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:1.0:1788270097.056804:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 18 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056813:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056820:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056831:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.056855:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270097.056872:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.056878:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.056894:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253217408:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 171us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270097.056901:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00010000:00010000:0.0:1788270097.057070:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.057081:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.057087:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.057104:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.057113:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 18 pid: 45776 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.057121:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262648704:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270097.057149:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249eb1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788270097.058436:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.058472:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253217536 00000100:00100000:1.0:1788270097.058478:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253217536 00010000:00010000:1.0:1788270097.058502:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 19 pid: 45776 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.058519:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262648704:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270097.058534:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.058542:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:1.0:1788270097.058550:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253217536:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270097.058560:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270097.058566:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 19 pid: 45776 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.058577:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 19 pid: 45776 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.058593:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09a6f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cb8 expref: 19 pid: 45776 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.058606:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:1.0:1788270097.058611:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.058616:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.058620:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.058648:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270097.058672:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.058679:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270097.058685:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253217536:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 137us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270097.058692:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000001:00080000:0.0:1788270097.058741:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771294 00000001:00080000:0.0:1788270097.058849:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771295 00000001:00080000:0.0:1788270097.058876:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771296 00000100:00100000:0.0:1788270097.058921:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262648832:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788270097.058949:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270097.058981:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249eb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270097.059133:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262648832 00000100:00100000:2.0:1788270097.059137:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262648832 00000100:00100000:2.0:1788270097.059157:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788270097.059161:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262648832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788270097.059219:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262648832:12345-0@lo:1000:mdt00_002.0 Request processed in 57us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270097.059224:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788270097.059284:0:45778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771112 gen 2 00000004:00080000:3.0:1788270097.059289:0:45778:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1451c3800, transno 30064771112 00000100:00100000:3.0:1788270097.059303:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262648832:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788270097.059396:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771297 00000100:00100000:3.0:1788270097.059426:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262648960:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788270097.059448:0:45778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270097.059465:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270097.059478:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262648960 00000100:00100000:1.0:1788270097.059483:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262648960 00000100:00100000:1.0:1788270097.059513:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788270097.059520:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45778:x1875136262648960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788270097.059687:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45778:x1875136262648960:12345-0@lo:1000:mdt00_002.0 Request processed in 166us (236us total) trans 30064771114 rc 0/0 00000100:00100000:1.0:1788270097.059694:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788270097.059863:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:45778:1875136262648960:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788270097.059886:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059892:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059897:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059900:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270097.059903:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059908:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059917:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:3.0:1788270097.059920:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270097.059922:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059926:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ab5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059940:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059943:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059946:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059949:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270097.059951:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059955:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059959:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:3.0:1788270097.059960:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270097.059963:0:45778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059979:0:45778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059984:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.059999:0:45778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be400/0xc5f5d7a016e099ea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101c8e expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270097.060006:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262649088:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270097.060067:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270097.061181:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262649088:192.168.201.42@tcp:105: 00010000:00010000:0.0:1788270097.061195:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061200:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821da400/0xc5f5d7a016e099e3 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061219:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061226:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061232:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061237:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061243:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061248:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061254:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.061257:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061264:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061272:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270097.061275:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270097.061278:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061284:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09abc lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061293:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061297:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061301:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061306:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.061309:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061315:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061323:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270097.061325:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270097.061328:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.061334:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09aae lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.061451:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:37287:x1875136253217280:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 6504us (6609us total) trans 30064771298 rc 0/0 00000100:00100000:0.0:1788270097.061459:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 281 00000020:00080000:0.0:1788270097.061463:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788270097.061693:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270097.061697:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270097.062128:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 8 00000040:00080000:1.0:1788270097.062136:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270097.062620:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.062705:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253217664 00000100:00100000:1.0:1788270097.062710:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253217664 00000100:00100000:1.0:1788270097.062783:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788270097.062793:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:37285:x1875136253217664:12345-192.168.201.42@tcp:49:dd.0 00000100:00100000:1.0:1788270097.062884:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:37285:x1875136253217664:12345-192.168.201.42@tcp:49:dd.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270097.062891:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788270097.064407:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270097.064461:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253217920 00000100:00100000:3.0:1788270097.064466:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253217920 00000100:00100000:3.0:1788270097.064499:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:3.0:1788270097.064506:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:37287:x1875136253217920:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788270097.064735:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x19:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788270097.064767:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771299 00010000:00010000:3.0:1788270097.064798:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.064812:0:45779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.064820:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.064827:0:45779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.064831:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.064835:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270097.064881:0:45779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788270097.064941:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:37287:x1875136253217920:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 434us (536us total) trans 30064771300 rc 0/0 00000100:00100000:3.0:1788270097.064948:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000020:00080000:3.0:1788270097.064952:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270097.065288:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.065324:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218048 00000100:00100000:1.0:1788270097.065329:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218048 00000100:00100000:1.0:1788270097.065362:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:1.0:1788270097.065369:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:37285:x1875136253218048:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270097.065380:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270097.065396:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e09aca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cd4 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.065409:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270097.065415:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270097.065418:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc6:0x0] initial LVB size: 42811392, mtime: 0x6a96d60f, atime: 0x6a96d60f, ctime: 0x6a96d60f, blocks: 0x146a0 00010000:00010000:0.0:1788270097.065423:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270097.065426:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.065432:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=888s v=(0 0) 00010000:00010000:0.0:1788270097.065434:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.065437:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270097.065445:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e09aca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cd4 expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.065446:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:0.0:1788270097.065449:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270097.065453:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.065458:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b6f8ee0/0xc5f5d7a016e09aca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cd4 expref: 9 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.065458:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09ac3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.065469:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a000, rc 0) 00010000:00010000:0.0:1788270097.065471:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270097.065472:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270097.065474:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270097.065498:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:37285:x1875136253218048:12345-192.168.201.42@tcp:101:dd.0 Request processed in 129us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270097.065505:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:1.0:1788270097.066918:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.066967:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218176 00000100:00100000:0.0:1788270097.066972:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218176 00000100:00100000:0.0:1788270097.067020:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 282 00000100:00100000:0.0:1788270097.067026:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:37285:x1875136253218176:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270097.067241:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270097.067257:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09ad1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cdb expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.067286:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09ad8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.067300:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.067311:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.067393:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09ad1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cdb expref: 25 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.067404:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e800/0xc5f5d7a016e09ad8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cdb expref: 24 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.067410:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270097.067412:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270097.067414:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e800, rc 0) 00000100:00100000:0.0:1788270097.067477:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:37285:x1875136253218176:12345-192.168.201.42@tcp:101:dd.0 Request processed in 451us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270097.067481:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 282 00000100:00100000:2.0:1788270097.195783:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.196758:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218304 00000100:00100000:1.0:1788270097.196769:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218304 00002000:00100000:1.0:1788270097.196819:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (46137344->50331647) req@ffff98c276264e00 x1875136253218304/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/0 e 0 to 0 dl 1788270108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270097.196828:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276264e00 with x1875136253218304 ext(46137344->50331647) 00002000:00010000:1.0:1788270097.196834:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c276264e00 00000100:00100000:1.0:1788270097.196864:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:1.0:1788270097.196874:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253218304:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270097.239556:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2402:x1875136253218304:12345-192.168.201.42@tcp:4:dd.0 Request processed in 42673us (43773us total) trans 30064771115 rc 0/0 00000100:00100000:2.0:1788270097.239571:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00002000:00100000:2.0:1788270097.239586:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc6:0x0] (46137344->50331647) req@ffff98c276264e00 x1875136253218304/t30064771115(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/448 e 0 to 0 dl 1788270108 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270097.239598:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276264e00 with x1875136253218304 ext(46137344->50331647) 00002000:00010000:2.0:1788270097.239605:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c276264e00 00000100:00100000:0.0:1788270097.275430:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.275547:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218432 00000100:00100000:1.0:1788270097.275558:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218432 00002000:00100000:1.0:1788270097.275610:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc6:0x0] (50331648->54525951) req@ffff98c26b600380 x1875136253218432/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/0 e 0 to 0 dl 1788270108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270097.275623:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b600380 with x1875136253218432 ext(50331648->54525951) 00002000:00010000:1.0:1788270097.275644:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26b600380 00000100:00100000:1.0:1788270097.275675:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788270097.275686:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253218432:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270097.304806:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253218432:12345-192.168.201.42@tcp:4:dd.0 Request processed in 29110us (29373us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1788270097.304821:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00002000:00100000:2.0:1788270097.304832:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc6:0x0] (50331648->54525951) req@ffff98c26b600380 x1875136253218432/t30064771116(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/448 e 0 to 0 dl 1788270108 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270097.304842:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26b600380 with x1875136253218432 ext(50331648->54525951) 00002000:00010000:2.0:1788270097.304849:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26b600380 00000100:00100000:1.0:1788270097.323797:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.324108:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218560 00000100:00100000:0.0:1788270097.324119:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218560 00002000:00100000:0.0:1788270097.324177:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (54525952->58720255) req@ffff98c27c2c7800 x1875136253218560/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/0 e 0 to 0 dl 1788270108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270097.324189:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c7800 with x1875136253218560 ext(54525952->58720255) 00002000:00010000:0.0:1788270097.324195:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c7800 00000100:00100000:0.0:1788270097.324234:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:0.0:1788270097.324245:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253218560:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270097.358899:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2403:x1875136253218560:12345-192.168.201.42@tcp:4:dd.0 Request processed in 34646us (35103us total) trans 30064771117 rc 0/0 00000100:00100000:2.0:1788270097.358923:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00002000:00100000:2.0:1788270097.358937:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc6:0x0] (54525952->58720255) req@ffff98c27c2c7800 x1875136253218560/t30064771117(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/448 e 0 to 0 dl 1788270108 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270097.358947:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c7800 with x1875136253218560 ext(54525952->58720255) 00002000:00010000:2.0:1788270097.358953:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c7800 00000100:00100000:0.0:1788270097.405223:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.405322:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218816 00000100:00100000:1.0:1788270097.405333:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218816 00000100:00100000:1.0:1788270097.405393:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:1.0:1788270097.405404:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:37285:x1875136253218816:12345-192.168.201.42@tcp:35:dd.0 00000001:00080000:1.0:1788270097.405857:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771301 00000001:00080000:1.0:1788270097.405909:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771302 00000100:00100000:1.0:1788270097.406112:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:37285:x1875136253218816:12345-192.168.201.42@tcp:35:dd.0 Request processed in 709us (896us total) trans 30064771303 rc 0/0 00000100:00100000:1.0:1788270097.406121:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000020:00080000:1.0:1788270097.406127:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788270097.414944:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.415172:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253218944 00000100:00100000:0.0:1788270097.415183:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253218944 00002000:00100000:0.0:1788270097.415236:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (58720256->62914559) req@ffff98c1451c3800 x1875136253218944/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/0 e 0 to 0 dl 1788270108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270097.415247:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c3800 with x1875136253218944 ext(58720256->62914559) 00002000:00010000:0.0:1788270097.415254:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1451c3800 00000100:00100000:0.0:1788270097.415342:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:0.0:1788270097.415354:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253218944:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270097.469852:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253218944:12345-192.168.201.42@tcp:4:dd.0 Request processed in 54487us (54904us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1788270097.469868:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00002000:00100000:2.0:1788270097.469883:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (58720256->62914559) req@ffff98c1451c3800 x1875136253218944/t30064771118(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:513/0 lens 488/448 e 0 to 0 dl 1788270108 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270097.469900:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c3800 with x1875136253218944 ext(58720256->62914559) 00002000:00010000:2.0:1788270097.469907:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1451c3800 00000100:00100000:0.0:1788270097.484292:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270097.484570:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219072 00000100:00100000:1.0:1788270097.484581:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219072 00000100:00100000:1.0:1788270097.484653:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 283 00000100:00100000:1.0:1788270097.484665:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:37297:x1875136253219072:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270097.484688:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270097.484710:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ce2 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.484769:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.484782:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.484795:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270097.484837:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270097.484840:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270097.484858:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.484881:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 29 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.484899:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 28 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270097.484908:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:1.0:1788270097.484912:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270097.484915:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a600, rc 0) 00000100:00100000:1.0:1788270097.485141:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:37297:x1875136253219072:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 478us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270097.485149:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 283 00000100:00100000:1.0:1788270097.491203:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270097.491530:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219200 00000100:00100000:0.0:1788270097.491540:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219200 00000100:00100000:0.0:1788270097.491606:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:0.0:1788270097.491617:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:37297:x1875136253219200:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788270097.491703:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491720:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491733:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491750:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491758:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491765:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491840:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491849:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491856:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270097.491897:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491908:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491914:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491922:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491928:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.491932:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491938:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491949:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:0.0:1788270097.491952:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270097.491956:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491962:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491983:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491990:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.491995:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492000:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.492003:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492009:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492017:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1500) 00010000:00010000:0.0:1788270097.492019:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270097.492022:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492035:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09af4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492150:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492156:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492161:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492165:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.492168:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492174:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492180:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270097.492183:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270097.492185:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.492190:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09afb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270097.492258:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:37297:x1875136253219200:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 643us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270097.492266:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:3.0:1788270097.539670:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270097.539796:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219328 00000100:00100000:2.0:1788270097.539807:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219328 00000100:00100000:0.0:1788270097.540147:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 285 00000100:00100000:0.0:1788270097.540157:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:37304:x1875136253219328:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:0.0:1788270097.540174:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270097.540190:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09b02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ce9 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540238:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540247:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540254:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540265:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540269:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540273:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540328:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09b17 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540333:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09b17 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540337:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09b17 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270097.540365:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 62914560 00000004:00200000:0.0:1788270097.540367:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270097.540399:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09b17 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540407:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09b17 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540413:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540417:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540427:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540433:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.540437:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540445:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540456:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:0.0:1788270097.540459:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270097.540464:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540470:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540483:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540488:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540493:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540498:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270097.540501:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540511:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540518:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff98c1429f1500) 00010000:00010000:0.0:1788270097.540520:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270097.540523:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540526:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09b10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540548:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09b02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce9 expref: 30 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540556:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ea00/0xc5f5d7a016e09b17 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce9 expref: 29 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270097.540560:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff98c14387f500) 00010000:00010000:0.0:1788270097.540562:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270097.540563:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ea00, rc 0) 00000100:00100000:0.0:1788270097.540609:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:37304:x1875136253219328:12345-192.168.201.42@tcp:101:stat.0 Request processed in 454us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270097.540616:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 285 00010000:00010000:0.0:1788270097.860183:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270098.501598:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788270098.628562:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270098.628584:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262649216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270098.628658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270098.628724:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649216 00000100:00100000:1.0:1788270098.628733:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649216 00000100:00100000:1.0:1788270098.628786:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788270098.628797:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262649216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270098.628830:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446363136 avail 1300123648 00000100:00100000:1.0:1788270098.628927:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262649216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270098.628944:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788270098.629088:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262649216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270098.884285:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270098.947156:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270098.947282:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270098.947308:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270098.947333:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270098.947393:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219456 00000100:00100000:0.0:1788270098.947404:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219456 00000100:00100000:0.0:1788270098.947453:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:0.0:1788270098.947464:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253219456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270098.947531:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253219456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270098.947539:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:2.0:1788270098.948399:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270098.948449:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219584 00000100:00100000:1.0:1788270098.948454:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219584 00000100:00100000:1.0:1788270098.948490:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253220096 00000100:00100000:1.0:1788270098.948494:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253220096 00000100:00100000:1.0:1788270098.948521:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:1.0:1788270098.948528:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2403:x1875136253219584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270098.948574:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2403:x1875136253219584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270098.948581:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:1.0:1788270098.948651:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:1.0:1788270098.948661:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253220096:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270098.948688:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253220096:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270098.948695:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00080000:1.0:1788270098.948716:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270098.949293:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270098.949314:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270098.949333:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219840 00000100:00100000:2.0:1788270098.949338:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219840 00000100:00100000:2.0:1788270098.949369:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219968 00000100:00100000:2.0:1788270098.949372:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219968 00000100:00100000:2.0:1788270098.949389:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788270098.949397:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253219840:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270098.949435:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2403:x1875136253219840:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270098.949442:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788270098.949455:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:2.0:1788270098.949460:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2402:x1875136253219968:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270098.949482:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2402:x1875136253219968:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270098.949488:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00080000:2.0:1788270098.949509:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270098.949513:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270098.949519:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253219712 00000100:00100000:2.0:1788270098.949523:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253219712 00000100:00100000:2.0:1788270098.949545:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253220224 00000100:00100000:2.0:1788270098.949547:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253220224 00000100:00100000:2.0:1788270098.949560:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788270098.949565:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253219712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270098.949591:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:2402:x1875136253219712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270098.949611:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788270098.949624:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:2.0:1788270098.949631:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253220224:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270098.949653:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253220224:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270098.949659:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00080000:2.0:1788270098.949674:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270099.140236:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262649344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270099.140303:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140324:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262649600:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140347:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262649856:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140352:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270099.140370:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140370:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262650112:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140384:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262650368:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140400:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262650624:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140412:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140421:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262649728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140431:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262650880:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140441:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270099.140449:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140453:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262650240:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140466:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788270099.140471:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270099.140472:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262649472:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140482:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140494:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140506:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270099.140519:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262649984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140536:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649856 00000100:00100000:1.0:1788270099.140540:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140543:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649856 00000100:00100000:1.0:1788270099.140556:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140573:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140580:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650368 00000100:00100000:1.0:1788270099.140582:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262651008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270099.140583:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650368 00000100:00100000:0.0:1788270099.140608:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650880 00000100:00100000:0.0:1788270099.140611:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650880 00000100:00100000:1.0:1788270099.140613:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.140630:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650752 00000100:00100000:0.0:1788270099.140633:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650752 00000100:00100000:1.0:1788270099.140638:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649344 00000100:00100000:1.0:1788270099.140641:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649344 00000100:00100000:0.0:1788270099.140643:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650496 00000100:00100000:0.0:1788270099.140645:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650496 00000100:00100000:0.0:1788270099.140660:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788270099.140663:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651008 00000100:00100000:1.0:1788270099.140666:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651008 00000100:00100000:0.0:1788270099.140668:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262649856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140678:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788270099.140684:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262649344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270099.140707:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41541312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1788270099.140751:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262649344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.140758:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788270099.140775:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788270099.140780:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262651008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270099.140798:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3379200 granted 125025984 pending 16875520 free 3863896064 avail 3632373760 00000100:00100000:1.0:1788270099.140826:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262651008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270099.140827:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262649856:12345-0@lo:400:kworker.0 Request processed in 161us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.140832:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788270099.140834:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788270099.140847:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788270099.140848:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649600 00000100:00100000:1.0:1788270099.140851:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649600 00000100:00100000:0.0:1788270099.140852:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140868:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650112 00000100:00100000:1.0:1788270099.140870:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650112 00000100:00100000:0.0:1788270099.140876:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262650368:12345-0@lo:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.140881:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649728 00000100:00100000:0.0:1788270099.140882:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788270099.140883:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649728 00000100:00100000:1.0:1788270099.140891:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650240 00000100:00100000:0.0:1788270099.140892:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788270099.140893:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650240 00000100:00100000:0.0:1788270099.140897:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262650880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140904:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788270099.140909:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262649600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140919:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262650880:12345-0@lo:400:kworker.0 Request processed in 22us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270099.140925:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788270099.140932:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262649600:12345-0@lo:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270099.140935:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788270099.140938:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788270099.140940:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262650752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140948:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788270099.140953:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262650112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.140967:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262650752:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.140973:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262650112:12345-0@lo:400:kworker.0 Request processed in 21us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270099.140973:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788270099.140981:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788270099.140983:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788270099.140988:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262650496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.140990:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788270099.140995:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262649728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141012:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262650496:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.141013:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262649728:12345-0@lo:400:kworker.0 Request processed in 18us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.141019:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788270099.141019:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788270099.141030:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788270099.141035:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262650240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.141095:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262650240:12345-0@lo:400:kworker.0 Request processed in 61us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.141101:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788270099.141103:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262649728:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141114:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262650240:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.141121:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649472 00000100:00100000:0.0:1788270099.141122:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.141125:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649472 00000100:00100000:0.0:1788270099.141175:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262649984 00000100:00100000:0.0:1788270099.141179:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262649984 00000100:00100000:0.0:1788270099.141200:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788270099.141206:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262649984:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788270099.141405:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270099.141410:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270099.141412:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270099.141414:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270099.141486:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262649984:12345-0@lo:400:kworker.0 Request processed in 279us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270099.141492:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788270099.141509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.141587:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262649600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141611:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262650112:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141664:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262651136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270099.141699:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270099.141733:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262649984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141743:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262650496:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141755:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262651008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270099.141765:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262649856:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141774:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262650368:0@lo:400:kworker.0 00010000:00080000:0.0:1788270099.141784:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1494ef800 x1875136262650880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788270099.141800:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262650880:0@lo:400:kworker.0 00000100:00100000:0.0:1788270099.141812:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262649344:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788270099.141922:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270099.141927:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270099.141949:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 8 count 8 00000040:00080000:0.0:1788270099.141956:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270099.142006:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651136 00000100:00100000:0.0:1788270099.142010:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651136 00000100:00100000:0.0:1788270099.142063:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788270099.142070:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262651136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270099.142081:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3379200 granted 125025984 pending 16875520 free 3863896064 avail 3632373760 00000100:00100000:0.0:1788270099.142113:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262651136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270099.142120:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788270099.142146:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262651136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270099.142773:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788270099.142783:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262649472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270099.142843:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262649472:12345-0@lo:400:kworker.0 Request processed in 62us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270099.142849:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788270099.142887:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262649472:0@lo:400:kworker.0 00000100:00100000:2.0:1788270099.144479:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262650624 00000100:00100000:2.0:1788270099.144490:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262650624 00000100:00100000:2.0:1788270099.144605:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788270099.144614:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262650624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270099.144682:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262650624:12345-0@lo:400:kworker.0 Request processed in 69us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270099.144689:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788270099.144734:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98c1494ee300 x1875136262650624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788270115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788270099.144749:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262650624:0@lo:400:kworker.0 00000100:00080000:0.0:1788270099.144798:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788270099.911974:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270100.023336:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270100.023526:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253220352 00000100:00100000:2.0:1788270100.023535:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253220352 00000100:00100000:2.0:1788270100.023670:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 286 00000100:00100000:2.0:1788270100.023682:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:37248:x1875136253220352:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788270100.023789:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:37248:x1875136253220352:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 109us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270100.023797:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 286 00000100:00080000:1.0:1788270100.023981:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270100.024991:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270100.025085:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253220480 00000100:00100000:2.0:1788270100.025092:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253220480 00000100:00100000:2.0:1788270100.025144:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 287 00000100:00100000:2.0:1788270100.025153:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:37248:x1875136253220480:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788270100.025236:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:37248:x1875136253220480:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270100.025248:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 287 00000100:00080000:1.0:1788270100.025534:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270100.028203:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270100.028371:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253220736 00000100:00100000:3.0:1788270100.028380:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253220736 00000100:00100000:3.0:1788270100.028472:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270100.028483:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:37248:x1875136253220736:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270100.028816:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:37248:x1875136253220736:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 335us (620us total) trans 30064771304 rc 0/0 00000100:00100000:3.0:1788270100.028824:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270100.129145:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270100.129429:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253220864 00000100:00100000:2.0:1788270100.129438:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253220864 00000100:00080000:1.0:1788270100.129502:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270100.129516:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 288 00000100:00100000:2.0:1788270100.129529:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:37749:x1875136253220864:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:2.0:1788270100.129547:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270100.129564:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e09b1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cf0 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270100.129637:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270100.129651:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270100.129662:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270100.129702:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270100.129704:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270100.129722:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270100.129740:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db200/0xc5f5d7a016e09b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 7 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270100.129754:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 6 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270100.129759:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:2.0:1788270100.129761:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270100.129764:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821daa00, rc 0) 00000100:00100000:2.0:1788270100.129815:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:37749:x1875136253220864:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 290us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270100.129819:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 288 00010000:00010000:0.0:1788270100.932198:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270101.191150:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270101.191168:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262651264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270101.191222:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270101.191260:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651264 00000100:00100000:1.0:1788270101.191265:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651264 00000100:00100000:1.0:1788270101.191302:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788270101.191307:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262651264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270101.191329:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41541312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1788270101.191360:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262651264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270101.191366:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788270101.191387:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270101.191419:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262651264:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788270101.192263:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771096 is committed 00000001:00080000:2.0:1788270101.192271:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771094 is committed 00000001:02000400:0.0:1788270101.533826:0:49864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 09:41:40 (1788270100) 00000100:00100000:1.0:1788270101.700839:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262651392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270101.700909:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270101.702408:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651392 00000100:00100000:3.0:1788270101.702421:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651392 00000100:00100000:3.0:1788270101.702476:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788270101.702487:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262651392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270101.702525:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1299947520 00000100:00100000:3.0:1788270101.702624:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262651392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270101.702634:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788270101.702678:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262651392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270101.958480:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270102.456133:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270102.456241:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253221120 00000100:00100000:3.0:1788270102.456252:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253221120 00000100:00100000:3.0:1788270102.456460:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 289 00000100:00100000:3.0:1788270102.456472:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:38033:x1875136253221120:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270102.456505:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270102.456528:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09b2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cf7 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456609:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456621:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456633:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456647:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456653:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456658:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456753:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e09b41 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456765:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e09b41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456772:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e09b41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270102.456781:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788270102.456867:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456875:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456881:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456887:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270102.456891:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456898:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456909:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:3.0:1788270102.456911:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270102.456916:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456921:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09b33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456932:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456939:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456945:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456950:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270102.456952:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456958:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456965:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429f9300) 00010000:00010000:3.0:1788270102.456968:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270102.456970:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.456975:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.457274:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09b2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf7 expref: 33 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.457296:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e09b41 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf7 expref: 32 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.457304:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:3.0:1788270102.457306:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270102.457309:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be800, rc 0) 00000100:00100000:3.0:1788270102.457362:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38033:x1875136253221120:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 893us (1239us total) trans 30064771305 rc 0/0 00000100:00100000:3.0:1788270102.457369:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 289 00000001:00080000:0.0:1788270102.460228:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771305 is committed 00000020:00080000:0.0:1788270102.460254:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c1440a63c0 refcount 2 committed 0 result 0 batchid 25769803845 00000020:00080000:0.0:1788270102.460259:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c1440a6d80 00000020:00080000:0.0:1788270102.460263:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c276453500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14422d400 00000020:00080000:0.0:1788270102.460301:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803844 batchid updated 00010000:00010000:0.0:1788270102.460319:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.460330:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.460338:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.460344:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270102.460348:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.460356:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.460371:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff98c1429fd300) 00010000:00010000:0.0:1788270102.460373:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270102.460377:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.460383:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09a99 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788270102.460626:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803845 committed batchid 25769803844 00000020:00080000:3.0:1788270102.460682:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803844 00000100:00100000:0.0:1788270102.461895:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.461973:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253221248 00000100:00100000:2.0:1788270102.461982:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253221248 00000100:00100000:2.0:1788270102.462065:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 290 00000100:00100000:2.0:1788270102.462076:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38033:x1875136253221248:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788270102.462175:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38033:x1875136253221248:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.462194:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 290 00000100:00100000:0.0:1788270102.462867:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270102.463035:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253221376 00000100:00100000:3.0:1788270102.463069:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253221376 00000100:00100000:3.0:1788270102.463118:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788270102.463127:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253221376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270102.463138:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270102.463159:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e09b41 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf7 expref: 18 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.463187:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:3.0:1788270102.463192:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270102.463224:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253221376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 99us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270102.463231:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788270102.464943:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.465014:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253221504 00000100:00100000:2.0:1788270102.465022:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253221504 00000100:00080000:1.0:1788270102.465108:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270102.465112:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270102.466673:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 291 00000100:00100000:2.0:1788270102.466688:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:38033:x1875136253221504:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788270102.466795:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:38033:x1875136253221504:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 110us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.466803:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 291 00000100:00100000:0.0:1788270102.546143:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.546306:0:45785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253221632 00000100:00100000:2.0:1788270102.546315:0:45785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253221632 00000100:00100000:2.0:1788270102.546391:0:45785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788270102.546401:0:45785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:38048:x1875136253221632:12345-192.168.201.42@tcp:700:mkdir.0 00000100:00100000:2.0:1788270102.546486:0:45785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:38048:x1875136253221632:12345-192.168.201.42@tcp:700:mkdir.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.546492:0:45785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:0.0:1788270102.548066:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.548126:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253221888 00000100:00100000:2.0:1788270102.548134:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253221888 00000100:00100000:2.0:1788270102.548216:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 292 00000100:00100000:2.0:1788270102.548226:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:38048:x1875136253221888:12345-192.168.201.42@tcp:36:mkdir.0 00000100:00100000:2.0:1788270102.548327:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:46770:1875136262651520:0@lo:900:mdt00_003.0 00000100:00100000:2.0:1788270102.548370:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270102.548420:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.548491:0:45788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651520 00000100:00100000:1.0:1788270102.548494:0:45788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651520 00000100:00100000:1.0:1788270102.548520:0:45788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788270102.548525:0:45788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:46770:x1875136262651520:12345-0@lo:900:mdt00_003.0 00000100:00100000:1.0:1788270102.548634:0:45788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:46770:x1875136262651520:12345-0@lo:900:mdt00_003.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.548641:0:45788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788270102.549074:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:46770:1875136262651520:0@lo:900:mdt00_003.0 00000100:00100000:3.0:1788270102.549128:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262651648:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.549162:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.549196:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788270102.549254:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651648 00000100:00100000:0.0:1788270102.549259:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651648 00000100:00100000:0.0:1788270102.549388:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788270102.549398:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262651648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788270102.549464:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262651648:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270102.549472:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788270102.549520:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262651648:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.549572:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262651776:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.549591:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.549754:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.549929:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651776 00000100:00100000:2.0:1788270102.549934:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651776 00000100:00100000:2.0:1788270102.549953:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788270102.549957:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262651776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788270102.550011:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262651776:12345-0@lo:1000:mdt00_003.0 Request processed in 53us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.550015:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788270102.550177:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262651776:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.550213:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262651904:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.550235:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.550255:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802840 going to sleep for 11 seconds 00000100:00100000:0.0:1788270102.550370:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262651904 00000100:00100000:0.0:1788270102.550375:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262651904 00000100:00100000:0.0:1788270102.550394:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788270102.550400:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262651904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788270102.550458:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262651904:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (222us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270102.550462:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788270102.550514:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262651904:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788270102.550576:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.550587:0:46770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.550597:0:46770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270102.550608:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652032:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1788270102.550633:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.550655:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.550706:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262652032 00000100:00100000:2.0:1788270102.550710:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262652032 00000100:00100000:2.0:1788270102.550732:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788270102.550737:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:46770:x1875136262652032:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788270102.550746:0:45781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.550759:0:45781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e09b4f expref: -99 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.550782:0:45781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.550791:0:45781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.550799:0:45781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 6 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.550819:0:45781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.550831:0:45781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 5 pid: 48110 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270102.550846:0:45781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:45781:1875136262652160:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270102.550970:0:45781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.550978:0:45781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 16 pid: 45777 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270102.550987:0:45781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:45781:1875136262652288:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270102.551008:0:45781:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.555150:0:45781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:45781:1875136262652160:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270102.555169:0:45781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:45781:1875136262652288:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270102.555203:0:45781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 6 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.555218:0:45781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:2.0:1788270102.555221:0:45781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270102.555226:0:45781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 6 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.555236:0:45781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821db400, rc 0) 00000100:00100000:2.0:1788270102.555424:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46770:x1875136262652032:12345-0@lo:101:mdt00_003.0 Request processed in 4684us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.555432:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788270102.555604:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270102.555635:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270102.555703:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222016 00000100:00100000:1.0:1788270102.555710:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222016 00010000:00010000:1.0:1788270102.555757:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 6 pid: 48110 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270102.555778:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222144 00000100:00100000:1.0:1788270102.555781:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222144 00010000:00010000:1.0:1788270102.555789:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 17 pid: 45777 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270102.555802:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788270102.555808:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253222016:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270102.555819:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270102.555823:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 6 pid: 48110 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555831:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 6 pid: 48110 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555846:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cf0 expref: 6 pid: 48110 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555857:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:1.0:1788270102.555860:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 5 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555866:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270102.555913:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253222016:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 104us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.555920:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788270102.555936:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:1.0:1788270102.555943:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253222144:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270102.555950:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270102.555956:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 17 pid: 45777 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555965:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 17 pid: 45777 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555978:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ce2 expref: 17 pid: 45777 timeout: 994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555989:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:1.0:1788270102.555992:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 5 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.555999:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 5 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556005:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 5 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556028:0:48804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 5 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270102.556065:0:48804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:48804:1875136262652416:0@lo:105: 00000100:00100000:1.0:1788270102.556093:0:48804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270102.556116:0:48804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248bd1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.556135:0:48113:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788270102.556144:0:48113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262652416 00000100:00100000:1.0:1788270102.556148:0:48113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262652416 00000100:00100000:1.0:1788270102.556174:0:48113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788270102.556181:0:48113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ebdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:48804:x1875136262652416:12345-0@lo:105: 00010000:00010000:1.0:1788270102.556191:0:48113:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556200:0:48113:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556208:0:48113:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556215:0:48113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556223:0:48113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556233:0:48113:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.556245:0:48113:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98c27a0be800) 00000100:00100000:1.0:1788270102.556274:0:48113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ebdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:48804:x1875136262652416:12345-0@lo:105: Request processed in 94us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.556280:0:48113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788270102.556560:0:48804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:48804:1875136262652416:0@lo:105: 00010000:00010000:1.0:1788270102.556573:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270102.556613:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253222144:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 669us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.556620:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00080000:3.0:1788270102.556850:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270102.558142:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652032:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788270102.558248:0:46770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270102.558270:0:46770:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788270102.558303:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.558309:0:46770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.558315:0:46770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270102.558338:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652544:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788270102.558373:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270102.558401:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.558465:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262652544 00000100:00100000:2.0:1788270102.558471:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262652544 00000100:00100000:2.0:1788270102.558512:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788270102.558522:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:46770:x1875136262652544:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788270102.558546:0:45782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.558564:0:45782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e09b5d expref: -99 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.558588:0:45782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b5d expref: 7 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.558600:0:45782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b5d expref: 7 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.558608:0:45782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff98c1429fb300) 00010000:00010000:2.0:1788270102.558672:0:45782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270102.558677:0:45782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbe00, rc 0) 00000100:00100000:2.0:1788270102.558716:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652544:12345-0@lo:101:mdt00_003.0 Request processed in 193us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.558720:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788270102.558758:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652544:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788270102.558772:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.558782:0:46770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270102.558793:0:46770:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788270102.558818:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652672:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788270102.558838:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270102.558859:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242bf79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.558918:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262652672 00000100:00100000:2.0:1788270102.558922:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262652672 00000100:00100000:2.0:1788270102.558951:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788270102.558956:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788270102.559003:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652672:12345-0@lo:1000:mdt00_003.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.559007:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788270102.559120:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652672:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788270102.559147:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652800:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788270102.559163:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270102.559180:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242bf7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.559228:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262652800 00000100:00100000:2.0:1788270102.559232:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262652800 00000100:00100000:2.0:1788270102.559354:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788270102.559362:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788270102.559465:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652800:12345-0@lo:1000:mdt00_003.0 Request processed in 104us (300us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270102.559470:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788270102.559614:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652800:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.559670:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652928:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.559695:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.559747:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.559776:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262652928 00000100:00100000:1.0:1788270102.559779:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262652928 00000100:00100000:1.0:1788270102.559827:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788270102.559832:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788270102.559927:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262652928:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (230us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788270102.559934:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788270102.560017:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262652928:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.560066:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653056:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.560081:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.560097:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428020c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.560136:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262653056 00000100:00100000:2.0:1788270102.560139:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262653056 00000100:00100000:2.0:1788270102.560161:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788270102.560165:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788270102.560275:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653056:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.560280:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788270102.560454:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653056:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.560485:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653184:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.560500:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.560553:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270102.560588:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262653184 00000100:00100000:0.0:1788270102.560592:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262653184 00000100:00100000:0.0:1788270102.560640:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788270102.560644:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653184:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788270102.560701:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653184:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270102.560708:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788270102.560758:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653184:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.560788:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653312:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.560803:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.562237:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428020c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.562335:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262653312 00000100:00100000:2.0:1788270102.562341:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262653312 00000100:00100000:1.0:1788270102.562386:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788270102.562396:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788270102.562469:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653312:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.562474:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788270102.562530:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653312:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788270102.562655:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653440:0@lo:700:mdt00_003.0 00000100:00100000:3.0:1788270102.562678:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.562705:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802180 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.562755:0:45786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262653440 00000100:00100000:1.0:1788270102.562760:0:45786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262653440 00000100:00100000:1.0:1788270102.562795:0:45786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788270102.562803:0:45786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653440:12345-0@lo:700:mdt00_003.0 00000100:00100000:1.0:1788270102.562845:0:45786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:46770:x1875136262653440:12345-0@lo:700:mdt00_003.0 Request processed in 43us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.562852:0:45786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788270102.562962:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262653440:0@lo:700:mdt00_003.0 00000040:00080000:3.0:1788270102.563068:0:46770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270102.563083:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].3, 64 off32960 00000004:00080000:3.0:1788270102.563088:0:46770:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c142802180 with version 5 00000040:00080000:3.0:1788270102.563128:0:46770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788270102.563135:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].4, 64 off33024 00000004:00080000:3.0:1788270102.563138:0:46770:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c142802e40 with version 6 00000004:00080000:1.0:1788270102.563363:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 5 rpc_version 5 00000020:00100000:1.0:1788270102.563386:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788270102.563394:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c147209c00 x1875136262653696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788270102.563409:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262653696:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788270102.563430:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270102.563444:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248bd1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.563453:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262653696 00000100:00100000:1.0:1788270102.563455:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262653696 00000100:00100000:1.0:1788270102.563469:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788270102.563472:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262653696:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1788270102.567154:0:46770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788270102.567568:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].2, 64 off32896 00000040:00080000:1.0:1788270102.567784:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400032e1:0x1:0x0].1, 992 off33760 00000001:00080000:0.0:1788270102.567999:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771306 is committed 00000020:00080000:0.0:1788270102.568005:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803845 batchid updated 00000020:00080000:3.0:1788270102.568071:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803845 00000020:00080000:3.0:1788270102.568084:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803845 00000040:00080000:1.0:1788270102.568213:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e2:0x1:0x0].1, 1144 off33912 00000004:00080000:1.0:1788270102.568221:0:46770:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c142802840 with version 7 00000100:00100000:1.0:1788270102.568327:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262653696:12345-0@lo:1000:osp_up0-1.0 Request processed in 4851us (4892us total) trans 30064771306 rc 0/0 00000100:00100000:1.0:1788270102.568335:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:3.0:1788270102.568840:0:46515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771306 committed transno 30064771306 00000100:00100000:3.0:1788270102.568845:0:46515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771306 gen 2 00000100:00100000:3.0:1788270102.568863:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262653696:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788270102.568898:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 6 rpc_version 6 00000020:00100000:3.0:1788270102.568922:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788270102.568930:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c27fa49180 x1875136262653952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788270102.568950:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262653952:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788270102.568992:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.569179:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802180 going to sleep for 11 seconds 00000100:00100000:0.0:1788270102.569231:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262653952 00000100:00100000:0.0:1788270102.569237:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262653952 00000100:00100000:0.0:1788270102.569265:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788270102.569270:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262653952:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1788270102.577770:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771307 is committed 00000100:00100000:0.0:1788270102.578507:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262653952:12345-0@lo:1000:osp_up0-1.0 Request processed in 9232us (9510us total) trans 30064771307 rc 0/0 00000100:00100000:0.0:1788270102.578517:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:3.0:1788270102.578820:0:46515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771307 committed transno 30064771307 00000100:00100000:3.0:1788270102.578826:0:46515:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771307 gen 2 00000100:00100000:3.0:1788270102.578845:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262653952:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788270102.578868:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 7 rpc_version 7 00000020:00100000:3.0:1788270102.578897:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788270102.578905:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c1494a4700 x1875136262654208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788270102.578927:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262654208:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788270102.578972:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.579141:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.579231:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654208 00000100:00100000:1.0:1788270102.579395:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654208 00000100:00100000:1.0:1788270102.579446:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788270102.579456:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262654208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788270102.584079:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:46515:x1875136262654208:12345-0@lo:1000:osp_up0-1.0 Request processed in 4617us (5098us total) trans 30064771308 rc 0/0 00000100:00100000:1.0:1788270102.584093:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788270102.584862:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262654208:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788270102.585002:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585108:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585125:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270102.585143:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c151d4ca reply state 000000001e36c6ad transno 30064771073 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585151:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585156:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:1.0:1788270102.585159:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270102.585162:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788270102.585167:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x1:0x0]: returning size 4096 00000004:00080000:1.0:1788270102.585173:0:46770:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788270102.585183:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585190:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585195:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585259:0:46770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788270102.585266:0:46770:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788270102.585272:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.585280:0:46770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270102.585391:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:38048:x1875136253221888:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 37165us (37327us total) trans 30064771073 rc 0/0 00000100:00100000:1.0:1788270102.585400:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 292 00010000:00010000:0.0:1788270102.585592:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270102.585600:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.585610:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be800 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:0.0:1788270102.585615:0:45764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270102.585622:0:45764:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.585656:0:45764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.585663:0:45764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788270102.585768:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262654336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270102.585813:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270102.585873:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.585881:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c27a0be800/0xc5f5d7a016e09b4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e09b56 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.585906:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270102.585907:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270102.585909:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270102.585967:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654336 00000100:00100000:2.0:1788270102.585974:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654336 00000100:00100000:2.0:1788270102.586031:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788270102.586056:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3608:x1875136262654336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270102.586067:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270102.586080:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e09b4f expref: 8 pid: 45781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.586089:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c14387f800) 00010000:00010000:2.0:1788270102.586095:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270102.586278:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262654336:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.586297:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788270102.586393:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262654336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788270102.594985:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270102.595096:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222272 00000100:00100000:3.0:1788270102.595105:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222272 00000100:00100000:3.0:1788270102.595154:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 293 00000100:00100000:3.0:1788270102.595164:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:38049:x1875136253222272:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270102.595183:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270102.595207:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09b72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101cfe expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.595271:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.595385:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.595398:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270102.595435:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270102.595438:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270102.595454:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.595474:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09b72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cfe expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.595486:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cfe expref: 17 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.595492:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270102.595494:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270102.595496:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be200, rc 0) 00000100:00100000:3.0:1788270102.595556:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:38049:x1875136253222272:12345-192.168.201.42@tcp:101:dd.0 Request processed in 394us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270102.595563:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 293 00000040:00080000:3.0:1788270102.596837:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788270102.598138:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.598203:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222400 00000100:00100000:2.0:1788270102.598213:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222400 00000100:00100000:2.0:1788270102.598278:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 294 00000100:00100000:2.0:1788270102.598288:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:38049:x1875136253222400:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270102.598309:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.598328:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d05 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598395:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598410:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598420:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598432:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598440:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09b5d expref: 6 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598446:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.598470:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e09b5d expref: 6 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270102.598480:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262654464:0@lo:104: 00000100:00100000:2.0:1788270102.598515:0:45777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.598557:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654464 00000100:00100000:3.0:1788270102.598561:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654464 00000100:00100000:2.0:1788270102.598563:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270102.598600:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788270102.598608:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:45777:x1875136262654464:12345-0@lo:104: 00010000:00010000:3.0:1788270102.598620:0:45759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.598676:0:45759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270102.598682:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:45777:x1875136262654464:12345-0@lo:104: Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270102.598689:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788270102.598797:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270102.598805:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.598813:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fa00 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:0.0:1788270102.598819:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270102.598827:0:45765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270102.598842:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262654464:0@lo:104: 00010000:00010000:0.0:1788270102.598851:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.598856:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788270102.598858:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270102.598904:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262654592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788270102.598938:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270102.598996:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.599006:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c26bf9fa00/0xc5f5d7a016e09b5d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e09b64 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270102.599034:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270102.599036:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270102.599060:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270102.599198:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654592 00000100:00100000:3.0:1788270102.599204:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654592 00010000:00010000:3.0:1788270102.599232:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc5f5d7a016e09b5d expref: 7 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270102.599302:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788270102.599311:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262654592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788270102.599321:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1788270102.600978:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771308 is committed 00010000:00010000:3.0:1788270102.601116:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbe00/0xc5f5d7a016e09b64 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e09b5d expref: 6 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.601133:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff98c1429fb300) 00010000:00010000:3.0:1788270102.601138:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.601147:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.601152:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.601174:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270102.601207:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.601214:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270102.601231:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262654592:12345-0@lo:103:ldlm_bl.0 Request processed in 1921us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270102.601239:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788270102.601487:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:45777:1875136262654720:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788270102.601525:0:45777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270102.601561:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2514ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1788270102.602728:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654720 00000100:00100000:0.0:1788270102.602735:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654720 00000100:00100000:0.0:1788270102.602775:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788270102.602783:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45777:x1875136262654720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788270102.602884:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45777:x1875136262654720:12345-0@lo:1000:mdt00_001.0 Request processed in 101us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270102.602892:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788270102.602973:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:45777:1875136262654720:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788270102.602973:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262654592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788270102.603020:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09b95 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603033:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09b95 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603154:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09b95 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270102.603181:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09b95 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603193:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603199:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603206:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603211:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270102.603214:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603221:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603231:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270102.603234:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270102.603397:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603406:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603419:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603425:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603431:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603435:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270102.603438:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603448:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603456:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff98c1429fb300) 00010000:00010000:2.0:1788270102.603458:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270102.603461:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603466:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09b8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603499:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09b80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d05 expref: 19 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603513:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dae00/0xc5f5d7a016e09b95 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d05 expref: 18 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.603521:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c1429fb700) 00010000:00010000:2.0:1788270102.603523:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270102.603525:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dae00, rc 0) 00000100:00100000:2.0:1788270102.603627:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38049:x1875136253222400:12345-192.168.201.42@tcp:101:dd.0 Request processed in 5341us (5492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.603635:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 294 00000100:00100000:1.0:1788270102.605652:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.605734:0:45788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222528 00000100:00100000:2.0:1788270102.605742:0:45788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222528 00000100:00100000:2.0:1788270102.605826:0:45788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788270102.605835:0:45788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38049:x1875136253222528:12345-192.168.201.42@tcp:900:dd.0 00000100:00100000:2.0:1788270102.605914:0:45788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38049:x1875136253222528:12345-192.168.201.42@tcp:900:dd.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.605921:0:45788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788270102.607495:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270102.607612:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222656 00000100:00100000:3.0:1788270102.607619:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222656 00000100:00100000:3.0:1788270102.607695:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 295 00000100:00100000:3.0:1788270102.607706:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:38049:x1875136253222656:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270102.607723:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270102.607745:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09b9c lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d0c expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.607802:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09ba3 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.607815:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09ba3 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.607828:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09ba3 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270102.607879:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270102.607895:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788270102.607948:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e09b9c lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d0c expref: 9 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.607966:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf400/0xc5f5d7a016e09ba3 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d0c expref: 8 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.607974:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:3.0:1788270102.607978:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788270102.607981:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf400, rc 0) 00000100:00100000:3.0:1788270102.608031:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:38049:x1875136253222656:12345-192.168.201.42@tcp:101:dd.0 Request processed in 326us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270102.608067:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 295 00000100:00100000:3.0:1788270102.610155:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.610261:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253222912 00000100:00100000:2.0:1788270102.610268:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253222912 00000100:00100000:2.0:1788270102.610309:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 296 00000100:00100000:2.0:1788270102.610319:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:38049:x1875136253222912:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270102.610334:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.610486:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09baa lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d13 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.610591:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.610600:0:45776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.610610:0:45776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270102.610642:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262654848:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788270102.610686:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270102.610764:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c249159300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270102.615778:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654848 00000100:00100000:1.0:1788270102.615795:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654848 00000100:00100000:1.0:1788270102.615924:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788270102.615936:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:45776:x1875136262654848:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788270102.615962:0:46517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270102.615985:0:46517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e09bb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e09bb1 expref: -99 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.616015:0:46517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e09bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e09bb1 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.616027:0:46517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b200/0xc5f5d7a016e09bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e09bb1 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270102.616035:0:46517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270102.616053:0:46517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270102.616057:0:46517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b200, rc 0) 00000100:00100000:1.0:1788270102.616141:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262654848:12345-0@lo:101:mdt00_000.0 Request processed in 208us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270102.616148:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788270102.616247:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771308 gen 2 00000004:00080000:3.0:1788270102.616254:0:45776:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771308 committed transno 30064771308 00000100:00100000:3.0:1788270102.616307:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262654848:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788270102.616324:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09bb8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616337:0:45776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e09bb8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270102.616356:0:45776:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788270102.616364:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09bb8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616372:0:45776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c2821db200/0xc5f5d7a016e09bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e09bb8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616431:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 3/0,1 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616442:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616457:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616472:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616478:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.616487:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270102.616616:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262654976:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270102.616649:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270102.616677:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142802840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270102.616951:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262654976 00000100:00100000:2.0:1788270102.616956:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262654976 00000100:00100000:2.0:1788270102.616996:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788270102.617009:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262654976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270102.617086:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262654976:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.617093:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788270102.620746:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262654976:0@lo:1000:mdt00_000.0 00000004:00080000:3.0:1788270102.621031:0:45776:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xa3:0x0], count =31 00000004:00080000:3.0:1788270102.621056:0:45776:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0xa3:0x0]+31 in llog 00000004:00080000:3.0:1788270102.621077:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc2:0x0], index 1: 0 00010000:00010000:3.0:1788270102.621225:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09bcd lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621300:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09bcd lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621313:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09bcd lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621348:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621354:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 2/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621362:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621367:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270102.621372:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621379:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621390:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:3.0:1788270102.621393:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270102.621397:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621403:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e09bbf lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270102.621414:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d89cb70 reply state 00000000b09e2d9f transno 30064771074 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621424:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621430:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x852f64c2 (ffff98c1429f8900) 00010000:00010000:3.0:1788270102.621432:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270102.621435:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270102.621467:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09baa lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d13 expref: 11 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621480:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09bcd lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d13 expref: 10 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270102.621487:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:3.0:1788270102.621489:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270102.621492:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf800, rc 0) 00000100:00100000:3.0:1788270102.621564:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:38049:x1875136253222912:12345-192.168.201.42@tcp:101:dd.0 Request processed in 11246us (11416us total) trans 30064771074 rc 0/0 00000100:00100000:3.0:1788270102.621572:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 296 00000100:00100000:1.0:1788270102.627444:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.627592:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253223040 00000100:00100000:2.0:1788270102.627603:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253223040 00000100:00080000:3.0:1788270102.627656:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270102.627689:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:2.0:1788270102.627701:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:38049:x1875136253223040:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270102.627719:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.627739:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d1a expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270102.627765:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270102.627787:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=894s v=(0 0) 00010000:00010000:2.0:1788270102.627792:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270102.627801:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 18 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.627818:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 18 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.627830:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821db400, rc 0) 00000100:00100000:2.0:1788270102.627890:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38049:x1875136253223040:12345-192.168.201.42@tcp:101:dd.0 Request processed in 191us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.627897:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:1.0:1788270102.689709:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.690013:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253223168 00000100:00100000:2.0:1788270102.690023:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253223168 00002000:00100000:2.0:1788270102.690095:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc2:0x0] (0->4194303) req@ffff98c14720b480 x1875136253223168/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/0 e 0 to 0 dl 1788270113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270102.690108:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720b480 with x1875136253223168 ext(0->4194303) 00002000:00010000:2.0:1788270102.690112:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720b480 00000100:00100000:2.0:1788270102.690148:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788270102.690154:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253223168:12345-192.168.201.42@tcp:4:dd.0 00000001:00080000:3.0:1788270102.730101:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771118 is committed 00000001:00080000:3.0:1788270102.730127:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771114 is committed 00000100:00100000:2.0:1788270102.738973:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2400:x1875136253223168:12345-192.168.201.42@tcp:4:dd.0 Request processed in 48806us (49267us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1788270102.738987:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00002000:00100000:2.0:1788270102.739000:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc2:0x0] (0->4194303) req@ffff98c14720b480 x1875136253223168/t30064771119(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/448 e 0 to 0 dl 1788270113 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270102.739011:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720b480 with x1875136253223168 ext(0->4194303) 00002000:00010000:2.0:1788270102.739017:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720b480 00000100:00100000:1.0:1788270102.753742:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.753841:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253223296 00000100:00100000:2.0:1788270102.753851:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253223296 00002000:00100000:2.0:1788270102.753899:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc2:0x0] (4194304->8388607) req@ffff98c147208700 x1875136253223296/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/0 e 0 to 0 dl 1788270113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270102.753910:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c147208700 with x1875136253223296 ext(4194304->8388607) 00002000:00010000:2.0:1788270102.753916:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c147208700 00000100:00100000:2.0:1788270102.753953:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:2.0:1788270102.753964:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253223296:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270102.807342:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253223296:12345-192.168.201.42@tcp:4:dd.0 Request processed in 53369us (53601us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1788270102.807356:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00002000:00100000:1.0:1788270102.807369:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc2:0x0] (4194304->8388607) req@ffff98c147208700 x1875136253223296/t30064771120(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/448 e 0 to 0 dl 1788270113 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270102.807379:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c147208700 with x1875136253223296 ext(4194304->8388607) 00002000:00010000:1.0:1788270102.807385:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c147208700 00000100:00100000:3.0:1788270102.852584:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270102.853453:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253223424 00000100:00100000:0.0:1788270102.853465:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253223424 00002000:00100000:0.0:1788270102.853513:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc2:0x0] (8388608->12582911) req@ffff98c1494a4700 x1875136253223424/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/0 e 0 to 0 dl 1788270113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270102.853524:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1494a4700 with x1875136253223424 ext(8388608->12582911) 00002000:00010000:0.0:1788270102.853542:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1494a4700 00000100:00100000:0.0:1788270102.853629:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:0.0:1788270102.853639:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253223424:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270102.881027:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253223424:12345-192.168.201.42@tcp:4:dd.0 Request processed in 27377us (28442us total) trans 30064771121 rc 0/0 00000100:00100000:0.0:1788270102.881080:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00002000:00100000:0.0:1788270102.881095:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc2:0x0] (8388608->12582911) req@ffff98c1494a4700 x1875136253223424/t30064771121(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/448 e 0 to 0 dl 1788270113 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270102.881107:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1494a4700 with x1875136253223424 ext(8388608->12582911) 00002000:00010000:0.0:1788270102.881115:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1494a4700 00000100:00100000:1.0:1788270102.895156:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.895369:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253223680 00000100:00100000:2.0:1788270102.895379:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253223680 00000100:00100000:2.0:1788270102.895449:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788270102.895459:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:38049:x1875136253223680:12345-192.168.201.42@tcp:35:dd.0 00000001:00080000:2.0:1788270102.895713:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771075 00000100:00100000:2.0:1788270102.895817:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:38049:x1875136253223680:12345-192.168.201.42@tcp:35:dd.0 Request processed in 357us (669us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788270102.895824:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000020:00080000:2.0:1788270102.895828:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270102.901785:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.901861:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253223936 00000100:00100000:2.0:1788270102.901871:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253223936 00000100:00100000:2.0:1788270102.901937:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:2.0:1788270102.901949:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:38050:x1875136253223936:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270102.901972:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.901993:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09be2 lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d21 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902142:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 3/0,1 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902153:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902163:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902177:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902184:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902191:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270102.902537:0:45777:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xa4:0x0], count =30 00000004:00080000:2.0:1788270102.902563:0:45777:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xa4:0x0]+30 in llog 00000004:00080000:2.0:1788270102.902574:0:45777:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc2:0x0], index 0: 0 00010000:00010000:2.0:1788270102.902703:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09bf7 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902709:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09bf7 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902714:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09bf7 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902735:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902739:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 2/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902743:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902747:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270102.902750:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902754:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902765:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270102.902768:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270102.902773:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902779:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09be9 lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270102.902792:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093032019 reply state 0000000000668c6d transno 30064771077 ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902803:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902809:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0xdee864c2 (ffff98c1429fb500) 00010000:00010000:2.0:1788270102.902812:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270102.902814:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270102.902841:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09be2 lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d21 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902857:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09bf7 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d21 expref: 15 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.902865:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270102.902867:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270102.902870:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821da400, rc 0) 00000100:00100000:2.0:1788270102.902924:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:38050:x1875136253223936:12345-192.168.201.42@tcp:101:dd.0 Request processed in 977us (1148us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1788270102.902932:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:3.0:1788270102.906677:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270102.906785:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253224064 00000100:00100000:2.0:1788270102.906797:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253224064 00000100:00100000:2.0:1788270102.906942:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:2.0:1788270102.906953:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+5:38050:x1875136253224064:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270102.906975:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270102.906996:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024f0fd33/0xc5f5d7a016e09c05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d28 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270102.907034:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270102.907099:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=894s v=(0 0) 00010000:00010000:2.0:1788270102.907104:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270102.907116:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f0fd33/0xc5f5d7a016e09c05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d28 expref: 6 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.907147:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024f0fd33/0xc5f5d7a016e09c05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d28 expref: 6 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270102.907163:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821dbe00, rc 0) 00000100:00100000:2.0:1788270102.907227:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:38050:x1875136253224064:12345-192.168.201.42@tcp:101:dd.0 Request processed in 275us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270102.907234:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00080000:3.0:1788270102.907744:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270102.958923:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270102.959066:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253224192 00000100:00100000:0.0:1788270102.959076:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253224192 00002000:00100000:0.0:1788270102.959134:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4194303) req@ffff98c147209c00 x1875136253224192/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/0 e 0 to 0 dl 1788270113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270102.959150:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c147209c00 with x1875136253224192 ext(0->4194303) 00002000:00010000:0.0:1788270102.959155:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c147209c00 00000100:00100000:0.0:1788270102.959187:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:0.0:1788270102.959196:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2400:x1875136253224192:12345-192.168.201.42@tcp:4:dd.0 00010000:00010000:0.0:1788270102.980438:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270102.991629:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253224192:12345-192.168.201.42@tcp:4:dd.0 Request processed in 32422us (32703us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1788270102.991645:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00002000:00100000:0.0:1788270102.991658:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4194303) req@ffff98c147209c00 x1875136253224192/t30064771097(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:518/0 lens 488/448 e 0 to 0 dl 1788270113 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270102.991668:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c147209c00 with x1875136253224192 ext(0->4194303) 00002000:00010000:0.0:1788270102.991674:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c147209c00 00000100:00100000:1.0:1788270103.006275:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.006429:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253224320 00000100:00100000:2.0:1788270103.006440:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253224320 00002000:00100000:2.0:1788270103.006486:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4194304->8388607) req@ffff98c271ff8e00 x1875136253224320/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:519/0 lens 488/0 e 0 to 0 dl 1788270114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270103.006494:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c271ff8e00 with x1875136253224320 ext(4194304->8388607) 00002000:00010000:2.0:1788270103.006499:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c271ff8e00 00000100:00100000:2.0:1788270103.006545:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788270103.006568:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2402:x1875136253224320:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:3.0:1788270103.032961:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253224320:12345-192.168.201.42@tcp:4:dd.0 Request processed in 26394us (26681us total) trans 30064771098 rc 0/0 00000100:00100000:3.0:1788270103.032976:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00002000:00100000:3.0:1788270103.032988:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4194304->8388607) req@ffff98c271ff8e00 x1875136253224320/t30064771098(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:519/0 lens 488/448 e 0 to 0 dl 1788270114 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270103.033005:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c271ff8e00 with x1875136253224320 ext(4194304->8388607) 00002000:00010000:3.0:1788270103.033012:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c271ff8e00 00000100:00100000:1.0:1788270103.051836:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.051918:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253224448 00000100:00100000:2.0:1788270103.051928:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253224448 00002000:00100000:2.0:1788270103.051983:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc2:0x0] (8388608->12582911) req@ffff98c271ffbb80 x1875136253224448/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:519/0 lens 488/0 e 0 to 0 dl 1788270114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270103.051995:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c271ffbb80 with x1875136253224448 ext(8388608->12582911) 00002000:00010000:2.0:1788270103.052001:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c271ffbb80 00000100:00100000:2.0:1788270103.052034:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788270103.052103:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253224448:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:3.0:1788270103.089381:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2403:x1875136253224448:12345-192.168.201.42@tcp:4:dd.0 Request processed in 37288us (37542us total) trans 30064771099 rc 0/0 00000100:00100000:3.0:1788270103.089397:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00002000:00100000:3.0:1788270103.089409:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc2:0x0] (8388608->12582911) req@ffff98c271ffbb80 x1875136253224448/t30064771099(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:519/0 lens 488/448 e 0 to 0 dl 1788270114 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270103.089420:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c271ffbb80 with x1875136253224448 ext(8388608->12582911) 00002000:00010000:3.0:1788270103.089426:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c271ffbb80 00000100:00100000:1.0:1788270103.094589:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270103.094674:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253224704 00000100:00100000:3.0:1788270103.094684:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253224704 00000100:00100000:3.0:1788270103.094738:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788270103.094749:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:38050:x1875136253224704:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:3.0:1788270103.095065:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:38050:x1875136253224704:12345-192.168.201.42@tcp:35:dd.0 Request processed in 289us (458us total) trans 30064771078 rc 0/0 00000100:00100000:3.0:1788270103.095074:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788270103.120855:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270103.121004:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253224832 00000100:00100000:3.0:1788270103.121014:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253224832 00000100:00100000:2.0:1788270103.121245:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 298 00000100:00100000:2.0:1788270103.121257:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:38051:x1875136253224832:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:2.0:1788270103.121278:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.121296:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c0c lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d2f expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.121331:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.121343:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.121353:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.121488:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c0c lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 19 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.121511:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.121520:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.121534:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270103.121538:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821daa00, rc 0) 00000100:00100000:2.0:1788270103.121591:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38051:x1875136253224832:12345-192.168.201.42@tcp:101:chown.0 Request processed in 337us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.121599:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 298 00000100:00100000:0.0:1788270103.123329:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270103.123434:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225088 00000100:00100000:3.0:1788270103.123455:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225088 00000100:00100000:3.0:1788270103.123506:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 299 00000100:00100000:3.0:1788270103.123516:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38051:x1875136253225088:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:3.0:1788270103.123568:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270103.123590:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09bcd lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d13 expref: 18 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.123616:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:3.0:1788270103.123621:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270103.123644:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.123655:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.123663:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270103.123906:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].2, 88 off8344 00000004:00080000:3.0:1788270103.123915:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 894830875431ns, next at 895830873495ns, rc = 0 00000004:00010000:3.0:1788270103.123961:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaeff945 reply state 00000000611e5e6a transno 30064771079 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.123973:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.123979:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:3.0:1788270103.123982:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788270103.123985:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270103.124102:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38051:x1875136253225088:12345-192.168.201.42@tcp:36:chown.0 Request processed in 587us (777us total) trans 30064771079 rc 0/0 00000100:00100000:3.0:1788270103.124110:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 299 00000100:00100000:1.0:1788270103.125747:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.125834:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225216 00000100:00100000:2.0:1788270103.125841:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225216 00000100:00100000:2.0:1788270103.125885:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 300 00000100:00100000:2.0:1788270103.125893:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38051:x1875136253225216:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:2.0:1788270103.125909:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.125925:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d36 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.125972:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 20 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.125985:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 20 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.126003:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.126006:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270103.126010:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ef200, rc 0) 00000100:00100000:2.0:1788270103.126109:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38051:x1875136253225216:12345-192.168.201.42@tcp:101:chown.0 Request processed in 216us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.126116:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 300 00000100:00100000:2.0:1788270103.127479:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.127649:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225344 00000100:00100000:0.0:1788270103.127656:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225344 00000100:00100000:0.0:1788270103.127697:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:0.0:1788270103.127705:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253225344:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:0.0:1788270103.127829:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:0.0:1788270103.127832:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788270103 00002000:00010000:0.0:1788270103.127835:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788270103.127837:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb ctime from disk: 0 -> 1788270103 00002000:00010000:0.0:1788270103.127839:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:0.0:1788270103.127881:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253225344:12345-192.168.201.42@tcp:2:chown.0 Request processed in 177us (405us total) trans 30064771122 rc 0/0 00000100:00100000:0.0:1788270103.127892:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:1.0:1788270103.144342:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.144637:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225472 00000100:00100000:2.0:1788270103.144647:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225472 00000100:00100000:2.0:1788270103.144746:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 301 00000100:00100000:2.0:1788270103.144758:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38052:x1875136253225472:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:2.0:1788270103.144775:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.144794:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c28 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d3d expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.144827:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e09c2f lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.144840:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e09c2f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.144851:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e09c2f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.144958:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c28 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d3d expref: 22 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.144976:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef600/0xc5f5d7a016e09c2f lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d3d expref: 21 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.144985:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270103.144988:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270103.144992:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9ef600, rc 0) 00000100:00100000:2.0:1788270103.145087:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38052:x1875136253225472:12345-192.168.201.42@tcp:101:chown.0 Request processed in 331us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.145094:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 301 00000100:00100000:1.0:1788270103.149268:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.149340:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225728 00000100:00100000:2.0:1788270103.149349:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225728 00000100:00100000:2.0:1788270103.149405:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 302 00000100:00100000:2.0:1788270103.149414:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38052:x1875136253225728:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:2.0:1788270103.149474:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270103.149504:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09bf7 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d21 expref: 21 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.149531:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270103.149537:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270103.149566:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.149579:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.149589:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270103.149773:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].2, 88 off8344 00000004:00080000:2.0:1788270103.149781:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 894856741297ns, next at 895856739788ns, rc = 0 00000004:00010000:2.0:1788270103.149820:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000238abb68 reply state 00000000101cb9aa transno 30064771080 ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.149837:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.149843:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270103.149846:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270103.149849:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270103.150104:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:38052:x1875136253225728:12345-192.168.201.42@tcp:36:chown.0 Request processed in 689us (843us total) trans 30064771080 rc 0/0 00000100:00100000:2.0:1788270103.150111:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 302 00000100:00100000:1.0:1788270103.154356:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.154399:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225856 00000100:00100000:0.0:1788270103.154408:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225856 00000100:00100000:0.0:1788270103.154576:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 303 00000100:00100000:0.0:1788270103.154586:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:38052:x1875136253225856:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270103.154610:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270103.154629:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09c3d lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d44 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.154681:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09c3d lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d44 expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.154698:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fe00/0xc5f5d7a016e09c3d lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d44 expref: 23 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.154718:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:0.0:1788270103.154720:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270103.154723:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fe00, rc 0) 00000100:00100000:0.0:1788270103.154773:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:38052:x1875136253225856:12345-192.168.201.42@tcp:101:chown.0 Request processed in 189us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270103.154780:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 303 00000100:00100000:1.0:1788270103.156230:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.156455:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253225984 00000100:00100000:0.0:1788270103.156463:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253225984 00000100:00100000:0.0:1788270103.156519:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:0.0:1788270103.156542:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253225984:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:0.0:1788270103.156693:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:0.0:1788270103.156698:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788270103 00002000:00010000:0.0:1788270103.156700:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788270103.156702:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 0 -> 1788270103 00002000:00010000:0.0:1788270103.156704:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:0.0:1788270103.156771:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253225984:12345-192.168.201.42@tcp:2:chown.0 Request processed in 229us (552us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1788270103.156778:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:1.0:1788270103.197580:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.197690:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253226112 00000100:00100000:2.0:1788270103.197700:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253226112 00000100:00100000:2.0:1788270103.197796:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 304 00000100:00100000:2.0:1788270103.197806:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:38058:x1875136253226112:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270103.197825:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.197847:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d4b expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270103.198444:0:46770:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 500, time 549us 00010000:00010000:2.0:1788270103.207663:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c4b lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.207684:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c4b lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.207694:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c4b lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270103.207737:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270103.207742:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270103.207781:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c4b lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.207816:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d4b expref: 25 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.207836:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c4b lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d4b expref: 24 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.207845:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270103.207848:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270103.207851:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c24a9eee00, rc 0) 00000100:00100000:2.0:1788270103.207952:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38058:x1875136253226112:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 10146us (10380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.207961:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 304 00000100:00100000:1.0:1788270103.209925:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.209974:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253226240 00000100:00100000:2.0:1788270103.209987:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253226240 00000100:00100000:2.0:1788270103.210197:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 305 00000100:00100000:2.0:1788270103.210207:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38058:x1875136253226240:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270103.210225:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.210244:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09c52 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d52 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210306:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210321:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210337:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210348:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210356:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210363:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210441:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210451:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210458:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270103.210501:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x2:0x0]: returning size 15728640 00000004:00200000:2.0:1788270103.210505:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270103.210533:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210552:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210560:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210572:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210579:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210586:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.210590:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210598:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210610:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270103.210620:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.210625:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210631:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09c59 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210644:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210651:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210657:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210662:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.210666:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210673:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210679:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x852f64c2 (ffff98c1429f8900) 00010000:00010000:2.0:1788270103.210682:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.210685:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210692:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c60 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210712:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09c52 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 26 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210726:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 25 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.210733:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.210735:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270103.210738:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030e00, rc 0) 00000100:00100000:2.0:1788270103.210790:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:38058:x1875136253226240:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 584us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.210798:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 305 00000100:00100000:1.0:1788270103.212725:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.213668:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253226496 00000100:00100000:0.0:1788270103.213678:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253226496 00000100:00100000:0.0:1788270103.213731:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 306 00000100:00100000:0.0:1788270103.213741:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:38058:x1875136253226496:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270103.213759:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270103.213777:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09c6e lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d59 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.213870:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09c75 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.213883:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09c75 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.213894:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09c75 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270103.213904:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x2:0x0]: returning size 15728640 00010000:00010000:0.0:1788270103.214008:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09c6e lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d59 expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.214025:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09c75 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d59 expref: 27 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.214034:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270103.214101:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270103.214105:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f200, rc 0) 00000100:00100000:0.0:1788270103.214190:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:38058:x1875136253226496:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 449us (1469us total) trans 30064771081 rc 0/0 00000100:00100000:0.0:1788270103.214198:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 306 00000100:00100000:1.0:1788270103.217196:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270103.217250:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270103.217301:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253226880 00000100:00100000:3.0:1788270103.217310:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253226880 00000100:00100000:2.0:1788270103.217313:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253226752 00000100:00100000:2.0:1788270103.217319:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253226752 00000100:00100000:2.0:1788270103.217371:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:2.0:1788270103.217382:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2402:x1875136253226752:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270103.217397:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788270103.217422:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 307 00010000:00010000:2.0:1788270103.217423:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09c75 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d59 expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270103.217436:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38058:x1875136253226880:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270103.217444:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.217449:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270103.217460:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270103.217477:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09c83 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d60 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.217500:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2402:x1875136253226752:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 120us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.217509:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00010000:00010000:3.0:1788270103.217579:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09c8a lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.217593:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09c8a lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.217603:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09c8a lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270103.217617:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x2:0x0]: returning size 15728640 00010000:00010000:3.0:1788270103.217709:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09c83 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d60 expref: 29 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.217723:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09c8a lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d60 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.217730:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:3.0:1788270103.217733:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788270103.217735:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf200, rc 0) 00000100:00100000:3.0:1788270103.217769:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38058:x1875136253226880:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 337us (517us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1788270103.217775:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 307 00000040:00080000:0.0:1788270103.236469:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270103.236479:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270103.236987:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 8 00000040:00080000:0.0:1788270103.236999:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270103.299556:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.299763:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227008 00000100:00100000:2.0:1788270103.299772:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227008 00000100:00100000:2.0:1788270103.299866:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788270103.299874:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253227008:12345-192.168.201.42@tcp:1:lfs.500 00010000:00010000:2.0:1788270103.299910:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.299927:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 16 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.299933:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0xc2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788270103.299937:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270103.299940:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.299967:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 16 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.299980:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 16 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.299991:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262655104:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270103.300105:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c25e4ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788270103.308966:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.309143:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262655104:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270103.309170:0:48230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270103.309287:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227136 00000100:00100000:0.0:1788270103.309295:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227136 00002000:00100000:0.0:1788270103.309342:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc2:0x0] (12582912->15728639) req@ffff98c14a49c380 x1875136253227136/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:519/0 lens 488/0 e 0 to 0 dl 1788270114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270103.309353:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14a49c380 with x1875136253227136 ext(12582912->15728639) 00010000:00010000:0.0:1788270103.309360:0:47288:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 17 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.309652:0:47288:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 17 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270103.309663:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c14a49c380 00000100:00100000:0.0:1788270103.309756:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788270103.309777:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253227136:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:2.0:1788270103.341251:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253227136:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 31462us (32279us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1788270103.341268:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00002000:00100000:2.0:1788270103.341284:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc2:0x0] (12582912->15728639) req@ffff98c14a49c380 x1875136253227136/t30064771123(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:519/0 lens 488/448 e 0 to 0 dl 1788270114 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270103.341293:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14a49c380 with x1875136253227136 ext(12582912->15728639) 00010000:00010000:2.0:1788270103.341304:0:47288:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 19 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.341323:0:47288:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 19 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270103.341330:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c14a49c380 00000100:00100000:0.0:1788270103.350857:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.350953:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227264 00000100:00100000:2.0:1788270103.350964:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227264 00010000:00010000:2.0:1788270103.351004:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 19 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.351074:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:2.0:1788270103.351085:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253227264:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270103.351100:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788270103.351118:0:45761:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb size from disk: 12582912 -> 15728640 00002000:00010000:2.0:1788270103.351122:0:45761:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1788270103 00002000:00010000:2.0:1788270103.351124:0:45761:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc2:0x0] updating lvb blocks from disk: 24576 -> 30720 00010000:00010000:2.0:1788270103.351131:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 19 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.351145:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 19 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.351167:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09bdb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d1a expref: 19 pid: 48231 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.351183:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270103.351187:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270103.351192:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.351201:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.351243:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270103.351300:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253227264:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 216us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.351308:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00010000:00010000:3.0:1788270103.351632:0:48230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351648:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351669:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351677:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351684:0:48230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351691:0:48230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270103.351695:0:48230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351757:0:48230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351770:0:48230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.351778:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3be283/0xc5f5d7a016e09c98 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270103.351868:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253227008:12345-192.168.201.42@tcp:1:lfs.500 Request processed in 51993us (52321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270103.351875:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:0.0:1788270103.353355:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.353536:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227520 00000100:00100000:2.0:1788270103.353545:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227520 00000100:00100000:2.0:1788270103.353616:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:2.0:1788270103.353622:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38058:x1875136253227520:12345-192.168.201.42@tcp:35:lfs.500 00000004:00010000:2.0:1788270103.353673:0:49484:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2400032e0:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09c8a lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d60 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270103.353820:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771083 00000001:00080000:2.0:1788270103.353838:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771084 00000001:00080000:2.0:1788270103.354111:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771085 00010000:00010000:2.0:1788270103.354148:0:49484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354163:0:49484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 32 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354171:0:49484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 32 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354177:0:49484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 32 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354182:0:49484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 6/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354209:0:49484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 32 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354218:0:49484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 32 pid: 45777 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.354229:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:49484:1875136262655232:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270103.354303:0:49484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 32 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354312:0:49484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 32 pid: 45776 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.354320:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:49484:1875136262655360:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270103.354348:0:49484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 32 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.354357:0:49484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 32 pid: 46770 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.354365:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:49484:1875136262655488:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270103.354387:0:49484:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788270103.357207:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270103.357241:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.357330:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227776 00000100:00100000:0.0:1788270103.357340:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227776 00000100:00100000:3.0:1788270103.357371:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227648 00000100:00100000:3.0:1788270103.357376:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227648 00010000:00010000:0.0:1788270103.357388:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 5/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 34 pid: 45776 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.357390:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 34 pid: 45777 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270103.357444:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788270103.357451:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:49484:1875136262655232:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270103.357453:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:2402:x1875136253227648:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788270103.357462:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:49484:1875136262655360:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270103.357466:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788270103.357469:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:49484:1875136262655488:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270103.357472:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 34 pid: 45777 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.357483:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 34 pid: 45777 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.357494:0:49484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.357560:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9ef200/0xc5f5d7a016e09c21 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d36 expref: 34 pid: 45777 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270103.357666:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:0.0:1788270103.357674:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:2402:x1875136253227776:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270103.357683:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270103.357688:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 33 pid: 45776 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.357838:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:3.0:1788270103.357845:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.357854:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.358029:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270103.358252:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 33 pid: 45776 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.358269:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09c67 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d52 expref: 33 pid: 45776 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.358280:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270103.358284:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.358290:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.358296:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270103.358344:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:2402:x1875136253227776:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 670us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270103.358452:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:2402:x1875136253227648:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 999us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270103.358459:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:0.0:1788270103.358469:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:3.0:1788270103.358826:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.359209:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253227904 00000100:00100000:0.0:1788270103.359216:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253227904 00010000:00010000:0.0:1788270103.359241:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 31 pid: 46770 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270103.359268:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:0.0:1788270103.359276:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:2403:x1875136253227904:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270103.359286:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270103.359292:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 31 pid: 46770 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.359303:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 31 pid: 46770 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.359317:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09c13 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d2f expref: 31 pid: 46770 timeout: 995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.359327:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270103.359330:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.359336:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.359341:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 4/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.362786:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270103.362839:0:49484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.362852:0:49484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270103.362861:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:2403:x1875136253227904:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3581us (4030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270103.362871:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000001:00080000:2.0:1788270103.363150:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771086 00000001:00080000:2.0:1788270103.363267:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771087 00000100:00100000:2.0:1788270103.363377:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:49484:1875136262655616:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788270103.365634:0:49484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270103.365715:0:49484:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270103.365778:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262655616 00000100:00100000:1.0:1788270103.365787:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262655616 00000100:00080000:3.0:1788270103.365828:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270103.365875:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788270103.365886:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:49484:x1875136262655616:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788270103.365991:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:49484:x1875136262655616:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 107us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270103.365998:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788270103.366019:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:49484:1875136262655616:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788270103.366247:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771088 00000100:00100000:2.0:1788270103.366301:0:49484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:49484:1875136262655744:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788270103.366327:0:49484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270103.366345:0:49484:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788270103.366369:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262655744 00000100:00100000:0.0:1788270103.366374:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262655744 00000100:00100000:0.0:1788270103.366403:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788270103.366410:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:49484:x1875136262655744:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788270103.366528:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:49484:x1875136262655744:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 109us (189us total) trans 30064771124 rc 0/0 00000100:00100000:0.0:1788270103.366535:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788270103.366706:0:49484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:49484:1875136262655744:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788270103.366746:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771089 00010000:00010000:2.0:1788270103.366778:0:49484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.366789:0:49484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 2/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.366796:0:49484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.366805:0:49484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.366809:0:49484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.366814:0:49484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 4/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.366829:0:49484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.366831:0:49484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788270103.366834:0:49484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 2/0,0 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.366838:0:49484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09c9f lrc: 0/0,0 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 49484 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270103.366966:0:49484:0:(mdd_object.c:4014:mdd_close()) Object [0x2400032e0:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788270103.367005:0:49484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].3, 64 off8408 00000001:00080000:2.0:1788270103.367011:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771090 00010000:00010000:2.0:1788270103.367025:0:49484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.367027:0:49484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270103.367031:0:49484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e09c8a lrc: 0/0,0 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d60 expref: 34 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.367140:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:38058:x1875136253227520:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 13517us (13790us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1788270103.367149:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000020:00080000:2.0:1788270103.367152:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788270103.368762:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.368804:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253228032 00000100:00100000:0.0:1788270103.368812:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253228032 00000100:00100000:0.0:1788270103.368861:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 308 00000100:00100000:0.0:1788270103.368871:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:38058:x1875136253228032:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270103.368890:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270103.368908:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09ca6 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d67 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.368947:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09ca6 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d67 expref: 34 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.368957:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09ca6 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d67 expref: 34 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.368969:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270103.368972:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270103.368975:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f200, rc 0) 00000100:00100000:0.0:1788270103.369014:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:38058:x1875136253228032:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 147us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270103.369019:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 308 00000100:00100000:0.0:1788270103.370625:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270103.370778:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253228288 00000100:00100000:1.0:1788270103.370786:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253228288 00000100:00100000:1.0:1788270103.370836:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:1.0:1788270103.370846:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:38058:x1875136253228288:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:1.0:1788270103.371680:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:38058:x1875136253228288:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 831us (1059us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1788270103.371688:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:1.0:1788270103.409335:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.409479:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253228416 00000100:00100000:0.0:1788270103.409490:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253228416 00000100:00100000:0.0:1788270103.409635:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 309 00000100:00100000:0.0:1788270103.409647:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:38065:x1875136253228416:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270103.409671:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270103.409693:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09cad lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d6e expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409759:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409771:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409781:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409792:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409800:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409804:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409896:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09cc2 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409906:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09cc2 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409913:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09cc2 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270103.409945:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x3:0x0]: returning size 15728640 00000004:00200000:0.0:1788270103.409949:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270103.409964:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09cc2 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409972:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09cc2 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409978:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409982:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409987:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409990:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270103.409993:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.409997:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410007:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:0.0:1788270103.410008:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270103.410011:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410016:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09cb4 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410024:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410027:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410030:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410033:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270103.410035:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410079:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410086:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0xdee864c2 (ffff98c1429fb500) 00010000:00010000:0.0:1788270103.410089:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270103.410092:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410099:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cbb lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410133:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09cad lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d6e expref: 37 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410148:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9ec00/0xc5f5d7a016e09cc2 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d6e expref: 36 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.410156:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:0.0:1788270103.410158:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270103.410160:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ec00, rc 0) 00000100:00100000:0.0:1788270103.410221:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:38065:x1875136253228416:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 576us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270103.410228:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 309 00000100:00100000:3.0:1788270103.412180:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.412236:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253228672 00000100:00100000:2.0:1788270103.412245:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253228672 00000100:00100000:2.0:1788270103.412323:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 310 00000100:00100000:2.0:1788270103.412333:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:38065:x1875136253228672:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270103.412350:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.412366:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09cc9 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d75 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.412469:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09cd0 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.412482:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09cd0 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.412492:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09cd0 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270103.412502:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x3:0x0]: returning size 15728640 00010000:00010000:2.0:1788270103.412612:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09cc9 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d75 expref: 39 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.412630:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09cd0 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d75 expref: 38 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.412638:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270103.412641:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270103.412645:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031e00, rc 0) 00000100:00100000:2.0:1788270103.412696:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38065:x1875136253228672:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 364us (522us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1788270103.412703:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 310 00000100:00100000:1.0:1788270103.415509:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270103.415634:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.416020:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253229056 00000100:00100000:2.0:1788270103.416030:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253229056 00000100:00100000:2.0:1788270103.416106:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 311 00000100:00100000:2.0:1788270103.416115:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38065:x1875136253229056:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270103.416136:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.416154:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09cde lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d7c expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.416248:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09ce5 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.416262:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09ce5 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.416272:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09ce5 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270103.416285:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x3:0x0]: returning size 15728640 00010000:00010000:2.0:1788270103.416379:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09cde lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d7c expref: 41 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.416398:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09ce5 lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d7c expref: 40 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.416406:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270103.416409:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270103.416413:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031200, rc 0) 00000100:00100000:2.0:1788270103.416605:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:38065:x1875136253229056:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 489us (968us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1788270103.416612:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 311 00000100:00100000:3.0:1788270103.416752:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253228800 00000100:00100000:3.0:1788270103.416757:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253228800 00000100:00100000:3.0:1788270103.416804:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788270103.416813:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:2403:x1875136253228800:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270103.416823:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270103.416836:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09cd0 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d75 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270103.416849:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:3.0:1788270103.416853:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270103.416891:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2403:x1875136253228800:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 79us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270103.416898:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:1.0:1788270103.441473:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.442189:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253229184 00000100:00100000:2.0:1788270103.442201:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253229184 00000100:00100000:2.0:1788270103.442275:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788270103.442286:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:38065:x1875136253229184:12345-192.168.201.42@tcp:103:lfs.500 00010000:00010000:2.0:1788270103.442301:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270103.442328:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09ce5 lrc: 0/0,0 mode: --/PW res: [0x2400032e0:0x3:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d7c expref: 39 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.442349:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270103.442355:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270103.442422:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38065:x1875136253229184:12345-192.168.201.42@tcp:103:lfs.500 Request processed in 138us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.442439:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:1.0:1788270103.444505:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.444600:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253229440 00000100:00100000:2.0:1788270103.444608:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253229440 00000100:00100000:2.0:1788270103.444658:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:2.0:1788270103.444668:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38065:x1875136253229440:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:2.0:1788270103.444891:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:38065:x1875136253229440:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 223us (392us total) trans 30064771095 rc 0/0 00000100:00100000:2.0:1788270103.444899:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788270103.472342:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270103.472574:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253229696 00000100:00100000:1.0:1788270103.472585:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253229696 00000100:00100000:1.0:1788270103.472702:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788270103.472713:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:38065:x1875136253229696:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:1.0:1788270103.472949:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:38065:x1875136253229696:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 239us (619us total) trans 30064771096 rc 0/0 00000100:00100000:1.0:1788270103.472955:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788270103.521282:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.521409:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253229952 00000100:00100000:0.0:1788270103.521419:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253229952 00000100:00100000:0.0:1788270103.521496:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 312 00000100:00100000:0.0:1788270103.521506:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:38075:x1875136253229952:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270103.521544:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270103.521568:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d83 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270103.521689:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788270103.521796:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d83 expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.521812:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f2800) 00010000:00010000:0.0:1788270103.521816:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270103.521821:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d83 expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.521838:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e400, rc 0) 00000100:00100000:0.0:1788270103.521915:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:38075:x1875136253229952:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 407us (640us total) trans 30064771097 rc 301/301 00000100:00100000:0.0:1788270103.521923:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 312 00000100:00100000:3.0:1788270103.524622:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.524754:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253230080 00000100:00100000:2.0:1788270103.524767:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253230080 00000100:00100000:2.0:1788270103.524895:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 313 00000100:00100000:2.0:1788270103.524907:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:38075:x1875136253230080:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270103.525008:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525035:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525084:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525099:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525107:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525126:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525234:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525244:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525250:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270103.525322:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525339:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525346:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525356:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525364:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525370:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.525375:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525383:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525398:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270103.525401:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.525406:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525410:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d01 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525425:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525428:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525432:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525435:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.525438:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525441:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525446:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x852f64c2 (ffff98c1429f8900) 00010000:00010000:2.0:1788270103.525447:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.525449:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525452:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d08 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525459:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525463:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525467:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525469:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.525471:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525474:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525477:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.525478:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.525480:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.525484:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d0f lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270103.525585:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:38075:x1875136253230080:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 679us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.525591:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 313 00000100:00100000:3.0:1788270103.528256:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.528348:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253230336 00000100:00100000:0.0:1788270103.528361:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253230336 00000100:00100000:0.0:1788270103.528464:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788270103.528473:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:38075:x1875136253230336:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270103.528751:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:38075:x1875136253230336:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 277us (508us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1788270103.528764:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:1.0:1788270103.618627:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.618801:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253230592 00000100:00100000:2.0:1788270103.618813:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253230592 00000100:00100000:2.0:1788270103.618996:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 314 00000100:00100000:2.0:1788270103.619008:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:38085:x1875136253230592:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270103.619065:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.619092:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d8a expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.619231:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d1d lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.619246:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d1d lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.619257:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d1d lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270103.619267:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788270103.619384:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d8a expref: 45 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.619405:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030c00/0xc5f5d7a016e09d1d lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d8a expref: 44 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.619412:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270103.619415:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788270103.619417:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030c00, rc 0) 00000100:00100000:2.0:1788270103.619498:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:38085:x1875136253230592:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 490us (883us total) trans 30064771099 rc 0/0 00000100:00100000:2.0:1788270103.619504:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 314 00000100:00100000:3.0:1788270103.680783:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.681236:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253230848 00000100:00100000:2.0:1788270103.681251:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253230848 00000100:00100000:2.0:1788270103.681337:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 315 00000100:00100000:2.0:1788270103.681350:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:38091:x1875136253230848:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270103.681383:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.681411:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d2b lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d91 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681527:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681545:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681559:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681574:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681582:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681589:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681803:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d40 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681813:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d40 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681821:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d40 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270103.681832:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x2:0x0]: returning size 15728640 00010000:00010000:2.0:1788270103.681928:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681936:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681944:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681950:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.681955:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681963:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.681977:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270103.681980:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.683377:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683387:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d32 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683407:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683413:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683420:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683426:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270103.683429:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683436:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683452:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x852f64c2 (ffff98c1429f8900) 00010000:00010000:2.0:1788270103.683455:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270103.683458:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683464:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d39 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683556:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d2b lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d91 expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683576:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d40 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d91 expref: 46 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.683584:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.683586:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270103.683589:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030e00, rc 0) 00000100:00100000:2.0:1788270103.684505:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:38091:x1875136253230848:12345-192.168.201.42@tcp:101:dd.500 Request processed in 3155us (3736us total) trans 30064771100 rc 0/0 00000100:00100000:2.0:1788270103.684524:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 315 00000100:00100000:3.0:1788270103.690905:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.691070:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253230976 00000100:00100000:2.0:1788270103.691082:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253230976 00000100:00100000:2.0:1788270103.691160:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 316 00000100:00100000:2.0:1788270103.691174:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:38091:x1875136253230976:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270103.691204:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.691232:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d4e lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d98 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.691273:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.691288:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.691297:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.691429:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d4e lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 48 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.691779:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 47 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.691791:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.691795:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270103.691800:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031e00, rc 0) 00000100:00100000:2.0:1788270103.691953:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:38091:x1875136253230976:12345-192.168.201.42@tcp:101:dd.500 Request processed in 781us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.691961:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 316 00000100:00100000:3.0:1788270103.694471:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.694569:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253231232 00000100:00100000:2.0:1788270103.694583:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253231232 00000100:00100000:2.0:1788270103.694939:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 317 00000100:00100000:2.0:1788270103.694952:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:38091:x1875136253231232:12345-192.168.201.42@tcp:36:dd.500 00010000:00010000:2.0:1788270103.695017:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270103.695073:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d40 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d91 expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.695097:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.695103:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270103.695330:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.695346:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.695357:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270103.695409:0:45777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771101 00000004:00010000:2.0:1788270103.695434:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc83e125 reply state 000000004ead6fed transno 30064771102 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.695447:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.695453:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.695456:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270103.695459:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270103.695581:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38091:x1875136253231232:12345-192.168.201.42@tcp:36:dd.500 Request processed in 633us (1119us total) trans 30064771102 rc 0/0 00000100:00100000:2.0:1788270103.695587:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 317 00000020:00080000:2.0:1788270103.695592:0:45777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270103.748383:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262655872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270103.748588:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270103.748828:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262655872 00000100:00100000:1.0:1788270103.748841:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262655872 00000100:00100000:1.0:1788270103.748939:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788270103.748952:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262655872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270103.748996:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788270103.749325:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262655872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 374us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270103.749334:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788270103.751120:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262655872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270103.841205:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270103.841771:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253231488 00000100:00100000:0.0:1788270103.841787:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253231488 00000100:00100000:0.0:1788270103.842190:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788270103.842204:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38091:x1875136253231488:12345-192.168.201.42@tcp:103:dd.500 00010000:00010000:0.0:1788270103.842226:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270103.842261:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09ca6 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d67 expref: 49 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270103.842630:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270103.842637:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270103.842719:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:38091:x1875136253231488:12345-192.168.201.42@tcp:103:dd.500 Request processed in 518us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270103.842732:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788270103.845210:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.845313:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253231616 00000100:00100000:2.0:1788270103.845328:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253231616 00000100:00100000:2.0:1788270103.845405:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 318 00000100:00100000:2.0:1788270103.845417:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:38091:x1875136253231616:12345-192.168.201.42@tcp:58:dd.500 00010000:00010000:2.0:1788270103.845582:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.845604:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.845618:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270103.846303:0:45776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788270103.846347:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788270103.846528:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].1, 136 off8328 00000100:00100000:2.0:1788270103.846652:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:38091:x1875136253231616:12345-192.168.201.42@tcp:58:dd.500 Request processed in 1232us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.846663:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 318 00000100:00100000:1.0:1788270103.848975:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270103.849191:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253231744 00000100:00100000:2.0:1788270103.849206:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253231744 00000100:00100000:2.0:1788270103.849325:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 319 00000100:00100000:2.0:1788270103.849338:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:38091:x1875136253231744:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270103.849365:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270103.849395:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101d9f expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.849572:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 2/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.849586:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 4/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.849610:0:46770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.849626:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.849642:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270103.849645:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270103.849650:0:46770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270103.849665:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030000, rc 0) 00000100:00100000:2.0:1788270103.849783:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38091:x1875136253231744:12345-192.168.201.42@tcp:101:dd.500 Request processed in 447us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270103.849792:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 319 00010000:00010000:0.0:1788270104.005369:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270104.066841:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.066959:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.067006:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.067283:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.067382:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232000 00000100:00100000:2.0:1788270104.067396:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232000 00000100:00100000:2.0:1788270104.067489:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232256 00000100:00100000:2.0:1788270104.067493:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232256 00000100:00100000:2.0:1788270104.067533:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232128 00000100:00100000:2.0:1788270104.067537:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232128 00000100:00100000:2.0:1788270104.067563:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:2.0:1788270104.067575:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2402:x1875136253232000:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270104.067827:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2402:x1875136253232000:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 254us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.067836:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:2.0:1788270104.067870:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:2.0:1788270104.067878:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253232256:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270104.067935:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253232256:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 58us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.067943:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:2.0:1788270104.067957:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:2.0:1788270104.067964:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253232128:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270104.067988:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253232128:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.067998:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00080000:3.0:1788270104.069763:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270104.069775:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270104.070391:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253231872 00000100:00100000:1.0:1788270104.070405:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253231872 00000100:00100000:1.0:1788270104.070574:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:1.0:1788270104.070586:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253231872:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270104.070682:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253231872:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 98us (3674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270104.070690:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00000004:00080000:0.0:1788270104.260386:0:46521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 895967342787ns, next at 896967339247ns, rc = 0 00000100:00100000:3.0:1788270104.260652:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262656128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270104.260748:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270104.260816:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270104.260823:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262656000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270104.260849:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270104.260876:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270104.260885:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262656256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270104.260886:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656128 00000100:00100000:1.0:1788270104.260895:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656128 00000100:00100000:3.0:1788270104.260939:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270104.260955:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656000 00000100:00100000:1.0:1788270104.260958:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656000 00000100:00080000:3.0:1788270104.260965:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270104.260971:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656256 00000100:00100000:1.0:1788270104.260973:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656256 00000100:00080000:3.0:1788270104.260997:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270104.261000:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788270104.261011:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262656128:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270104.261015:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788270104.261021:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262656000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270104.261061:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3379200 granted 141901504 pending 15826944 free 3863896064 avail 3615498240 00002000:00000024:1.0:1788270104.261061:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66854592 pending 12656640 free 3923496960 avail 3691974656 00000100:00100000:1.0:1788270104.261118:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262656128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270104.261125:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788270104.261135:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788270104.261144:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262656256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270104.261154:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3379200 granted 141901504 pending 15826944 free 3863896064 avail 3615498240 00000100:00100000:3.0:1788270104.261810:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262656000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 787us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270104.261818:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788270104.261853:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270104.261865:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.261904:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270104.261943:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656384 00000100:00100000:3.0:1788270104.261948:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656384 00000100:00100000:3.0:1788270104.261975:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788270104.261982:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262656384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.262014:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262656384:12345-0@lo:400:kworker.0 Request processed in 32us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270104.262020:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788270104.262087:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.262117:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262656512:0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.262145:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270104.262181:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656512 00000100:00100000:3.0:1788270104.262184:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656512 00000100:00100000:2.0:1788270104.262421:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262656768:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.262456:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270104.262477:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262657280:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.262530:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270104.262549:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788270104.262555:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262656896:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.262581:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270104.262596:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262657408:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.262619:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270104.262649:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656768 00000100:00100000:2.0:1788270104.262653:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656768 00000100:00100000:2.0:1788270104.262695:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788270104.262702:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262656768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270104.262835:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262656256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1691us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270104.262842:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788270104.262999:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771114 gen 2 00000004:00080000:0.0:1788270104.263006:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771114 committed transno 30064771114 00000100:00100000:0.0:1788270104.263053:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262656256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270104.263077:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262657280 00000100:00100000:0.0:1788270104.263080:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262657280 00000100:00100000:0.0:1788270104.263113:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656896 00000100:00100000:0.0:1788270104.263116:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656896 00000100:00100000:0.0:1788270104.263130:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262657408 00000100:00100000:0.0:1788270104.263133:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262657408 00000100:00100000:0.0:1788270104.263150:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788270104.263158:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262657280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.263313:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788270104.263321:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262656896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270104.263409:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262657280:12345-0@lo:400:kworker.0 Request processed in 251us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270104.263416:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788270104.263511:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262656000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270104.263527:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771096 gen 2 00000004:00080000:1.0:1788270104.263531:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771095 committed transno 30064771096 00000004:00080000:1.0:1788270104.263550:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c2b5180, transno 30064771096 00000100:00100000:1.0:1788270104.263567:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262656128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270104.263571:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262656896:12345-0@lo:400:kworker.0 Request processed in 252us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270104.263590:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262656640:0@lo:400:kworker.0 00000100:00100000:1.0:1788270104.263624:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270104.263654:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262657152:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.263660:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262656768:12345-0@lo:400:kworker.0 Request processed in 959us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.263667:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788270104.263677:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270104.263690:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1788270104.263694:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270104.263696:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262657024:0@lo:400:kworker.0 00000100:00080000:2.0:1788270104.263699:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270104.263702:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270104.263716:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270104.263735:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262656896:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.263746:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262656768:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.263755:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262657280:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.263806:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262657152 00000100:00100000:2.0:1788270104.263811:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262657152 00000100:00100000:3.0:1788270104.263859:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788270104.263871:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262657024 00000100:00100000:3.0:1788270104.263874:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262657024 00000100:00100000:1.0:1788270104.263876:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262656640 00000100:00100000:1.0:1788270104.263879:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262656640 00000100:00100000:3.0:1788270104.263892:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788270104.263897:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262657408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270104.263906:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788270104.263911:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262656640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.263934:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262657408:12345-0@lo:400:kworker.0 Request processed in 37us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270104.263941:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788270104.263948:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262656640:12345-0@lo:400:kworker.0 Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270104.263953:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788270104.263954:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788270104.263959:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262656512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270104.263981:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262656640:0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.263989:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262656512:12345-0@lo:400:kworker.0 Request processed in 31us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270104.263995:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788270104.264008:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788270104.264015:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262657024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270104.264072:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262657024:12345-0@lo:400:kworker.0 Request processed in 58us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270104.264078:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788270104.264104:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262657024:0@lo:400:kworker.0 00000100:00100000:3.0:1788270104.267680:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262657408:0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.267839:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788270104.267861:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262657152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270104.267965:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262657152:12345-0@lo:400:kworker.0 Request processed in 117us (4286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.267973:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788270104.268123:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262656512:0@lo:400:kworker.0 00000100:00080000:0.0:1788270104.268145:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270104.268151:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270104.268445:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262657152:0@lo:400:kworker.0 00000040:00080000:0.0:1788270104.645192:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270104.645203:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270104.645235:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788270104.645247:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788270104.645418:0:46530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:46530:1875136262657536:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270104.645616:0:46530:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14406a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270104.651621:0:46530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:46530:1875136262657536:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270104.652695:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270104.652812:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232384 00000100:00100000:1.0:1788270104.652822:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232384 00000100:00080000:0.0:1788270104.653316:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270104.655650:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 320 00000100:00100000:1.0:1788270104.655683:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38092:x1875136253232384:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788270104.655731:0:46770:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2400032e0:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788270104.655905:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38092:x1875136253232384:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 239us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270104.655914:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 320 00000100:00100000:2.0:1788270104.670791:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.670927:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232512 00000100:00100000:3.0:1788270104.670940:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232512 00000100:00100000:2.0:1788270104.671097:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 321 00000100:00100000:2.0:1788270104.671111:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38092:x1875136253232512:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270104.671204:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.671224:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.671240:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.671258:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.671265:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.671272:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270104.671369:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262657664:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788270104.671429:0:48110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270104.671464:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270104.671586:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262657664 00000100:00100000:1.0:1788270104.671592:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262657664 00000100:00100000:1.0:1788270104.671782:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788270104.671793:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262657664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788270104.671904:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262657664:12345-0@lo:1000:mdt00_004.0 Request processed in 113us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270104.671912:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788270104.672066:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262657664:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788270104.672127:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672137:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672145:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270104.672168:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672180:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672187:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672196:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672203:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270104.672208:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672217:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672230:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270104.672233:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270104.672238:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672243:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c240030e00/0xc5f5d7a016e09d71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672258:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672264:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672269:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672275:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270104.672278:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672284:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672292:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x76198432 (ffff98c1429fb000) 00010000:00010000:2.0:1788270104.672294:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270104.672297:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672303:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09d78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x76198432 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672320:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672331:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672338:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672343:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270104.672346:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672351:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672357:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429fbd00) 00010000:00010000:2.0:1788270104.672360:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270104.672362:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.672368:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09d7f lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270104.673127:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38092:x1875136253232512:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 2015us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.673139:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 321 00000100:00100000:1.0:1788270104.682968:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.683299:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232640 00000100:00100000:3.0:1788270104.683321:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232640 00000100:00100000:3.0:1788270104.683402:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 322 00000100:00100000:3.0:1788270104.683413:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38092:x1875136253232640:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788270104.683507:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683530:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683704:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270104.683775:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788270104.683781:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788270104.683822:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683835:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683842:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683848:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270104.683853:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683861:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683877:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:3.0:1788270104.683880:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788270104.683885:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270104.683891:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e09d86 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270104.684198:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38092:x1875136253232640:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 785us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270104.684207:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 322 00000100:00100000:0.0:1788270104.689774:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270104.689939:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253232896 00000100:00100000:1.0:1788270104.689954:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253232896 00000100:00100000:1.0:1788270104.690132:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 323 00000100:00100000:1.0:1788270104.690147:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38092:x1875136253232896:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270104.690176:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270104.690207:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09d8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101da6 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690345:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690365:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690381:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270104.690394:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788270104.690690:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690700:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690707:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690778:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270104.690785:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690795:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690813:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:1.0:1788270104.690816:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270104.690822:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690829:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09d94 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690952:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09d8d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101da6 expref: 51 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.690965:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c14387fa00) 00010000:00010000:1.0:1788270104.690967:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788270104.691144:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09d8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101da6 expref: 51 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.691166:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ba00, rc 0) 00000100:00100000:1.0:1788270104.691260:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38092:x1875136253232896:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1116us (1659us total) trans 30064771103 rc 301/301 00000100:00100000:1.0:1788270104.691268:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 323 00000100:00100000:1.0:1788270104.695383:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.695794:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253233024 00000100:00100000:2.0:1788270104.695808:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253233024 00000100:00100000:2.0:1788270104.695894:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 324 00000100:00100000:2.0:1788270104.695916:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38092:x1875136253233024:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270104.700262:0:48110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2400032e0:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270104.700554:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38092:x1875136253233024:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 4631us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.700569:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 324 00000100:00100000:3.0:1788270104.704466:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270104.704846:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253233280 00000100:00100000:0.0:1788270104.704860:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253233280 00000100:00100000:0.0:1788270104.704926:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 325 00000100:00100000:0.0:1788270104.704937:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38092:x1875136253233280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270104.704962:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270104.704966:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788270104.705011:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c24a9eee00/0xc5f5d7a016e09c4b lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d4b expref: 50 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.705035:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:0.0:1788270104.705086:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270104.705103:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09da2 lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dad expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270104.705598:0:45778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc3:0x0], index 1: 0 00010000:00010000:0.0:1788270104.707247:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09da9 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.707271:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09da9 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.707284:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09da9 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.707361:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09da2 lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dad expref: 52 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.707382:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09da9 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dad expref: 51 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.707391:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2800) 00010000:00010000:0.0:1788270104.707394:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270104.707398:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fa00, rc 0) 00000100:00100000:0.0:1788270104.707491:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38092:x1875136253233280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2554us (3035us total) trans 30064771104 rc 0/0 00000100:00100000:0.0:1788270104.709894:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 325 00000100:00100000:3.0:1788270104.712489:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270104.716438:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253233536 00000100:00100000:1.0:1788270104.716460:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253233536 00000100:00100000:1.0:1788270104.716593:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 326 00000100:00100000:1.0:1788270104.716616:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38092:x1875136253233536:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788270104.716692:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270104.716738:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09da9 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dad expref: 51 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.716763:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2800) 00010000:00010000:1.0:1788270104.716775:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270104.716802:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 3/0,1 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.716818:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.716827:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717357:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717368:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717376:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717451:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 4/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717459:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 4/0,1 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717472:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717479:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717486:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270104.717490:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717557:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 5/0,0 mode: CW/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717567:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:1.0:1788270104.717570:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270104.717574:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 3/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717581:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09db7 lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717596:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717699:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 2/0,0 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717706:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717720:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270104.717724:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717731:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 4/0,0 mode: PW/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717740:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x53bdeec9 (ffff98c14387f600) 00010000:00010000:1.0:1788270104.717743:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270104.717746:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 2/0,0 mode: --/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270104.717752:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09dbe lrc: 0/0,0 mode: --/PW res: [0x2400032e0:0x1:0x0].0x53bdeec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270104.718120:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38092:x1875136253233536:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1512us (5639us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788270104.718129:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 326 00000100:00100000:2.0:1788270104.723164:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270104.724234:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253233664 00000100:00100000:0.0:1788270104.724251:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253233664 00000100:00100000:0.0:1788270104.724321:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 327 00000100:00100000:0.0:1788270104.724332:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38092:x1875136253233664:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270104.724351:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270104.724375:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09dc5 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101db4 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.724413:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.724427:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.724439:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.724564:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09dc5 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 52 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.724582:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.724591:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270104.724593:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270104.724596:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e400, rc 0) 00000100:00100000:0.0:1788270104.724670:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38092:x1875136253233664:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 339us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270104.724679:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 327 00000100:00100000:3.0:1788270104.728205:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.728304:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253233920 00000100:00100000:2.0:1788270104.728319:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253233920 00000100:00100000:2.0:1788270104.728386:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 328 00000100:00100000:2.0:1788270104.728399:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38092:x1875136253233920:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270104.728565:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.728587:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.728660:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270104.729136:0:48110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].4, 88 off8496 00000004:00010000:2.0:1788270104.729196:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001225bbbb reply state 000000003fe22e13 transno 30064771105 ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.729210:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.729219:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:2.0:1788270104.729222:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270104.729226:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270104.729346:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:38092:x1875136253233920:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 948us (1150us total) trans 30064771105 rc 0/0 00000100:00100000:2.0:1788270104.729354:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 328 00000100:00100000:1.0:1788270104.740607:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.740704:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253234048 00000100:00100000:2.0:1788270104.740725:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253234048 00000100:00100000:2.0:1788270104.740794:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 329 00000100:00100000:2.0:1788270104.740805:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:38092:x1875136253234048:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270104.740844:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270104.740872:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dbb expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.740957:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 54 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.740975:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 54 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.740997:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:2.0:1788270104.741000:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270104.741005:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821da400, rc 0) 00000100:00100000:2.0:1788270104.741118:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:38092:x1875136253234048:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 314us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.741126:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 329 00000100:00100000:1.0:1788270104.745304:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.745435:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253234176 00000100:00100000:2.0:1788270104.745450:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253234176 00000100:00100000:2.0:1788270104.745581:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:2.0:1788270104.745599:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253234176:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788270104.745600:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270104.745929:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253234176:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 335us (639us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1788270104.745938:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:3.0:1788270104.748650:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270104.748909:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253234432 00000100:00100000:1.0:1788270104.748922:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253234432 00000100:00100000:1.0:1788270104.749005:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788270104.749016:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:38092:x1875136253234432:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788270104.749356:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:38092:x1875136253234432:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 341us (718us total) trans 30064771106 rc 0/0 00000100:00100000:1.0:1788270104.749365:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:3.0:1788270104.755834:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.755925:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253234688 00000100:00100000:2.0:1788270104.755939:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253234688 00000100:00100000:2.0:1788270104.756173:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 330 00000100:00100000:2.0:1788270104.756186:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:38092:x1875136253234688:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270104.756334:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:38092:x1875136253234688:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 151us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.756343:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 330 00000100:00100000:2.0:1788270104.760508:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270104.760575:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253234816 00000100:00100000:0.0:1788270104.760588:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253234816 00000100:00100000:0.0:1788270104.760675:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 331 00000100:00100000:0.0:1788270104.760688:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:38092:x1875136253234816:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270104.760716:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270104.760741:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09de1 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dc2 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.760841:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09de8 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.760859:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09de8 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.760872:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09de8 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270104.760928:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270104.760952:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09de8 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.760982:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09de1 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc2 expref: 57 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.761015:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09de8 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc2 expref: 56 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.761025:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270104.761028:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788270104.761032:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9e200, rc 0) 00000100:00100000:0.0:1788270104.761143:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:38092:x1875136253234816:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 457us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270104.761152:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 331 00000100:00100000:3.0:1788270104.763529:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.765378:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253234944 00000100:00100000:2.0:1788270104.765395:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253234944 00000100:00100000:2.0:1788270104.765472:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:2.0:1788270104.765482:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2403:x1875136253234944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270104.765514:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270104.765546:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dc9 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270104.765584:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d618, blocks: 0x0 00010000:00010000:2.0:1788270104.765607:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=896s v=(0 0) 00010000:00010000:2.0:1788270104.765612:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270104.765621:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 19 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.765639:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 19 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.765652:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821db400, rc 0) 00000100:00100000:2.0:1788270104.765773:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2403:x1875136253234944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 293us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.765779:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:3.0:1788270104.767964:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.769877:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235200 00000100:00100000:2.0:1788270104.769894:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235200 00000100:00100000:2.0:1788270104.770021:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 332 00000100:00100000:2.0:1788270104.770033:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:38092:x1875136253235200:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270104.770214:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:38092:x1875136253235200:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 182us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.770223:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 332 00000100:00100000:1.0:1788270104.775291:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270104.775765:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235328 00000100:00100000:2.0:1788270104.775778:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235328 00000100:00100000:2.0:1788270104.775845:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:2.0:1788270104.775858:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38092:x1875136253235328:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270104.775882:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270104.775909:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dd0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.775950:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.775961:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270104.775967:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270104.775973:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 20 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.776020:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.776036:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 996 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270104.776078:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262657792:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270104.776203:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270104.778601:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262657792:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270104.778635:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 20 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270104.778657:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030e00, rc 0) 00000100:00100000:2.0:1788270104.778792:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38092:x1875136253235328:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2936us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270104.778803:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:3.0:1788270104.779546:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270104.781175:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235456 00000100:00100000:0.0:1788270104.781195:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235456 00010000:00010000:0.0:1788270104.781258:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 996 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270104.781321:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:0.0:1788270104.781333:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253235456:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270104.781352:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270104.781376:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 996 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.781390:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 996 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.781417:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc87e35/0xc5f5d7a016e09def lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc9 expref: 20 pid: 48230 timeout: 996 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.781436:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270104.781441:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270104.781451:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 19 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.781461:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 19 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270104.781517:0:48804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 19 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270104.781535:0:48804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262657920:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788270104.781651:0:48804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c272618a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788270104.791695:0:48804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:48804:1875136262657920:192.168.201.42@tcp:105: 00010000:00010000:0.0:1788270104.791732:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270104.791799:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253235456:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 10469us (12257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270104.791809:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:3.0:1788270104.850572:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270104.850778:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235584 00000100:00100000:0.0:1788270104.850792:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235584 00002000:00100000:0.0:1788270104.850865:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc3:0x0] (0->4194303) req@ffff98c14ad96680 x1875136253235584/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:520/0 lens 488/0 e 0 to 0 dl 1788270115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270104.850879:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14ad96680 with x1875136253235584 ext(0->4194303) 00002000:00010000:0.0:1788270104.850886:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14ad96680 00000100:00100000:0.0:1788270104.850921:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:0.0:1788270104.850931:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253235584:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270104.905894:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253235584:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 54947us (55321us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1788270104.905912:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00002000:00100000:2.0:1788270104.905928:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc3:0x0] (0->4194303) req@ffff98c14ad96680 x1875136253235584/t30064771126(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:520/0 lens 488/448 e 0 to 0 dl 1788270115 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270104.905938:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14ad96680 with x1875136253235584 ext(0->4194303) 00002000:00010000:2.0:1788270104.905947:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14ad96680 00000100:00100000:2.0:1788270104.930945:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.931080:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235712 00000100:00100000:3.0:1788270104.931094:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235712 00002000:00100000:3.0:1788270104.931169:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (4194304->8388607) req@ffff98c1483a4e00 x1875136253235712/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:520/0 lens 488/0 e 0 to 0 dl 1788270115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270104.931182:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a4e00 with x1875136253235712 ext(4194304->8388607) 00002000:00010000:3.0:1788270104.931191:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1483a4e00 00000100:00100000:3.0:1788270104.931229:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:3.0:1788270104.931240:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253235712:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270104.969832:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253235712:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 38579us (38887us total) trans 30064771127 rc 0/0 00000100:00100000:0.0:1788270104.969848:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00002000:00100000:0.0:1788270104.969869:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (4194304->8388607) req@ffff98c1483a4e00 x1875136253235712/t30064771127(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:520/0 lens 488/448 e 0 to 0 dl 1788270115 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270104.969883:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a4e00 with x1875136253235712 ext(4194304->8388607) 00002000:00010000:0.0:1788270104.969891:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1483a4e00 00000100:00100000:1.0:1788270104.999215:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270104.999335:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235840 00000100:00100000:3.0:1788270104.999349:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235840 00002000:00100000:3.0:1788270104.999415:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc3:0x0] (8388608->12582911) req@ffff98c14a49f800 x1875136253235840/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:520/0 lens 488/0 e 0 to 0 dl 1788270115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270104.999427:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14a49f800 with x1875136253235840 ext(8388608->12582911) 00002000:00010000:3.0:1788270104.999445:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14a49f800 00000100:00100000:3.0:1788270104.999482:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:3.0:1788270104.999503:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2402:x1875136253235840:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00010000:00010000:2.0:1788270105.028204:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270105.064887:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2402:x1875136253235840:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 65382us (65680us total) trans 30064771128 rc 0/0 00000100:00100000:0.0:1788270105.064903:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00002000:00100000:0.0:1788270105.064918:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc3:0x0] (8388608->12582911) req@ffff98c14a49f800 x1875136253235840/t30064771128(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:520/0 lens 488/448 e 0 to 0 dl 1788270115 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270105.064942:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14a49f800 with x1875136253235840 ext(8388608->12582911) 00002000:00010000:0.0:1788270105.064950:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14a49f800 00000100:00100000:2.0:1788270105.089772:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.093842:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253235968 00000100:00100000:0.0:1788270105.093864:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253235968 00002000:00100000:0.0:1788270105.093948:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc3:0x0] (12582912->16777215) req@ffff98c1483a4000 x1875136253235968/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/0 e 0 to 0 dl 1788270116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270105.093962:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a4000 with x1875136253235968 ext(12582912->16777215) 00002000:00010000:0.0:1788270105.093972:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1483a4000 00000100:00100000:0.0:1788270105.094114:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:0.0:1788270105.094128:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2400:x1875136253235968:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270105.142796:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2400:x1875136253235968:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 48652us (53025us total) trans 30064771129 rc 0/0 00000100:00100000:0.0:1788270105.142816:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00002000:00100000:0.0:1788270105.142834:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc3:0x0] (12582912->16777215) req@ffff98c1483a4000 x1875136253235968/t30064771129(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/448 e 0 to 0 dl 1788270116 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270105.142847:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a4000 with x1875136253235968 ext(12582912->16777215) 00002000:00010000:0.0:1788270105.142855:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1483a4000 00000100:00100000:2.0:1788270105.158452:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.158616:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253236096 00000100:00100000:0.0:1788270105.158629:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253236096 00002000:00100000:0.0:1788270105.158693:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc3:0x0] (16777216->20971519) req@ffff98c1483a6680 x1875136253236096/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/0 e 0 to 0 dl 1788270116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270105.158707:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a6680 with x1875136253236096 ext(16777216->20971519) 00002000:00010000:0.0:1788270105.158715:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1483a6680 00000100:00100000:0.0:1788270105.158760:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788270105.158772:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2400:x1875136253236096:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788270105.191193:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2400:x1875136253236096:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 32405us (32737us total) trans 30064771130 rc 0/0 00000100:00100000:1.0:1788270105.191213:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00002000:00100000:1.0:1788270105.191233:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc3:0x0] (16777216->20971519) req@ffff98c1483a6680 x1875136253236096/t30064771130(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/448 e 0 to 0 dl 1788270116 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270105.191247:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a6680 with x1875136253236096 ext(16777216->20971519) 00002000:00010000:1.0:1788270105.191255:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1483a6680 00000100:00100000:2.0:1788270105.195213:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270105.195323:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253236224 00000100:00100000:3.0:1788270105.195337:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253236224 00000100:00100000:3.0:1788270105.195442:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 333 00000100:00100000:3.0:1788270105.195454:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:38092:x1875136253236224:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788270105.198694:0:46509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771106 is committed 00000004:00080000:1.0:1788270105.198724:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000020:00080000:1.0:1788270105.198776:0:46509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c142802840 refcount 2 committed 0 result 0 batchid 25769803850 00000020:00080000:1.0:1788270105.198783:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14437c900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c142802e40 00000020:00080000:1.0:1788270105.198787:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14437c600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c247997400 00000004:00080000:1.0:1788270105.198822:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:1.0:1788270105.198842:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000020:00080000:1.0:1788270105.198854:0:46509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c1428020c0 refcount 2 committed 0 result 0 batchid 25769803849 00000020:00080000:1.0:1788270105.198857:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14437c700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c142802840 00000020:00080000:1.0:1788270105.198861:0:46509:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000032e2:0x1:0x0].1 00000020:00080000:1.0:1788270105.198864:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14437c400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14388c200 00000020:00080000:1.0:1788270105.198867:0:46509:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400032e1:0x1:0x0].1 00000100:00100000:0.0:1788270105.199071:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270105.199096:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262658048:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1788270105.199189:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270105.199227:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262658048 00000100:00100000:1.0:1788270105.199236:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262658048 00000100:00100000:1.0:1788270105.199312:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788270105.199323:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262658048:12345-0@lo:2:osp-syn-1-1.0 00000020:00080000:3.0:1788270105.199349:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769803850 committed batchid 21474836518 00000020:00080000:3.0:1788270105.199428:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836518 00000100:00100000:3.0:1788270105.199478:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270105.199501:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262658176:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1788270105.199546:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270105.199558:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3608:x1875136262658048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 235us (369us total) trans 30064771131 rc 0/0 00000100:00100000:1.0:1788270105.199567:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788270105.199584:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262658176 00000100:00100000:3.0:1788270105.199589:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262658176 00000100:00100000:3.0:1788270105.199630:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788270105.199637:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262658176:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1788270105.199771:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 12582912 -> 12582912 00002000:00010000:3.0:1788270105.199775:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1788270103 -> 1788270103 00002000:00010000:3.0:1788270105.199778:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270105.199780:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788270103 -> 1788270103 00002000:00010000:3.0:1788270105.199783:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 24576 -> 24576 00000100:00100000:3.0:1788270105.199815:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262658176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 179us (279us total) trans 30064771101 rc 0/0 00000100:00100000:3.0:1788270105.199822:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000004:00080000:1.0:1788270105.199872:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14ad95500/2, rc 0, transno 30064771101 00000100:00100000:1.0:1788270105.199882:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262658176:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1788270105.199915:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14720c700/2, rc 0, transno 30064771131 00000100:00100000:3.0:1788270105.199931:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262658048:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1788270105.200076:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:38092:x1875136253236224:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 4622us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270105.200085:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 333 00000100:00100000:3.0:1788270105.200109:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262658304:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1788270105.200134:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270105.200163:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262658304 00000100:00100000:3.0:1788270105.200166:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262658304 00000100:00100000:3.0:1788270105.200191:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788270105.200199:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3609:x1875136262658304:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1788270105.200215:0:47284:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:194 count 1 00002000:00010000:3.0:1788270105.200243:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc2:0x0] initial LVB size: 15728640, mtime: 0x6a96d617, atime: 0x6a96d617, ctime: 0x6a96d617, blocks: 0x7800 00010000:00010000:3.0:1788270105.200253:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.200273:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=896s v=(0 0) 00010000:00010000:3.0:1788270105.200279:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270105.200285:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.200302:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.200314:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.200323:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.200345:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788270105.200424:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270105.200433:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.200444:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270105.200451:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270105.200452:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3609:x1875136262658304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 252us (316us total) trans 30064771132 rc 0/0 00000100:00100000:3.0:1788270105.200467:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:1.0:1788270105.200472:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270105.200502:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14a49ea00/2, rc 0, transno 30064771132 00010000:00010000:1.0:1788270105.200508:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270105.200513:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262658304:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1788270105.200525:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b58c6d/0xc5f5d7a016e09dfd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.200550:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270105.200552:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270105.200554:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788270105.200610:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788270105.202211:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202230:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202237:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202243:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202249:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202256:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202274:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:2.0:1788270105.202278:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270105.202282:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202288:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09b6b lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202315:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202327:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202333:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202338:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202341:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202346:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202353:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x852f64c2 (ffff98c1429f8900) 00010000:00010000:2.0:1788270105.202356:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270105.202359:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202364:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bec00/0xc5f5d7a016e09bc6 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202386:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202393:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202400:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202405:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202408:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202415:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202422:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0xdee864c2 (ffff98c1429fb500) 00010000:00010000:2.0:1788270105.202425:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270105.202427:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202433:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821db600/0xc5f5d7a016e09bf0 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x1:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202454:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202460:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202467:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202471:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202474:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202480:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202498:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270105.202501:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270105.202504:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202511:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e09c1a lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202522:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202529:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202543:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202548:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821dbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202551:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202558:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202565:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x3:0x0].0x0 (ffff98c1429fb200) 00010000:00010000:2.0:1788270105.202567:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270105.202570:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202576:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09c36 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202587:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202593:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202600:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202605:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202608:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202614:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202620:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270105.202622:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270105.202625:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202630:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031200/0xc5f5d7a016e09d5c lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202641:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202647:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202652:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202657:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.202660:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202670:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202678:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:2.0:1788270105.202680:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270105.202683:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.202688:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09dd3 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270105.203137:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.203332:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253236352 00000100:00100000:1.0:1788270105.203343:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253236352 00000100:00100000:1.0:1788270105.203408:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:1.0:1788270105.203418:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2400:x1875136253236352:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788270105.205670:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771132 is committed 00000001:00080000:2.0:1788270105.205690:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771130 is committed 00000100:00100000:1.0:1788270105.205902:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253236352:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 2479us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270105.205915:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:1.0:1788270105.225420:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.225562:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253236608 00000100:00100000:0.0:1788270105.225574:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253236608 00000100:00100000:0.0:1788270105.225746:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 334 00000100:00100000:0.0:1788270105.225758:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:38092:x1875136253236608:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270105.225826:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270105.225873:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09de8 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dc2 expref: 15 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.225897:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270105.225902:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270105.225938:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.225955:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.225966:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270105.226387:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005218ae10 reply state 00000000624930c7 transno 30064771107 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.226408:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.226415:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270105.226418:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270105.226421:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270105.226559:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:38092:x1875136253236608:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 802us (1151us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1788270105.226567:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 334 00000100:00100000:2.0:1788270105.229405:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270105.229464:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253236736 00000100:00100000:3.0:1788270105.229474:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253236736 00000100:00100000:3.0:1788270105.229554:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:3.0:1788270105.229566:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253236736:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788270105.229762:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:3.0:1788270105.229765:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788270103 00002000:00010000:3.0:1788270105.229767:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1788270103 00002000:00010000:3.0:1788270105.229768:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb ctime from disk: 1788270104 -> 1788270103 00002000:00010000:3.0:1788270105.229770:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb blocks from disk: 0 -> 40960 00000100:00100000:3.0:1788270105.229823:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253236736:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 261us (431us total) trans 30064771133 rc 0/0 00000100:00100000:3.0:1788270105.229828:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:2.0:1788270105.231925:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.232077:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253236992 00000100:00100000:1.0:1788270105.232086:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253236992 00000100:00100000:1.0:1788270105.232451:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 335 00000100:00100000:1.0:1788270105.232463:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:38092:x1875136253236992:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788270105.232558:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.232577:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.232589:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 4/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.232629:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 16 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.232645:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 16 pid: 45777 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270105.232661:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:46770:1875136262658432:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270105.232770:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2585d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788270105.234312:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:46770:1875136262658432:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270105.234342:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270105.234586:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.234727:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253237120 00000100:00100000:1.0:1788270105.234736:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253237120 00010000:00010000:1.0:1788270105.234774:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 17 pid: 45777 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270105.234864:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788270105.234872:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253237120:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270105.234884:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270105.234890:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 17 pid: 45777 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.234900:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 17 pid: 45777 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.234924:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09dcc lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101db4 expref: 17 pid: 45777 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.234942:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:1.0:1788270105.234948:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.234957:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.234962:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 4/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.234986:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270105.235088:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235094:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235133:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235142:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 2/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235147:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235151:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19aa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.235155:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235160:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 4/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235166:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:2.0:1788270105.235167:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788270105.235170:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 2/0,0 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.235174:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e0b lrc: 0/0,0 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270105.235207:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:38092:x1875136253236992:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 2748us (3291us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788270105.235213:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 335 00000100:00100000:1.0:1788270105.235322:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253237120:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 156us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270105.235327:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788270105.238769:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.238869:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253237248 00000100:00100000:0.0:1788270105.238881:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253237248 00000100:00100000:0.0:1788270105.238938:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:0.0:1788270105.238950:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253237248:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788270105.239003:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.239023:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 10 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.239030:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270105.239034:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270105.239070:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.239104:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 10 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.239121:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 10 pid: 47284 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270105.239135:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262658560:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270105.239213:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2726183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270105.241071:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262658560:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270105.241105:0:48231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270105.284018:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.284227:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253237376 00000100:00100000:0.0:1788270105.284239:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253237376 00010000:00010000:0.0:1788270105.284286:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 11 pid: 47284 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270105.284329:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:0.0:1788270105.284337:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2400:x1875136253237376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270105.284351:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270105.284375:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 11 pid: 47284 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.284388:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 11 pid: 47284 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.284410:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076c65ee/0xc5f5d7a016e09df6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd0 expref: 11 pid: 47284 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.284430:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270105.284435:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270105.284443:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.284454:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.284502:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270105.284562:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253237376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 225us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270105.284568:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00010000:00010000:3.0:1788270105.284682:0:48231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284690:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284709:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284714:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284720:0:48231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284731:0:48231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270105.284735:0:48231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284741:0:48231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284749:0:48231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.284753:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36ddfc8/0xc5f5d7a016e09e12 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270105.284795:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253237248:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 45849us (46040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270105.284800:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:0.0:1788270105.289276:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270105.289395:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253237632 00000100:00100000:3.0:1788270105.289406:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253237632 00000100:00100000:3.0:1788270105.289473:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 336 00000100:00100000:3.0:1788270105.289482:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:38092:x1875136253237632:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788270105.289603:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.289624:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 15 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.289640:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 4/0,1 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.289686:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 15 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.289700:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 15 pid: 46770 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270105.289718:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:45776:1875136262658688:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270105.289870:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2514ad540 going to sleep for 11 seconds 00000100:00100000:2.0:1788270105.292591:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.292713:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253237760 00000100:00100000:0.0:1788270105.292725:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253237760 00010000:00010000:0.0:1788270105.292771:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 5/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 16 pid: 46770 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270105.292820:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788270105.292840:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253237760:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270105.292857:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270105.292865:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 5/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 16 pid: 46770 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.292880:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 16 pid: 46770 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.292908:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270105.292915:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 16 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.292928:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.292936:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.292944:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 4/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.292966:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270105.293034:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253237760:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 197us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270105.293060:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00010000:00010000:3.0:1788270105.293649:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031e00/0xc5f5d7a016e09d55 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d98 expref: 15 pid: 46770 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270105.293672:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:45776:1875136262658688:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270105.293698:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.293709:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.293715:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.293999:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.294010:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 15 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.294017:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 4/0,1 mode: --/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.294178:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 15 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.294190:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 15 pid: 46770 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270105.294202:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:45776:1875136262658816:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270105.294310:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1424956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270105.297785:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:45776:1875136262658816:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270105.297918:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.298001:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253237888 00000100:00100000:1.0:1788270105.298010:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253237888 00010000:00010000:1.0:1788270105.298086:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 16 pid: 46770 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270105.298173:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:1.0:1788270105.298185:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253237888:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270105.298202:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270105.298210:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 16 pid: 46770 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.298224:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 16 pid: 46770 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.298231:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.298279:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c2821da400/0xc5f5d7a016e09dda lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dbb expref: 16 pid: 46770 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.298297:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:1.0:1788270105.298303:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.298311:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.298318:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 4/0,1 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.298340:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270105.298357:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.298363:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270105.298401:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253237888:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 219us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270105.298408:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000001:00080000:2.0:1788270105.298611:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771108 00000001:00080000:2.0:1788270105.298761:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771109 00000001:00080000:2.0:1788270105.298793:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771110 00000100:00100000:2.0:1788270105.298869:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262658944:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270105.298916:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270105.298946:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788270105.298957:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262658944 00000100:00100000:3.0:1788270105.298963:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262658944 00000100:00100000:3.0:1788270105.299006:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788270105.299014:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:45776:x1875136262658944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270105.301013:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:45776:x1875136262658944:12345-0@lo:1000:mdt00_000.0 Request processed in 1988us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270105.301183:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 30064771132 gen 2 00000004:00080000:2.0:1788270105.301191:0:45776:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771124 committed transno 30064771132 00000004:00080000:2.0:1788270105.301213:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14720c700, transno 30064771131 00000004:00080000:2.0:1788270105.301266:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14a49ea00, transno 30064771132 00000100:00100000:3.0:1788270105.301379:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788270105.301430:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262658944:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788270105.301668:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771111 00000100:00100000:2.0:1788270105.301736:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262659072:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270105.301786:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270105.301815:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1429b8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788270105.301874:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659072 00000100:00100000:3.0:1788270105.301881:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659072 00000100:00100000:3.0:1788270105.301922:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788270105.301932:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:45776:x1875136262659072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270105.302114:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262659072:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (326us total) trans 30064771134 rc 0/0 00000100:00100000:3.0:1788270105.302121:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788270105.302136:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262659072:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788270105.302179:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302191:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 2/0,0 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302199:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302207:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.302212:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302225:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 4/0,0 mode: EX/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302245:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:2.0:1788270105.302248:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270105.302252:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 2/0,0 mode: --/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302256:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e09e20 lrc: 0/0,0 mode: --/EX res: [0x2400032e0:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302284:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302288:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 2/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302292:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302295:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270105.302297:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302300:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 4/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302305:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:2.0:1788270105.302306:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270105.302311:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302324:0:45776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302331:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270105.302374:0:45776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff98c240030000/0xc5f5d7a016e09d6a lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101d9f expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270105.302382:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:45776:1875136262659200:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270105.302472:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1428029c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270105.305447:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.305551:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253238016 00000100:00100000:0.0:1788270105.305561:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253238016 00000100:00100000:0.0:1788270105.305628:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788270105.305639:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38091:x1875136253238016:12345-192.168.201.42@tcp:49:dd.500 00000100:00100000:0.0:1788270105.305898:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38091:x1875136253238016:12345-192.168.201.42@tcp:49:dd.500 Request processed in 260us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270105.305907:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:3.0:1788270105.306005:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:45776:1875136262659200:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270105.306103:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 2/0,0 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270105.306118:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c240031400/0xc5f5d7a016e09d63 lrc: 0/0,0 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306425:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306444:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306655:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306759:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306768:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 2/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306775:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306782:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270105.306786:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 3/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306794:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 4/0,0 mode: EX/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306809:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270105.306812:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270105.306816:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 2/0,0 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306822:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e27 lrc: 0/0,0 mode: --/EX res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306834:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306839:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 2/0,0 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306844:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306849:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270105.306852:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306858:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 4/0,0 mode: PW/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306867:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270105.306869:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270105.306872:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 2/0,0 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.306878:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e09e19 lrc: 0/0,0 mode: --/PW res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270105.307176:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38092:x1875136253237632:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 17642us (17859us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1788270105.307187:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 336 00000020:00080000:0.0:1788270105.307192:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788270105.307815:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270105.307821:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270105.307845:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788270105.307854:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788270105.308171:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.308216:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253238144 00000100:00100000:1.0:1788270105.308225:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253238144 00000100:00100000:1.0:1788270105.308313:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788270105.308324:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:38091:x1875136253238144:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270105.308342:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270105.308363:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ae1ac9/0xc5f5d7a016e09e2e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dd7 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270105.308389:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc3:0x0] initial LVB size: 20971520, mtime: 0x6a96d617, atime: 0x6a96d617, ctime: 0x6a96d617, blocks: 0xa000 00010000:00010000:1.0:1788270105.308413:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=897s v=(0 0) 00010000:00010000:1.0:1788270105.308418:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270105.308430:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ae1ac9/0xc5f5d7a016e09e2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd7 expref: 10 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.308449:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0ae1ac9/0xc5f5d7a016e09e2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dd7 expref: 10 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.308464:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b000, rc 0) 00000100:00100000:1.0:1788270105.308522:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:38091:x1875136253238144:12345-192.168.201.42@tcp:101:dd.500 Request processed in 200us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270105.308528:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788270105.310861:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.311020:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253238272 00000100:00100000:0.0:1788270105.311030:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253238272 00000100:00100000:0.0:1788270105.311320:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 337 00000100:00100000:0.0:1788270105.311331:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38091:x1875136253238272:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270105.311359:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270105.311382:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e35 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dde expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.311423:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09e3c lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.311437:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09e3c lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.311451:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09e3c lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.311620:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09e35 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dde expref: 20 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.311639:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9fc00/0xc5f5d7a016e09e3c lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dde expref: 19 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.311649:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:0.0:1788270105.311652:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270105.311656:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9fc00, rc 0) 00000100:00100000:0.0:1788270105.311738:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38091:x1875136253238272:12345-192.168.201.42@tcp:101:dd.500 Request processed in 408us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270105.311746:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 337 00000100:00100000:2.0:1788270105.381227:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.381549:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253238528 00000100:00100000:1.0:1788270105.381565:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253238528 00000100:00100000:1.0:1788270105.381646:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:1.0:1788270105.381659:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38092:x1875136253238528:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788270105.382185:0:45780:0:(mdd_object.c:4014:mdd_close()) Object [0x2400032e0:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788270105.382228:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771113 00010000:00010000:1.0:1788270105.382275:0:45780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.382297:0:45780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.382311:0:45780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.382320:0:45780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 4/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.382327:0:45780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 4/0,1 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.382335:0:45780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.382350:0:45780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270105.382467:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38092:x1875136253238528:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 811us (1258us total) trans 30064771114 rc 0/0 00000100:00100000:1.0:1788270105.382476:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000020:00080000:1.0:1788270105.382493:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270105.383068:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270105.383079:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 2/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.383088:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270105.383097:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 2/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.383107:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 3/0,0 mode: PW/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.383124:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270105.383127:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270105.383132:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 1/0,0 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.383137:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09e43 lrc: 0/0,0 mode: --/PW res: [0x2400032e0:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270105.383153:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270105.383155:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270105.383156:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270105.395701:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270105.395846:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253238656 00000100:00100000:2.0:1788270105.395861:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253238656 00002000:00100000:2.0:1788270105.395931:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (20971520->25165823) req@ffff98c14ad96d80 x1875136253238656/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/0 e 0 to 0 dl 1788270116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788270105.395946:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14ad96d80 with x1875136253238656 ext(20971520->25165823) 00002000:00010000:2.0:1788270105.395954:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14ad96d80 00000100:00100000:2.0:1788270105.396085:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:2.0:1788270105.396099:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253238656:12345-192.168.201.42@tcp:4:dd.500 00000100:00100000:0.0:1788270105.444420:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253238656:12345-192.168.201.42@tcp:4:dd.500 Request processed in 48308us (48718us total) trans 30064771135 rc 0/0 00000100:00100000:0.0:1788270105.444439:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00002000:00100000:0.0:1788270105.444455:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (20971520->25165823) req@ffff98c14ad96d80 x1875136253238656/t30064771135(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/448 e 0 to 0 dl 1788270116 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788270105.444467:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14ad96d80 with x1875136253238656 ext(20971520->25165823) 00002000:00010000:0.0:1788270105.444476:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14ad96d80 00000100:00100000:2.0:1788270105.459535:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270105.459658:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253238784 00000100:00100000:0.0:1788270105.459672:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253238784 00002000:00100000:0.0:1788270105.459813:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc3:0x0] (25165824->29360127) req@ffff98c27a618e00 x1875136253238784/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/0 e 0 to 0 dl 1788270116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788270105.459837:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a618e00 with x1875136253238784 ext(25165824->29360127) 00002000:00010000:0.0:1788270105.459846:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a618e00 00000100:00100000:0.0:1788270105.459940:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788270105.459954:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253238784:12345-192.168.201.42@tcp:4:dd.500 00000100:00100000:3.0:1788270105.491166:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.491735:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239040 00000100:00100000:1.0:1788270105.491747:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239040 00000100:00100000:1.0:1788270105.491809:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788270105.491822:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38091:x1875136253239040:12345-192.168.201.42@tcp:35:dd.500 00000001:00080000:1.0:1788270105.492030:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771115 00000001:00080000:1.0:1788270105.492129:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771116 00000100:00100000:1.0:1788270105.492237:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38091:x1875136253239040:12345-192.168.201.42@tcp:35:dd.500 Request processed in 417us (1084us total) trans 30064771117 rc 0/0 00000100:00100000:1.0:1788270105.492246:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000020:00080000:1.0:1788270105.492252:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788270105.496853:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253238784:12345-192.168.201.42@tcp:4:dd.500 Request processed in 36887us (37319us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1788270105.496872:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00002000:00100000:0.0:1788270105.496889:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc3:0x0] (25165824->29360127) req@ffff98c27a618e00 x1875136253238784/t30064771136(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:521/0 lens 488/448 e 0 to 0 dl 1788270116 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788270105.496901:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a618e00 with x1875136253238784 ext(25165824->29360127) 00002000:00010000:0.0:1788270105.496909:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a618e00 00000100:00100000:2.0:1788270105.536350:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270105.536687:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239168 00000100:00100000:1.0:1788270105.536702:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239168 00000100:00100000:1.0:1788270105.536782:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 338 00000100:00100000:1.0:1788270105.536794:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38102:x1875136253239168:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270105.536902:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.536923:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.536937:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.536954:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.536962:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.536969:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537077:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537088:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537095:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270105.537150:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537167:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537175:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537182:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537189:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537196:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270105.537201:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537209:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537223:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x0 (ffff98c14387f400) 00010000:00010000:1.0:1788270105.537226:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270105.537231:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537239:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09e4a lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537257:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537264:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537270:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537276:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19be00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270105.537278:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537284:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537290:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x1:0x0].0x852f64c2 (ffff98c143876a00) 00010000:00010000:1.0:1788270105.537293:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270105.537296:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537302:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09e51 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x1:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537318:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537325:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537332:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537337:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270105.537339:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537346:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537353:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x2:0x0].0x0 (ffff98c1429f8700) 00010000:00010000:1.0:1788270105.537355:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270105.537358:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270105.537364:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09e58 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270105.538214:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38102:x1875136253239168:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 1417us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270105.538225:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 338 00010000:00010000:2.0:1788270106.052239:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270106.311762:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262659328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270106.311864:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270106.311945:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659328 00000100:00100000:3.0:1788270106.311957:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659328 00000100:00100000:3.0:1788270106.312028:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788270106.312059:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262659328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270106.312098:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66854592 pending 12656640 free 3910914048 avail 3679391744 00000100:00100000:3.0:1788270106.312146:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262659328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270106.312157:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788270106.312186:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270106.312238:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262659328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270106.820328:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262659456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270106.820435:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270106.820565:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659456 00000100:00100000:0.0:1788270106.820576:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659456 00000100:00100000:0.0:1788270106.820664:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788270106.820675:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262659456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270106.820718:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446146048 avail 1299906560 00000100:00100000:0.0:1788270106.831231:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262659456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10539us (10777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270106.831255:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788270106.831522:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262659456:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270107.080460:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270108.101268:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270108.356281:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788270108.356288:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270108.356309:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:3.0:1788270108.356315:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:00080000:3.0:1788270108.359684:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771101 is committed 00000001:00080000:3.0:1788270108.359695:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771100 is committed 00000100:00100000:3.0:1788270108.459364:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270108.459426:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239296 00000100:00100000:0.0:1788270108.459447:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239296 00000100:00100000:0.0:1788270108.459606:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 339 00000100:00100000:0.0:1788270108.459618:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38033:x1875136253239296:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788270108.459717:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38033:x1875136253239296:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270108.459722:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 339 00000100:00080000:3.0:1788270108.459801:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270108.462756:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270108.462878:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239424 00000100:00100000:0.0:1788270108.462887:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239424 00000100:00100000:0.0:1788270108.462985:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 340 00000100:00100000:0.0:1788270108.462993:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38033:x1875136253239424:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788270108.463122:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38033:x1875136253239424:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 129us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270108.463131:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 340 00000100:00080000:3.0:1788270108.463481:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270108.465311:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270108.465563:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239680 00000100:00100000:0.0:1788270108.465573:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239680 00000100:00100000:0.0:1788270108.465635:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:0.0:1788270108.465646:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38033:x1875136253239680:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788270108.465967:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38033:x1875136253239680:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 219us (559us total) trans 30064771309 rc 0/0 00000100:00100000:0.0:1788270108.465976:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788270108.578915:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270108.579134:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239808 00000100:00100000:1.0:1788270108.579145:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239808 00000100:00100000:1.0:1788270108.579362:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 341 00000100:00100000:1.0:1788270108.579374:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:38550:x1875136253239808:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:1.0:1788270108.579392:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270108.579413:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101de5 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270108.579507:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270108.579521:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270108.579534:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270108.579594:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270108.579598:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270108.579622:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270108.579646:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 7 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270108.579666:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 6 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270108.579676:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270108.579679:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270108.579683:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a200, rc 0) 00000100:00100000:1.0:1788270108.579749:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:38550:x1875136253239808:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 376us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270108.579756:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 341 00000100:00080000:3.0:1788270108.580303:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270108.869457:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262659584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270108.869531:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270108.869888:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659584 00000100:00100000:3.0:1788270108.869896:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659584 00000100:00100000:3.0:1788270108.869953:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788270108.869963:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262659584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270108.869998:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788270108.870070:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262659584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270108.870077:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788270108.870164:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262659584:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270109.124189:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270109.185943:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270109.186084:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270109.186122:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270109.186148:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270109.186148:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240192 00000100:00100000:0.0:1788270109.186157:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240192 00000100:00100000:2.0:1788270109.186167:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270109.186183:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270109.186206:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240704 00000100:00100000:0.0:1788270109.186209:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240704 00000100:00100000:2.0:1788270109.186217:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270109.186234:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240064 00000100:00100000:0.0:1788270109.186237:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240064 00000100:00100000:0.0:1788270109.186247:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240576 00000100:00100000:0.0:1788270109.186249:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240576 00000100:00080000:2.0:1788270109.186263:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270109.186265:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788270109.186274:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:2402:x1875136253240192:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270109.186277:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788270109.186285:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253240704:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270109.186341:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253240704:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270109.186349:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788270109.186368:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:3.0:1788270109.186369:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240448 00000100:00100000:3.0:1788270109.186373:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240448 00000100:00100000:2.0:1788270109.186375:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2402:x1875136253240064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270109.186403:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240320 00000100:00100000:3.0:1788270109.186405:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240320 00000100:00100000:3.0:1788270109.186443:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788270109.186452:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253240448:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270109.186499:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:2402:x1875136253240192:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 225us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270109.186507:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788270109.186521:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788270109.186528:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253240576:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270109.186553:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253240576:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270109.186560:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788270109.186719:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:0.0:1788270109.186727:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2402:x1875136253240320:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270109.187923:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:2402:x1875136253240320:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1191us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270109.187933:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00080000:0.0:1788270109.187975:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270109.187979:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270109.188955:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253239936 00000100:00100000:1.0:1788270109.188964:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253239936 00000100:00100000:1.0:1788270109.189140:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:1.0:1788270109.189150:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253239936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270109.189226:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253239936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.189237:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:2.0:1788270109.189333:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2402:x1875136253240064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2955us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270109.189343:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:3.0:1788270109.189855:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253240448:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3402us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.189864:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788270109.380655:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262659712:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380728:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.380769:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262660224:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380792:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.380809:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262660736:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380824:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.380837:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262661248:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380852:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.380871:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788270109.380876:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262659840:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380895:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.380908:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262660352:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380924:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.380956:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262660864:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.380974:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.381005:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262661376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270109.381032:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.381081:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262659968:0@lo:400:kworker.0 00000004:00080000:1.0:1788270109.381090:0:46521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 901088049206ns, next at 902088045937ns, rc = 0 00000100:00100000:3.0:1788270109.381109:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.381130:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262660480:0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.381142:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659968 00000100:00100000:3.0:1788270109.381149:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270109.381151:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659968 00000100:00100000:3.0:1788270109.381166:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262660992:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.381186:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.381203:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262661504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270109.381219:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660480 00000100:00100000:3.0:1788270109.381224:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270109.381225:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660480 00000100:00100000:3.0:1788270109.381246:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788270109.381253:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262660096:0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.381268:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788270109.381273:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270109.381284:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262659968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.381290:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262660608:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.381310:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270109.381320:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262661120:0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.381356:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262659968:12345-0@lo:400:kworker.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.381364:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788270109.381380:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660096 00000100:00100000:1.0:1788270109.381384:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660096 00000100:00100000:1.0:1788270109.381397:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660608 00000100:00100000:1.0:1788270109.381399:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660608 00000100:00100000:0.0:1788270109.381424:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659712 00000100:00100000:1.0:1788270109.381427:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788270109.381431:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659712 00000100:00100000:1.0:1788270109.381438:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262660480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270109.381471:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788270109.381479:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262659712:12345-0@lo:400:kworker.0 00000040:00080000:2.0:1788270109.381590:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270109.381595:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270109.381619:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 8 count 8 00000040:00080000:2.0:1788270109.381626:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270109.381679:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262659840 00000100:00100000:2.0:1788270109.381683:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262659840 00000100:00100000:2.0:1788270109.381710:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660352 00000100:00100000:2.0:1788270109.381713:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660352 00000100:00100000:2.0:1788270109.381725:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788270109.381731:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262659840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383196:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270109.383227:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262660480:12345-0@lo:400:kworker.0 Request processed in 1790us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383229:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262661632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270109.383237:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788270109.383262:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788270109.383267:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262659712:12345-0@lo:400:kworker.0 Request processed in 1786us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383271:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270109.383275:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262660096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270109.383281:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788270109.383313:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262659968:0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383313:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262660096:12345-0@lo:400:kworker.0 Request processed in 41us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383320:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788270109.383324:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 30064771101 gen 2 00000004:00080000:3.0:1788270109.383328:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14ad95500, transno 30064771101 00000100:00100000:1.0:1788270109.383332:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788270109.383337:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262660480:0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383338:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262660608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383362:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262660096:0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383364:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262660608:12345-0@lo:400:kworker.0 Request processed in 27us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383369:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788270109.383371:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262660608:0@lo:400:kworker.0 00000100:00080000:1.0:1788270109.383396:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270109.383398:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1788270109.383401:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270109.383406:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262660352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383443:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660224 00000100:00100000:1.0:1788270109.383449:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660224 00000100:00100000:3.0:1788270109.383453:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262660352:12345-0@lo:400:kworker.0 Request processed in 49us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383460:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788270109.383470:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660736 00000100:00100000:1.0:1788270109.383473:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660736 00000100:00100000:3.0:1788270109.383478:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262661376 00000100:00100000:3.0:1788270109.383481:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262661376 00000100:00100000:1.0:1788270109.383482:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262661248 00000100:00100000:1.0:1788270109.383484:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262661248 00000100:00100000:3.0:1788270109.383495:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262661504 00000100:00100000:3.0:1788270109.383498:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262661504 00000100:00100000:1.0:1788270109.383501:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660864 00000100:00100000:1.0:1788270109.383503:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660864 00000100:00100000:3.0:1788270109.383506:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262661632 00000100:00100000:3.0:1788270109.383508:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262661632 00000100:00100000:1.0:1788270109.383514:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262660992 00000100:00100000:1.0:1788270109.383516:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262660992 00000100:00100000:3.0:1788270109.383518:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788270109.383523:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262661376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270109.383527:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262661120 00000100:00100000:1.0:1788270109.383529:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262661120 00000100:00100000:1.0:1788270109.383540:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00002000:00000024:3.0:1788270109.383543:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3379200 granted 164044480 pending 8437760 free 3834535936 avail 3603013632 00000100:00100000:1.0:1788270109.383545:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262660224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383575:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262660224:12345-0@lo:400:kworker.0 Request processed in 29us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383576:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262661376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383581:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788270109.383581:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788270109.383593:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788270109.383593:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788270109.383599:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262661504:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270109.383599:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262660736:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788270109.383613:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54197952 pending 0 free 3910914048 avail 3679391744 00000100:00100000:1.0:1788270109.383623:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262660736:12345-0@lo:400:kworker.0 Request processed in 26us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383630:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788270109.383636:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262661504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383640:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788270109.383641:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788270109.383645:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262661248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383650:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788270109.383655:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262661632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270109.383663:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3379200 granted 164044480 pending 8437760 free 3834535936 avail 3603013632 00000100:00100000:1.0:1788270109.383670:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262661248:12345-0@lo:400:kworker.0 Request processed in 25us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383676:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788270109.383681:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262661632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383686:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788270109.383686:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788270109.383691:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262660864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383717:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262660864:12345-0@lo:400:kworker.0 Request processed in 26us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383722:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788270109.383733:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788270109.383738:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383761:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262660992:12345-0@lo:400:kworker.0 Request processed in 23us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270109.383766:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788270109.383776:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788270109.383782:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262661120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270109.383812:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262661120:12345-0@lo:400:kworker.0 Request processed in 30us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270109.383815:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262661376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270109.383819:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788270109.383838:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270109.383841:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270109.383864:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262660352:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383869:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262661120:0@lo:400:kworker.0 00000100:00100000:0.0:1788270109.383888:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262660864:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383893:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262661632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270109.383905:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262659712:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383912:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262660992:0@lo:400:kworker.0 00000100:00100000:0.0:1788270109.383926:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262660224:0@lo:400:kworker.0 00000100:00100000:3.0:1788270109.383933:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262661504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270109.383955:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262659840:12345-0@lo:400:kworker.0 Request processed in 2223us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270109.383962:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788270109.384003:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262660736:0@lo:400:kworker.0 00000100:00100000:0.0:1788270109.384014:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262661248:0@lo:400:kworker.0 00000100:00100000:0.0:1788270109.384068:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262659840:0@lo:400:kworker.0 00010000:00010000:1.0:1788270110.149031:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788270110.205321:0:50062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 09:41:49 (1788270109) 00000001:00080000:0.0:1788270110.409939:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771309 is committed 00000100:00100000:0.0:1788270111.069329:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.071778:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253240960 00000100:00100000:1.0:1788270111.071792:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253240960 00000100:00080000:2.0:1788270111.071862:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270111.071878:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 342 00000100:00100000:1.0:1788270111.071891:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38833:x1875136253240960:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270111.071910:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.071929:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dec expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.071997:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072010:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072022:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072034:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072077:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072083:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072166:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072174:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072180:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.072189:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788270111.072272:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072280:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072286:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072292:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19aa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.072296:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072303:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072314:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:1.0:1788270111.072326:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.072332:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072338:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09e74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072350:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072356:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072366:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072371:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.072374:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072380:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072396:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c143876a00) 00010000:00010000:1.0:1788270111.072398:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.072401:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072407:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09e7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072664:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dec expref: 21 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072678:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dec expref: 20 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.072685:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:1.0:1788270111.072687:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.072690:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b400, rc 0) 00000100:00100000:1.0:1788270111.072759:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38833:x1875136253240960:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 871us (3439us total) trans 30064771310 rc 0/0 00000100:00100000:1.0:1788270111.072771:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 342 00000100:00100000:2.0:1788270111.079008:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.079080:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241216 00000100:00100000:1.0:1788270111.079089:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241216 00000100:00100000:1.0:1788270111.079161:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 343 00000100:00100000:2.0:1788270111.079162:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.079177:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38833:x1875136253241216:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270111.079215:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241088 00000100:00100000:3.0:1788270111.079221:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241088 00000100:00100000:1.0:1788270111.079293:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38833:x1875136253241216:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270111.079302:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:1.0:1788270111.079311:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 343 00000100:00100000:3.0:1788270111.079316:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253241088:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270111.079330:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270111.079355:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09e82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dec expref: 20 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.079374:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:3.0:1788270111.079379:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270111.079418:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2403:x1875136253241088:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270111.079427:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788270111.081459:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.081520:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241344 00000100:00100000:1.0:1788270111.081529:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241344 00000100:00100000:1.0:1788270111.081593:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 344 00000100:00080000:2.0:1788270111.081596:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270111.081605:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38833:x1875136253241344:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270111.081693:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:38833:x1875136253241344:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.081701:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 344 00000100:00100000:2.0:1788270111.141636:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.141705:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241600 00000100:00100000:1.0:1788270111.141717:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241600 00000100:00100000:1.0:1788270111.142155:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 345 00000100:00100000:1.0:1788270111.142166:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:38848:x1875136253241600:12345-192.168.201.42@tcp:36:mkdir.0 00010000:00010000:1.0:1788270111.142222:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270111.142249:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e09b79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101cfe expref: 19 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.142268:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270111.142286:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270111.142344:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.142358:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 5 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.142367:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.142415:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 5 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.142428:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 5 pid: 46770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.142443:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262661760:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270111.142537:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788270111.144938:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262661760:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270111.144965:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270111.145551:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.145591:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241728 00000100:00100000:1.0:1788270111.145599:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241728 00010000:00010000:1.0:1788270111.145642:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 6 pid: 46770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788270111.145652:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270111.145677:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788270111.145685:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253241728:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270111.145696:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270111.145701:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 6 pid: 46770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.145710:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 6 pid: 46770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.145725:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101de5 expref: 6 pid: 46770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.145736:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270111.145739:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.145746:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.145750:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.145774:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270111.145802:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.145810:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.145822:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253241728:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 137us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.145831:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00010000:00010000:0.0:1788270111.145831:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.145842:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.145851:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146380:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146400:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146408:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270111.146427:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7e15867 reply state 000000004a901572 transno 30064771311 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146438:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146444:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270111.146446:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270111.146449:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788270111.146454:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 4096 00010000:00010000:0.0:1788270111.146462:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146469:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146475:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146480:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270111.146485:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146493:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146501:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270111.146503:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270111.146506:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146516:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09e90 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270111.146526:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7e15867 reply state 000000004a901572 transno 30064771311 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146533:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.146539:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff98c1429f2600) 00010000:00010000:0.0:1788270111.146541:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270111.146543:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788270111.146613:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38848:x1875136253241600:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 4442us (4981us total) trans 30064771311 rc 0/0 00000100:00100000:0.0:1788270111.146622:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 345 00000100:00100000:2.0:1788270111.159706:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.160139:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241856 00000100:00100000:0.0:1788270111.160150:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241856 00000100:00100000:0.0:1788270111.160208:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 346 00000100:00100000:0.0:1788270111.160219:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:38849:x1875136253241856:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270111.160245:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270111.160266:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101df3 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.160329:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.160350:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.160361:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270111.160406:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270111.160414:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270111.160436:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.160463:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 22 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.160482:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 21 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.160490:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270111.160493:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270111.160496:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9f200, rc 0) 00000100:00100000:0.0:1788270111.160547:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38849:x1875136253241856:12345-192.168.201.42@tcp:101:dd.0 Request processed in 331us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270111.160553:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 346 00000100:00100000:2.0:1788270111.163180:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.163444:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253241984 00000100:00100000:1.0:1788270111.163454:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253241984 00000100:00100000:1.0:1788270111.163508:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 347 00000100:00100000:1.0:1788270111.163519:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:38849:x1875136253241984:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270111.163538:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.163556:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101dfa expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163611:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163626:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163637:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163649:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163656:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163660:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163733:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09ec8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163738:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09ec8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163742:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09ec8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.163775:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 4096 00000004:00200000:1.0:1788270111.163777:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270111.163791:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09ec8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163800:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163804:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163809:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163812:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.163815:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163819:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163827:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270111.163829:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.163831:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163835:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163842:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163846:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163853:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163856:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19aa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.163857:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163860:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163864:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff98c1429f2600) 00010000:00010000:1.0:1788270111.163865:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.163867:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163870:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19aa00/0xc5f5d7a016e09ec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163884:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e09eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dfa expref: 23 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163892:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b800/0xc5f5d7a016e09ec8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101dfa expref: 22 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.163896:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:1.0:1788270111.163897:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788270111.163899:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b800, rc 0) 00000100:00100000:1.0:1788270111.163945:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:38849:x1875136253241984:12345-192.168.201.42@tcp:101:dd.0 Request processed in 429us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.163952:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 347 00000100:00100000:2.0:1788270111.165903:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.165964:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253242240 00000100:00100000:0.0:1788270111.165970:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253242240 00000100:00100000:0.0:1788270111.166002:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 348 00000100:00100000:0.0:1788270111.166008:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:38849:x1875136253242240:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270111.166021:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270111.166035:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09ecf lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e01 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166134:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166147:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166158:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166173:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166180:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166187:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270111.166500:0:45778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc7:0x0], index 0: 0 00010000:00010000:0.0:1788270111.166624:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09ee4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166633:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09ee4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166640:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09ee4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166670:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166681:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166688:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166693:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270111.166697:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166704:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166715:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270111.166718:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270111.166723:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166729:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e400/0xc5f5d7a016e09ed6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270111.166741:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce5e19cf reply state 00000000160fb8d0 transno 30064771312 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166751:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166758:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x4f74ecdb (ffff98c1429f2700) 00010000:00010000:0.0:1788270111.166759:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270111.166762:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270111.166786:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f800/0xc5f5d7a016e09ecf lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e01 expref: 25 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166799:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09ee4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e01 expref: 24 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.166806:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270111.166808:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270111.166811:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26bf9ee00, rc 0) 00000100:00100000:0.0:1788270111.166868:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:38849:x1875136253242240:12345-192.168.201.42@tcp:101:dd.0 Request processed in 858us (969us total) trans 30064771312 rc 0/0 00000100:00100000:0.0:1788270111.166875:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 348 00010000:00010000:0.0:1788270111.172190:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270111.172484:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.173379:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253242368 00000100:00100000:1.0:1788270111.173400:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253242368 00000100:00080000:2.0:1788270111.173443:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270111.173528:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:1.0:1788270111.173537:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+6:38849:x1875136253242368:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270111.173551:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.173567:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e08 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270111.173586:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270111.173604:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=902s v=(0 0) 00010000:00010000:1.0:1788270111.173609:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270111.173618:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 7 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.173634:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 7 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.173646:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a200, rc 0) 00000100:00100000:1.0:1788270111.173708:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:38849:x1875136253242368:12345-192.168.201.42@tcp:101:dd.0 Request processed in 171us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.173715:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:2.0:1788270111.249548:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.249632:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253242496 00000100:00100000:0.0:1788270111.249644:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253242496 00002000:00100000:0.0:1788270111.249694:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc7:0x0] (0->4194303) req@ffff98c27c30b100 x1875136253242496/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270111.249706:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c30b100 with x1875136253242496 ext(0->4194303) 00002000:00010000:0.0:1788270111.249711:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c30b100 00000100:00100000:0.0:1788270111.249746:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:0.0:1788270111.249756:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253242496:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270111.297669:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.297732:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253242624 00000100:00100000:1.0:1788270111.297741:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253242624 00002000:00100000:1.0:1788270111.297785:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc7:0x0] (4194304->8388607) req@ffff98c27c30aa00 x1875136253242624/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270111.297915:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c30aa00 with x1875136253242624 ext(4194304->8388607) 00002000:00010000:1.0:1788270111.297921:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c30aa00 00000100:00100000:1.0:1788270111.297948:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788270111.297957:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253242624:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270111.301139:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253242496:12345-192.168.201.42@tcp:4:dd.0 Request processed in 51379us (51596us total) trans 30064771102 rc 0/0 00000100:00100000:0.0:1788270111.301149:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00002000:00100000:0.0:1788270111.301158:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc7:0x0] (0->4194303) req@ffff98c27c30b100 x1875136253242496/t30064771102(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270111.301169:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c30b100 with x1875136253242496 ext(0->4194303) 00002000:00010000:0.0:1788270111.301174:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c30b100 00000100:00100000:1.0:1788270111.319239:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253242624:12345-192.168.201.42@tcp:4:dd.0 Request processed in 21267us (21564us total) trans 30064771103 rc 0/0 00000100:00100000:1.0:1788270111.319255:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00002000:00100000:1.0:1788270111.319270:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc7:0x0] (4194304->8388607) req@ffff98c27c30aa00 x1875136253242624/t30064771103(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270111.319281:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c30aa00 with x1875136253242624 ext(4194304->8388607) 00002000:00010000:1.0:1788270111.319287:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c30aa00 00000100:00100000:0.0:1788270111.360689:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270111.360818:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253242752 00000100:00100000:2.0:1788270111.360827:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253242752 00002000:00100000:2.0:1788270111.360869:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc7:0x0] (8388608->12582911) req@ffff98c14720dc00 x1875136253242752/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270111.360881:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720dc00 with x1875136253242752 ext(8388608->12582911) 00002000:00010000:2.0:1788270111.360885:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14720dc00 00000100:00100000:2.0:1788270111.360937:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788270111.360944:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2400:x1875136253242752:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:3.0:1788270111.387977:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253242752:12345-192.168.201.42@tcp:4:dd.0 Request processed in 27014us (27277us total) trans 30064771104 rc 0/0 00000100:00100000:3.0:1788270111.387991:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00002000:00100000:3.0:1788270111.388004:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc7:0x0] (8388608->12582911) req@ffff98c14720dc00 x1875136253242752/t30064771104(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270111.388013:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720dc00 with x1875136253242752 ext(8388608->12582911) 00002000:00010000:3.0:1788270111.388020:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14720dc00 00000100:00100000:2.0:1788270111.393246:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.393318:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253243008 00000100:00100000:1.0:1788270111.393329:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253243008 00000100:00100000:1.0:1788270111.393392:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:1.0:1788270111.393402:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:38849:x1875136253243008:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:1.0:1788270111.394033:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:38849:x1875136253243008:12345-192.168.201.42@tcp:35:dd.0 Request processed in 630us (794us total) trans 30064771313 rc 0/0 00000100:00100000:1.0:1788270111.394069:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:2.0:1788270111.405645:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.405749:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253243264 00000100:00100000:0.0:1788270111.405759:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253243264 00000100:00100000:0.0:1788270111.405829:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 349 00000100:00100000:0.0:1788270111.405853:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:38850:x1875136253243264:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270111.405878:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270111.405898:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09ef9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e0f expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.405996:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406012:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406025:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406076:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406084:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406091:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270111.406401:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc7:0x0], index 1: 0 00010000:00010000:0.0:1788270111.406542:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09f0e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406551:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09f0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406559:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09f0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406590:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406598:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406603:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406610:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406615:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270111.406618:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406624:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 5/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406636:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270111.406639:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270111.406644:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 3/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406650:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f00 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270111.406664:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034aae765 reply state 00000000b09a07dd transno 30064771314 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406674:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406680:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xa92decdb (ffff98c1429f2100) 00010000:00010000:0.0:1788270111.406683:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270111.406685:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270111.406711:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821dbc00/0xc5f5d7a016e09ef9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e0f expref: 29 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406725:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09f0e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e0f expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.406733:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:0.0:1788270111.406735:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270111.406737:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2821daa00, rc 0) 00000100:00100000:0.0:1788270111.406790:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:38850:x1875136253243264:12345-192.168.201.42@tcp:101:dd.0 Request processed in 952us (1153us total) trans 30064771314 rc 0/0 00000100:00100000:0.0:1788270111.406797:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 349 00000100:00100000:0.0:1788270111.410768:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.410837:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253243392 00000100:00100000:1.0:1788270111.410846:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253243392 00000100:00080000:2.0:1788270111.410904:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270111.410981:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:1.0:1788270111.410992:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:38850:x1875136253243392:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270111.411010:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.411030:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec59da0/0xc5f5d7a016e09f1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e16 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270111.411088:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270111.411110:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=903s v=(0 0) 00010000:00010000:1.0:1788270111.411115:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270111.411125:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec59da0/0xc5f5d7a016e09f1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e16 expref: 15 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.411143:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dec59da0/0xc5f5d7a016e09f1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e16 expref: 15 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.411156:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19aa00, rc 0) 00000100:00100000:1.0:1788270111.411223:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:38850:x1875136253243392:12345-192.168.201.42@tcp:101:dd.0 Request processed in 232us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.411231:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000040:00080000:3.0:1788270111.428240:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000100:00100000:0.0:1788270111.428244:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262661888:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788270111.428248:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270111.428277:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 8 count 8 00000040:00080000:3.0:1788270111.428291:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270111.428321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270111.428374:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262661888 00000100:00100000:3.0:1788270111.428395:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262661888 00000100:00100000:3.0:1788270111.428455:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788270111.428466:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262661888:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788270111.428477:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788270111.428488:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 79511232 pending 12656640 free 3906719744 avail 3675197440 00000100:00100000:3.0:1788270111.428545:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262661888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270111.428552:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000040:00080000:0.0:1788270111.430295:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270111.430303:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270111.430341:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788270111.430349:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788270111.431521:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262661888:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788270111.432285:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771136 is committed 00000001:00080000:3.0:1788270111.432301:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771134 is committed 00000004:00080000:3.0:1788270111.432617:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000001:00080000:3.0:1788270111.432647:0:46509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771117 is committed 00000020:00080000:3.0:1788270111.432662:0:46509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c1429b8780 refcount 2 committed 0 result 0 batchid 25769803851 00000020:00080000:3.0:1788270111.432666:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10c00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c1429b83c0 00000020:00080000:3.0:1788270111.432668:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1436b9c00 00000020:00080000:3.0:1788270111.432687:0:46509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 25769803850 batchid updated 00000020:00080000:2.0:1788270111.433023:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769803851 committed batchid 25769803850 00000100:00100000:2.0:1788270111.433177:0:46534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c308380 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:46534:1875136262662016:0@lo:1000:dist_txn-1.0 00000100:00100000:2.0:1788270111.433242:0:46534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270111.433273:0:46534:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788270111.433288:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262662016 00000100:00100000:3.0:1788270111.433295:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262662016 00010000:00010000:0.0:1788270111.433342:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.433345:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788270111.433354:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46534:x1875136262662016:12345-0@lo:1000:dist_txn-1.0 00010000:00010000:0.0:1788270111.433357:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.433366:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.433373:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270111.433389:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.433398:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.433427:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x5:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270111.433430:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270111.433433:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46534:x1875136262662016:12345-0@lo:1000:dist_txn-1.0 Request processed in 79us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1788270111.433437:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.433441:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00010000:0.0:1788270111.433449:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26bf9f000/0xc5f5d7a016e09e04 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.433457:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262662144:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1788270111.433491:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270111.433516:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262662144 00000100:00100000:0.0:1788270111.433521:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262662144 00000100:00080000:1.0:1788270111.433551:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270111.433574:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788270111.433582:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262662144:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1788270111.433680:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb size from disk: 20971520 -> 29360128 00002000:00010000:0.0:1788270111.433684:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb mtime from disk: 1788270103 -> 1788270105 00002000:00010000:0.0:1788270111.433686:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb atime from disk: 1788270103 -> 1788270103 00002000:00010000:0.0:1788270111.433688:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb ctime from disk: 1788270103 -> 1788270105 00002000:00010000:0.0:1788270111.433690:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc3:0x0] updating lvb blocks from disk: 40960 -> 57344 00000100:00100000:0.0:1788270111.433732:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262662144:12345-0@lo:2:osp-syn-1-1.0 Request processed in 150us (240us total) trans 30064771137 rc 0/0 00000100:00100000:0.0:1788270111.433739:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788270111.433908:0:46534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c308380 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:46534:1875136262662016:0@lo:1000:dist_txn-1.0 00000004:00080000:2.0:1788270111.433936:0:46534:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c1424950c0 with version 8 00000020:00080000:2.0:1788270111.433949:0:46534:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 25769803849 cancel update log [0x2000032e2:0x1:0x0].1: rc = 0 00000004:00080000:3.0:1788270111.433978:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 8 rpc_version 8 00000020:00080000:2.0:1788270111.433995:0:46534:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 25769803849 cancel update log [0x2400032e1:0x1:0x0].1: rc = 0 00000020:00100000:3.0:1788270111.433999:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:2.0:1788270111.434006:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 25769803850 00000100:00100000:3.0:1788270111.434008:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c27c2c5880 x1875136262662400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788270111.434026:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262662400:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788270111.434079:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270111.434102:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24844ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788270111.434171:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262662400 00000100:00100000:2.0:1788270111.434176:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262662400 00000100:00100000:2.0:1788270111.434211:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788270111.434218:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:46515:x1875136262662400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270111.434318:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262662400:12345-0@lo:1000:osp_up0-1.0 Request processed in 100us (237us total) trans 30064771315 rc 0/0 00000100:00100000:2.0:1788270111.434325:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788270111.434423:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 30064771134 gen 2 00000004:00080000:1.0:1788270111.434429:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771134 committed transno 30064771134 00000100:00100000:1.0:1788270111.434442:0:3610:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c14a49ea00 x1875136262662144/t30064771137(30064771137) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788270127 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788270111.434452:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14a49ea00/2, rc 0, transno 30064771137 00000100:00100000:1.0:1788270111.434457:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262662144:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1788270111.434533:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262662400:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270111.458513:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.458655:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253243520 00000100:00100000:0.0:1788270111.458666:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253243520 00002000:00100000:0.0:1788270111.458716:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc7:0x0] (0->4194303) req@ffff98c27c308380 x1875136253243520/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270111.458728:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c308380 with x1875136253243520 ext(0->4194303) 00002000:00010000:0.0:1788270111.458734:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c308380 00000100:00100000:0.0:1788270111.458769:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:0.0:1788270111.458779:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253243520:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270111.482917:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253243520:12345-192.168.201.42@tcp:4:dd.0 Request processed in 24126us (24402us total) trans 30064771138 rc 0/0 00000100:00100000:1.0:1788270111.482942:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00002000:00100000:1.0:1788270111.482959:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc7:0x0] (0->4194303) req@ffff98c27c308380 x1875136253243520/t30064771138(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270111.482970:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c308380 with x1875136253243520 ext(0->4194303) 00002000:00010000:1.0:1788270111.482977:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c308380 00000100:00100000:0.0:1788270111.507444:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270111.507514:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253243648 00000100:00100000:2.0:1788270111.507524:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253243648 00002000:00100000:2.0:1788270111.507569:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc7:0x0] (4194304->8388607) req@ffff98c14720ea00 x1875136253243648/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270111.507580:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720ea00 with x1875136253243648 ext(4194304->8388607) 00002000:00010000:2.0:1788270111.507631:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720ea00 00000100:00100000:2.0:1788270111.507668:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:2.0:1788270111.507676:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253243648:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270111.541899:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253243648:12345-192.168.201.42@tcp:4:dd.0 Request processed in 34210us (34453us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1788270111.541914:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00002000:00100000:2.0:1788270111.541927:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc7:0x0] (4194304->8388607) req@ffff98c14720ea00 x1875136253243648/t30064771139(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270111.541940:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720ea00 with x1875136253243648 ext(4194304->8388607) 00002000:00010000:2.0:1788270111.541946:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720ea00 00000100:00100000:2.0:1788270111.556557:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.557385:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253243776 00000100:00100000:1.0:1788270111.557397:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253243776 00002000:00100000:1.0:1788270111.557448:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc7:0x0] (8388608->12582911) req@ffff98c14409aa00 x1875136253243776/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270111.557460:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14409aa00 with x1875136253243776 ext(8388608->12582911) 00002000:00010000:1.0:1788270111.557466:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14409aa00 00000100:00100000:1.0:1788270111.557548:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:1.0:1788270111.557559:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253243776:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270111.586179:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.586236:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253244032 00000100:00100000:1.0:1788270111.586247:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253244032 00000100:00100000:1.0:1788270111.586311:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:1.0:1788270111.586321:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:38850:x1875136253244032:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:1.0:1788270111.586618:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:38850:x1875136253244032:12345-192.168.201.42@tcp:35:dd.0 Request processed in 298us (447us total) trans 30064771316 rc 0/0 00000100:00100000:1.0:1788270111.586627:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:1.0:1788270111.600797:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253243776:12345-192.168.201.42@tcp:4:dd.0 Request processed in 43228us (44239us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1788270111.600815:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00002000:00100000:1.0:1788270111.600828:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc7:0x0] (8388608->12582911) req@ffff98c14409aa00 x1875136253243776/t30064771140(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270111.600839:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14409aa00 with x1875136253243776 ext(8388608->12582911) 00002000:00010000:1.0:1788270111.600846:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14409aa00 00000100:00100000:0.0:1788270111.603656:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.603733:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253244160 00000100:00100000:1.0:1788270111.603743:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253244160 00000100:00100000:1.0:1788270111.603804:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 350 00000100:00100000:1.0:1788270111.603815:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:38851:x1875136253244160:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:1.0:1788270111.603839:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.603860:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f23 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e1d expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.603897:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.603909:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.603920:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.604072:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f23 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.604086:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 31 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.604096:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.604098:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270111.604101:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a800, rc 0) 00000100:00100000:1.0:1788270111.604147:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:38851:x1875136253244160:12345-192.168.201.42@tcp:101:chown.0 Request processed in 336us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.604152:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 350 00000100:00100000:2.0:1788270111.607179:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.609214:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253244416 00000100:00100000:0.0:1788270111.609229:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253244416 00000100:00100000:0.0:1788270111.609295:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 351 00000100:00100000:0.0:1788270111.609305:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:38851:x1875136253244416:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:0.0:1788270111.609355:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270111.609390:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9ee00/0xc5f5d7a016e09ee4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e01 expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.609410:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270111.609414:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270111.609450:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.609463:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.609472:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270111.609673:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].9, 88 off8840 00000004:00080000:0.0:1788270111.609682:0:45778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 903316641797ns, next at 904316639985ns, rc = 0 00000004:00010000:0.0:1788270111.609720:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c04cccd reply state 000000003277077d transno 30064771317 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.609732:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.609739:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270111.609742:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788270111.609744:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270111.609836:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38851:x1875136253244416:12345-192.168.201.42@tcp:36:chown.0 Request processed in 531us (2664us total) trans 30064771317 rc 0/0 00000100:00100000:0.0:1788270111.609843:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 351 00000100:00100000:0.0:1788270111.612033:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.612200:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253244544 00000100:00100000:1.0:1788270111.612215:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253244544 00000100:00100000:1.0:1788270111.612255:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 352 00000100:00100000:1.0:1788270111.612265:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38851:x1875136253244544:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:1.0:1788270111.612283:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.612307:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e24 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.612350:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 33 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.612362:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 33 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.612389:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.612392:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270111.612394:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a600, rc 0) 00000100:00100000:1.0:1788270111.612436:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:38851:x1875136253244544:12345-192.168.201.42@tcp:101:chown.0 Request processed in 173us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.612447:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 352 00000100:00100000:2.0:1788270111.614030:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.615475:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253244672 00000100:00100000:1.0:1788270111.615488:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253244672 00000100:00100000:1.0:1788270111.615548:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:1.0:1788270111.615558:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253244672:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:1.0:1788270111.615700:0:47281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:1.0:1788270111.615703:0:47281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb mtime from disk: 0 -> 1788270111 00002000:00010000:1.0:1788270111.615705:0:47281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270111.615706:0:47281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb ctime from disk: 0 -> 1788270111 00002000:00010000:1.0:1788270111.615708:0:47281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:1.0:1788270111.615759:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253244672:12345-192.168.201.42@tcp:2:chown.0 Request processed in 204us (1735us total) trans 30064771105 rc 0/0 00000100:00100000:1.0:1788270111.615764:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:2.0:1788270111.629795:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.629854:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253244800 00000100:00100000:1.0:1788270111.629863:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253244800 00000100:00100000:1.0:1788270111.629966:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 353 00000100:00100000:1.0:1788270111.629976:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:38852:x1875136253244800:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:1.0:1788270111.630001:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.630019:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09f3f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e2b expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.630088:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09f46 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.630102:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09f46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.630118:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09f46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.630226:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09f3f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e2b expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.630244:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19be00/0xc5f5d7a016e09f46 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e2b expref: 34 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.630253:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:1.0:1788270111.630256:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270111.630259:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19be00, rc 0) 00000100:00100000:1.0:1788270111.630322:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:38852:x1875136253244800:12345-192.168.201.42@tcp:101:chown.0 Request processed in 347us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.630329:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 353 00000100:00100000:0.0:1788270111.632710:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.632763:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253245056 00000100:00100000:1.0:1788270111.632772:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253245056 00000100:00100000:1.0:1788270111.632819:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 354 00000100:00100000:1.0:1788270111.632830:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:38852:x1875136253245056:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:1.0:1788270111.632873:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270111.632895:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09f0e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e0f expref: 34 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.632913:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:1.0:1788270111.632917:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270111.632940:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.632953:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.632961:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270111.633416:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].9, 88 off8912 00000004:00080000:1.0:1788270111.633770:0:45777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 903340730248ns, next at 904340726867ns, rc = 0 00000004:00010000:1.0:1788270111.633823:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efc8dffa reply state 00000000bb48efa8 transno 30064771318 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.633837:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.633844:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:1.0:1788270111.633848:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788270111.633851:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270111.633949:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:38852:x1875136253245056:12345-192.168.201.42@tcp:36:chown.0 Request processed in 1119us (1242us total) trans 30064771318 rc 0/0 00000100:00100000:1.0:1788270111.633956:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 354 00000100:00100000:2.0:1788270111.636839:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.636882:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253245184 00000100:00100000:1.0:1788270111.636891:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253245184 00000100:00100000:1.0:1788270111.636945:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 355 00000100:00100000:1.0:1788270111.636956:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:38852:x1875136253245184:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:1.0:1788270111.636978:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.637007:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09f54 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e32 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.637227:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09f54 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e32 expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.637243:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ac00/0xc5f5d7a016e09f54 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e32 expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.637264:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:1.0:1788270111.637267:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270111.637271:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ac00, rc 0) 00000100:00100000:1.0:1788270111.637327:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:38852:x1875136253245184:12345-192.168.201.42@tcp:101:chown.0 Request processed in 373us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.637334:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 355 00000100:00100000:2.0:1788270111.638851:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.638892:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253245312 00000100:00100000:1.0:1788270111.638899:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253245312 00000100:00100000:1.0:1788270111.638945:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788270111.638954:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253245312:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:1.0:1788270111.639123:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:1.0:1788270111.639128:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb mtime from disk: 0 -> 1788270111 00002000:00010000:1.0:1788270111.639130:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270111.639132:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb ctime from disk: 0 -> 1788270111 00002000:00010000:1.0:1788270111.639134:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:1.0:1788270111.639181:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253245312:12345-192.168.201.42@tcp:2:chown.0 Request processed in 228us (333us total) trans 30064771141 rc 0/0 00000100:00100000:1.0:1788270111.639188:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788270111.673536:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.673648:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253245440 00000100:00100000:1.0:1788270111.673657:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253245440 00000100:00100000:1.0:1788270111.673708:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 356 00000100:00100000:1.0:1788270111.673718:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:38858:x1875136253245440:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270111.673736:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.673754:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e39 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270111.675153:0:48110:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1356us 00010000:00010000:1.0:1788270111.687278:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09f62 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.687302:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09f62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.687315:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09f62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.687362:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 4096 00000004:00200000:1.0:1788270111.687364:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270111.688502:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09f62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.688551:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e09f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e39 expref: 38 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.688571:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09f62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e39 expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.688581:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:1.0:1788270111.688584:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270111.688588:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b400, rc 0) 00000100:00100000:1.0:1788270111.688657:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38858:x1875136253245440:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 14938us (15128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.688666:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 356 00000100:00100000:2.0:1788270111.690921:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.690963:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253245568 00000100:00100000:1.0:1788270111.690971:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253245568 00000100:00100000:1.0:1788270111.691032:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 357 00000100:00100000:1.0:1788270111.691147:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38858:x1875136253245568:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270111.691168:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.691187:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09f69 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e40 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691237:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691247:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691257:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691268:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691275:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691281:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691446:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691453:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691458:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.691487:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00000004:00200000:1.0:1788270111.691490:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270111.691504:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691512:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691518:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691522:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691526:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691529:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5ce00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.691532:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691537:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691545:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:1.0:1788270111.691548:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.691551:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691555:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e09f70 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691563:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691567:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691570:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691573:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.691575:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691578:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691581:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x4f74ecdb (ffff98c1429f2700) 00010000:00010000:1.0:1788270111.691583:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270111.691584:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691587:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d000/0xc5f5d7a016e09f77 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691603:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09f69 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 39 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691611:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 38 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.691616:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.691617:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270111.691619:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c800, rc 0) 00000100:00100000:1.0:1788270111.691666:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38858:x1875136253245568:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 626us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.691673:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 357 00000100:00100000:2.0:1788270111.693871:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.693913:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253245824 00000100:00100000:1.0:1788270111.693921:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253245824 00000100:00100000:1.0:1788270111.694085:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 358 00000100:00100000:1.0:1788270111.694095:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38858:x1875136253245824:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270111.694112:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.694129:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e09f85 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e47 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.694221:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09f8c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.694235:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09f8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.694245:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09f8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.694256:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:1.0:1788270111.694357:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e09f85 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e47 expref: 41 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.694383:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09f8c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e47 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.694392:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.694395:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270111.694397:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d200, rc 0) 00000100:00100000:1.0:1788270111.694492:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:38858:x1875136253245824:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 398us (627us total) trans 30064771319 rc 0/0 00000100:00100000:1.0:1788270111.694500:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 358 00000100:00100000:0.0:1788270111.697989:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.698028:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270111.698156:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246208 00000100:00100000:2.0:1788270111.698166:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246208 00000100:00100000:2.0:1788270111.698233:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788270111.698243:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:2403:x1875136253246208:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270111.698258:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270111.698283:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e09f8c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e47 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270111.698302:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270111.698306:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270111.698355:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2403:x1875136253246208:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270111.698362:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788270111.698387:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246080 00000100:00100000:1.0:1788270111.698392:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246080 00000100:00100000:1.0:1788270111.698612:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 359 00000100:00100000:1.0:1788270111.698621:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:38858:x1875136253246080:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270111.698641:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.698657:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09f9a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e4e expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.698761:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09fa1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.698775:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09fa1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.698786:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09fa1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.698801:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:1.0:1788270111.698897:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e09f9a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e4e expref: 42 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.698911:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09fa1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e4e expref: 41 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.698919:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.698921:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788270111.698923:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c200, rc 0) 00000100:00100000:1.0:1788270111.698965:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:38858:x1875136253246080:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 345us (983us total) trans 30064771320 rc 0/0 00000100:00100000:1.0:1788270111.698971:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 359 00000100:00100000:1.0:1788270111.779572:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.779748:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246336 00000100:00100000:0.0:1788270111.779758:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246336 00000100:00100000:0.0:1788270111.779824:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:0.0:1788270111.779834:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253246336:12345-192.168.201.42@tcp:1:lfs.500 00010000:00010000:0.0:1788270111.779880:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.779902:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 14 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.779912:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788270111.779916:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270111.779921:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 4/0,1 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.779970:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 14 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.779986:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 14 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270111.780010:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262662528:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270111.780187:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270111.782524:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262662528:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270111.782552:0:47284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.786098:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270111.786417:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246464 00000100:00100000:3.0:1788270111.786426:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246464 00002000:00100000:3.0:1788270111.786489:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc7:0x0] (12582912->15728639) req@ffff98c14a49d180 x1875136253246464/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/0 e 0 to 0 dl 1788270122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270111.786501:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14a49d180 with x1875136253246464 ext(12582912->15728639) 00010000:00010000:3.0:1788270111.786511:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 15 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.786528:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 15 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270111.786535:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c14a49d180 00000100:00100000:2.0:1788270111.788498:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788270111.788518:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253246464:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:2.0:1788270111.807877:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253246464:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 19357us (21779us total) trans 30064771106 rc 0/0 00000100:00100000:2.0:1788270111.807891:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00002000:00100000:2.0:1788270111.807905:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc7:0x0] (12582912->15728639) req@ffff98c14a49d180 x1875136253246464/t30064771106(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:527/0 lens 488/448 e 0 to 0 dl 1788270122 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270111.807914:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14a49d180 with x1875136253246464 ext(12582912->15728639) 00010000:00010000:2.0:1788270111.807924:0:49680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 17 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270111.807942:0:49680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 17 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270111.807950:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c14a49d180 00000100:00100000:2.0:1788270111.822347:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270111.822428:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246592 00000100:00100000:3.0:1788270111.822438:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246592 00010000:00010000:3.0:1788270111.822473:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 17 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.822509:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:3.0:1788270111.822519:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253246592:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270111.822534:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788270111.822552:0:45762:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb size from disk: 12582912 -> 15728640 00002000:00010000:3.0:1788270111.822556:0:45762:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb atime from disk: 0 -> 1788270111 00002000:00010000:3.0:1788270111.822558:0:45762:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc7:0x0] updating lvb blocks from disk: 24576 -> 30720 00010000:00010000:3.0:1788270111.822564:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 17 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.822574:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 17 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.822595:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b972b2b/0xc5f5d7a016e09ef2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e08 expref: 17 pid: 47281 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.822612:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270111.822617:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270111.822623:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.822634:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.822660:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270111.822700:0:47284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822710:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.822719:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253246592:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 202us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270111.822727:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00010000:00010000:1.0:1788270111.822734:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822742:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822750:0:47284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822757:0:47284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821da400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270111.822775:0:47284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822784:0:47284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822796:0:47284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.822802:0:47284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1c28e35/0xc5f5d7a016e09faf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.822863:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253246336:12345-192.168.201.42@tcp:1:lfs.500 Request processed in 43030us (43303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.822874:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788270111.826165:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.826248:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246848 00000100:00100000:0.0:1788270111.826257:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246848 00000100:00100000:0.0:1788270111.826316:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:0.0:1788270111.826328:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:38858:x1875136253246848:12345-192.168.201.42@tcp:35:lfs.500 00000004:00010000:0.0:1788270111.826405:0:45779:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09fa1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e4e expref: 41 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270111.826585:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771321 00000001:00080000:0.0:1788270111.826617:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771322 00000001:00080000:0.0:1788270111.826901:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771323 00010000:00010000:0.0:1788270111.826938:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.826952:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 45 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.826961:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 45 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.826968:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.826976:0:45779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.827009:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.827022:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 45 pid: 46770 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270111.827295:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262662656:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270111.827429:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 45 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.827439:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 45 pid: 45777 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270111.827449:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262662784:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270111.827481:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 45 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.827490:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 45 pid: 48110 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270111.827498:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262662912:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270111.827516:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788270111.831547:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.831585:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270111.831616:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253247104 00000100:00100000:3.0:1788270111.831625:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253247104 00000100:00100000:0.0:1788270111.831630:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.831656:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253246976 00000100:00100000:0.0:1788270111.831660:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253246976 00010000:00010000:3.0:1788270111.831667:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 47 pid: 48110 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.831680:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 47 pid: 46770 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.831705:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253247232 00000100:00100000:3.0:1788270111.831710:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253247232 00000100:00100000:0.0:1788270111.831714:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00010000:00010000:3.0:1788270111.831727:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 48 pid: 45777 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270111.831734:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253247104:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270111.831754:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788270111.831756:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00010000:00010000:0.0:1788270111.831764:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 48 pid: 48110 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.831770:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253246976:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270111.831784:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270111.831786:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 48 pid: 48110 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.831793:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 48 pid: 46770 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.831821:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 48 pid: 46770 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.831837:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788270111.831843:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.831852:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270111.831858:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00010000:00010000:3.0:1788270111.831869:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270111.831871:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253247232:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270111.831881:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270111.831887:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 48 pid: 45777 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270111.831897:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 48 pid: 45777 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270111.831908:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270111.831912:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.831923:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253246976:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 155us (334us total) trans 0 rc 0/0 00010000:00010000:2.0:1788270111.831927:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270111.831935:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00010000:00010000:2.0:1788270111.831939:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270111.831960:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270111.831980:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:2402:x1875136253247232:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270111.831987:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00010000:00010000:0.0:1788270111.832025:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270111.832214:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270111.832239:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:2400:x1875136253247104:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 510us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270111.832245:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00010000:00010000:1.0:1788270111.833078:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e09f38 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e24 expref: 45 pid: 46770 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.833098:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262662656:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270111.833112:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09f7e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e40 expref: 44 pid: 45777 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.833122:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262662784:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270111.833147:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e09f2a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e1d expref: 43 pid: 48110 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.833157:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262662912:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270111.833185:0:45779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.833195:0:45779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.833201:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788270111.833319:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771324 00000001:00080000:1.0:1788270111.833693:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771325 00000100:00100000:1.0:1788270111.833781:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262663040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788270111.833838:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270111.833877:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c248865840 going to sleep for 11 seconds 00000100:00100000:3.0:1788270111.833950:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262663040 00000100:00100000:3.0:1788270111.833956:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262663040 00000100:00100000:3.0:1788270111.834001:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788270111.834010:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262663040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270111.834101:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262663040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270111.834108:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788270111.834281:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270111.834368:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262663040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788270111.834530:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771326 00000100:00100000:1.0:1788270111.834567:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262663168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788270111.834592:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270111.834618:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24880e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788270111.834689:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262663168 00000100:00100000:3.0:1788270111.834694:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262663168 00000100:00100000:3.0:1788270111.834726:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788270111.834733:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262663168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270111.834820:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262663168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (226us total) trans 30064771107 rc 0/0 00000100:00100000:3.0:1788270111.834827:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788270111.834899:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262663168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788270111.834927:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771327 00010000:00010000:1.0:1788270111.834952:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.834961:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.834968:0:45779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.834974:0:45779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821daa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270111.834978:0:45779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.834985:0:45779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.835000:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.835004:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788270111.835008:0:45779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.835015:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821daa00/0xc5f5d7a016e09fb6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788270111.835126:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x1d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788270111.835310:0:45779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].10, 64 off8904 00000001:00080000:1.0:1788270111.835319:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771328 00010000:00010000:1.0:1788270111.835341:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.835344:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788270111.835350:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e09fa1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e4e expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270111.835504:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:38858:x1875136253246848:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 9179us (9347us total) trans 30064771329 rc 0/0 00000100:00100000:1.0:1788270111.835513:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000020:00080000:1.0:1788270111.835516:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788270111.839000:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.839192:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253247360 00000100:00100000:1.0:1788270111.839202:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253247360 00000100:00100000:1.0:1788270111.840804:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 360 00000100:00100000:1.0:1788270111.840822:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:38858:x1875136253247360:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270111.840847:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.840868:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e09fbd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e55 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.840926:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e09fbd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e55 expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.840941:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e09fbd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e55 expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.840960:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:1.0:1788270111.840964:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270111.840968:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5de00, rc 0) 00000100:00100000:1.0:1788270111.841031:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:38858:x1875136253247360:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 216us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270111.841062:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 360 00000100:00100000:0.0:1788270111.844640:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.844790:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253247616 00000100:00100000:1.0:1788270111.844800:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253247616 00000100:00100000:1.0:1788270111.844889:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788270111.844900:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:38858:x1875136253247616:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:1.0:1788270111.845154:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:38858:x1875136253247616:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 256us (524us total) trans 30064771330 rc 0/0 00000100:00100000:1.0:1788270111.845162:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:2.0:1788270111.893938:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.894157:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253247744 00000100:00100000:1.0:1788270111.894167:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253247744 00000100:00100000:0.0:1788270111.894485:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 361 00000100:00100000:0.0:1788270111.894496:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:38864:x1875136253247744:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270111.894521:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270111.894541:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e09fc4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e5c expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894603:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894618:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894630:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894641:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894648:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894655:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894896:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e09fd9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894906:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e09fd9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894913:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e09fd9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270111.894945:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00000004:00200000:0.0:1788270111.894950:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270111.894971:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e09fd9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894983:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e09fd9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894992:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.894999:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895009:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895016:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895022:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270111.895026:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895033:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895066:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270111.895069:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270111.895074:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895080:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e09fcb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895092:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895098:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895104:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895108:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270111.895111:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895117:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895123:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xa92decdb (ffff98c1429f2100) 00010000:00010000:0.0:1788270111.895126:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270111.895129:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895134:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09fd2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895158:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e09fc4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e5c expref: 50 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895171:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193200/0xc5f5d7a016e09fd9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e5c expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.895178:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:0.0:1788270111.895180:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270111.895183:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193200, rc 0) 00000100:00100000:0.0:1788270111.895328:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38864:x1875136253247744:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 833us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270111.895336:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 361 00000100:00100000:0.0:1788270111.897937:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.898084:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253248000 00000100:00100000:1.0:1788270111.898094:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253248000 00000100:00100000:1.0:1788270111.898186:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 362 00000100:00100000:1.0:1788270111.898197:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:38864:x1875136253248000:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270111.898217:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270111.898237:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09fe0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e63 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.898331:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09fe7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.898349:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.898360:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270111.898382:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:1.0:1788270111.898482:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e09fe0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e63 expref: 52 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.898500:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09fe7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e63 expref: 51 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270111.898509:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:1.0:1788270111.898511:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270111.898515:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c600, rc 0) 00000100:00100000:1.0:1788270111.898581:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38864:x1875136253248000:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 386us (653us total) trans 30064771331 rc 0/0 00000100:00100000:1.0:1788270111.898589:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 362 00000100:00100000:1.0:1788270111.900555:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270111.900601:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270111.900663:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253248128 00000100:00100000:3.0:1788270111.900671:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253248128 00000100:00100000:3.0:1788270111.900724:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788270111.900734:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:2401:x1875136253248128:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270111.900747:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270111.900875:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e09fe7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e63 expref: 51 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270111.900899:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:3.0:1788270111.900904:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270111.900956:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2401:x1875136253248128:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 224us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270111.900964:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788270111.901472:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253248384 00000100:00100000:0.0:1788270111.901479:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253248384 00000100:00100000:0.0:1788270111.901558:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 363 00000100:00100000:0.0:1788270111.901569:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:38864:x1875136253248384:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270111.901588:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270111.901602:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e09ff5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e6a expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.901689:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09ffc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.901702:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09ffc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.901712:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09ffc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270111.901723:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:0.0:1788270111.901835:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e09ff5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e6a expref: 53 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.901850:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09ffc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e6a expref: 52 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.901858:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:0.0:1788270111.901862:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788270111.901864:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192000, rc 0) 00000100:00100000:0.0:1788270111.901907:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:38864:x1875136253248384:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 341us (1306us total) trans 30064771332 rc 0/0 00000100:00100000:0.0:1788270111.901913:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 363 00000100:00100000:3.0:1788270111.940302:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262663296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270111.940361:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270111.940593:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262663296 00000100:00100000:2.0:1788270111.940599:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262663296 00000100:00100000:2.0:1788270111.940640:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788270111.940647:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3607:x1875136262663296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270111.940676:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1788270111.940833:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3607:x1875136262663296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270111.940840:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788270111.940903:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262663296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270111.947658:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.947833:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253248512 00000100:00100000:0.0:1788270111.947844:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253248512 00000100:00100000:0.0:1788270111.947902:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788270111.947912:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:38864:x1875136253248512:12345-192.168.201.42@tcp:103:lfs.500 00010000:00010000:0.0:1788270111.947927:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270111.947952:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e09ffc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e6a expref: 52 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270111.947973:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:0.0:1788270111.947978:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270111.948027:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38864:x1875136253248512:12345-192.168.201.42@tcp:103:lfs.500 Request processed in 118us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270111.948032:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788270111.949699:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270111.949811:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253248768 00000100:00100000:2.0:1788270111.949819:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253248768 00000100:00100000:2.0:1788270111.949865:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:2.0:1788270111.949875:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:38864:x1875136253248768:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:2.0:1788270111.950150:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:38864:x1875136253248768:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 277us (454us total) trans 30064771333 rc 0/0 00000100:00100000:2.0:1788270111.950158:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:1.0:1788270111.965870:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270111.966445:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253249024 00000100:00100000:0.0:1788270111.966456:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253249024 00000100:00100000:0.0:1788270111.966519:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788270111.966529:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:38864:x1875136253249024:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:0.0:1788270111.970524:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:38864:x1875136253249024:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 3985us (4652us total) trans 30064771334 rc 0/0 00000100:00100000:0.0:1788270111.970539:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:1.0:1788270112.029318:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.029429:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253249280 00000100:00100000:0.0:1788270112.029440:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253249280 00000100:00100000:0.0:1788270112.029494:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 364 00000100:00100000:0.0:1788270112.029503:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:38874:x1875136253249280:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270112.029525:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.029543:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a00a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e71 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270112.029647:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 4096 00010000:00010000:0.0:1788270112.029869:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a00a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e71 expref: 55 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.029884:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270112.029887:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270112.029891:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a00a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e71 expref: 55 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.029906:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192000, rc 0) 00000100:00100000:0.0:1788270112.029959:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:38874:x1875136253249280:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 457us (652us total) trans 30064771335 rc 301/301 00000100:00100000:0.0:1788270112.029966:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 364 00000100:00100000:1.0:1788270112.033844:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.033939:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253249408 00000100:00100000:2.0:1788270112.033947:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253249408 00000100:00100000:2.0:1788270112.033998:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 365 00000100:00100000:2.0:1788270112.034009:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:38874:x1875136253249408:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270112.034105:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034122:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034133:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034148:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034156:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034161:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034234:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034243:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034249:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270112.034293:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034305:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034311:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034317:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034323:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.034328:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034336:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034346:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:2.0:1788270112.034349:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.034353:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034359:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a018 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034385:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034391:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034397:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034402:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.034405:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034411:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034418:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x4f74ecdb (ffff98c1429f2700) 00010000:00010000:2.0:1788270112.034421:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.034424:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034429:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a01f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034439:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034445:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034451:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034456:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.034459:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034464:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034470:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.034472:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.034475:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.034480:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a026 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270112.034545:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:38874:x1875136253249408:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 538us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.034553:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 365 00000100:00100000:1.0:1788270112.037302:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270112.037398:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253249664 00000100:00100000:3.0:1788270112.037408:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253249664 00000100:00100000:3.0:1788270112.037456:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788270112.037467:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:38874:x1875136253249664:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270112.037701:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:38874:x1875136253249664:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 226us (398us total) trans 30064771336 rc 0/0 00000100:00100000:3.0:1788270112.037709:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:1.0:1788270112.095244:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.095348:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253249920 00000100:00100000:0.0:1788270112.095359:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253249920 00000100:00100000:0.0:1788270112.095425:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 366 00000100:00100000:0.0:1788270112.095432:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:38884:x1875136253249920:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270112.095451:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.095467:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e78 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.095548:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e0a034 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.095558:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e0a034 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.095568:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e0a034 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270112.095575:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 4096 00010000:00010000:0.0:1788270112.095648:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e78 expref: 58 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.095664:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192e00/0xc5f5d7a016e0a034 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e78 expref: 57 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.095672:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270112.095675:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788270112.095678:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192e00, rc 0) 00000100:00100000:0.0:1788270112.095734:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:38884:x1875136253249920:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 302us (501us total) trans 30064771337 rc 0/0 00000100:00100000:0.0:1788270112.095742:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 366 00000100:00100000:1.0:1788270112.134703:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.134832:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253250176 00000100:00100000:0.0:1788270112.134843:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253250176 00000100:00100000:0.0:1788270112.134960:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 367 00000100:00100000:0.0:1788270112.134971:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:38890:x1875136253250176:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270112.134996:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.135014:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a042 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e7f expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135116:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135136:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135147:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135159:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135168:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135175:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135278:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a057 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135289:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a057 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135296:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a057 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270112.135306:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:0.0:1788270112.135403:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135412:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135418:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135426:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135432:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.135437:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135445:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135458:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270112.135462:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.135466:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135473:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a049 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135487:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135493:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135500:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135505:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.135508:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135518:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135525:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x4f74ecdb (ffff98c1429f2700) 00010000:00010000:0.0:1788270112.135527:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.135531:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135537:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192200/0xc5f5d7a016e0a050 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135602:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a042 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e7f expref: 60 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135615:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a057 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e7f expref: 59 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.135623:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.135625:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270112.135627:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192400, rc 0) 00000100:00100000:0.0:1788270112.135683:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:38890:x1875136253250176:12345-192.168.201.42@tcp:101:dd.500 Request processed in 713us (991us total) trans 30064771338 rc 0/0 00000100:00100000:0.0:1788270112.135690:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 367 00000100:00100000:1.0:1788270112.137558:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.137611:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253250304 00000100:00100000:0.0:1788270112.137620:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253250304 00000100:00100000:0.0:1788270112.137666:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 368 00000100:00100000:0.0:1788270112.137673:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:38890:x1875136253250304:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270112.137696:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.137714:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a065 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e86 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.137743:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.137752:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.137759:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.137858:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a065 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 61 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.137878:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 60 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.137886:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.137889:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270112.137892:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192a00, rc 0) 00000100:00100000:0.0:1788270112.137941:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:38890:x1875136253250304:12345-192.168.201.42@tcp:101:dd.500 Request processed in 268us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.137948:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 368 00000100:00100000:1.0:1788270112.139132:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.139430:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253250560 00000100:00100000:0.0:1788270112.139438:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253250560 00000100:00100000:0.0:1788270112.139485:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 369 00000100:00100000:0.0:1788270112.139494:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:38890:x1875136253250560:12345-192.168.201.42@tcp:36:dd.500 00010000:00010000:0.0:1788270112.139532:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270112.139552:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a057 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e7f expref: 60 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.139570:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.139575:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270112.139725:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.139738:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.139746:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270112.139784:0:45777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771339 00000004:00010000:0.0:1788270112.139804:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090ab1134 reply state 000000001e36c6ad transno 30064771340 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.139817:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.139824:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.139826:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270112.139829:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270112.142084:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38890:x1875136253250560:12345-192.168.201.42@tcp:36:dd.500 Request processed in 2581us (2946us total) trans 30064771340 rc 0/0 00000100:00100000:0.0:1788270112.142096:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 369 00000020:00080000:0.0:1788270112.142103:0:45777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270112.196195:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270112.260549:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.260608:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253250816 00000100:00100000:2.0:1788270112.260618:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253250816 00000100:00100000:2.0:1788270112.260686:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788270112.260697:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38890:x1875136253250816:12345-192.168.201.42@tcp:103:dd.500 00010000:00010000:2.0:1788270112.260714:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270112.260737:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e09fbd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e55 expref: 62 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.260757:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.260762:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270112.260908:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:38890:x1875136253250816:12345-192.168.201.42@tcp:103:dd.500 Request processed in 212us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.260916:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:1.0:1788270112.262406:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.262545:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253250944 00000100:00100000:0.0:1788270112.262553:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253250944 00000100:00100000:0.0:1788270112.262606:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 370 00000100:00100000:0.0:1788270112.262615:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:38890:x1875136253250944:12345-192.168.201.42@tcp:58:dd.500 00010000:00010000:0.0:1788270112.262720:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.262737:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.262748:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270112.262846:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].8, 136 off9280 00000100:00100000:0.0:1788270112.262920:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:38890:x1875136253250944:12345-192.168.201.42@tcp:58:dd.500 Request processed in 305us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.262927:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 370 00000100:00100000:1.0:1788270112.264107:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.264205:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253251072 00000100:00100000:0.0:1788270112.264211:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253251072 00000100:00100000:0.0:1788270112.264301:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 371 00000100:00100000:0.0:1788270112.264310:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:38890:x1875136253251072:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270112.264322:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.264337:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e8d expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.264392:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.264403:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 62 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.264420:0:45778:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.264432:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 62 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.264445:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.264447:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270112.264451:0:45778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 62 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.264469:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1a00, rc 0) 00000100:00100000:0.0:1788270112.264505:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38890:x1875136253251072:12345-192.168.201.42@tcp:101:dd.500 Request processed in 198us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.264511:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 371 00000040:00080000:2.0:1788270112.453354:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270112.453372:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270112.453402:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 9 count 9 00000040:00080000:2.0:1788270112.453411:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270112.453547:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262663424:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788270112.453643:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788270112.457760:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.457853:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253251200 00000100:00100000:0.0:1788270112.457862:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253251200 00000100:00100000:2.0:1788270112.457879:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262663424:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270112.457913:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 372 00000100:00100000:0.0:1788270112.457921:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38891:x1875136253251200:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788270112.457948:0:45777:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788270112.458093:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38891:x1875136253251200:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 173us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.458099:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 372 00000100:00100000:1.0:1788270112.460625:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.460683:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253251328 00000100:00100000:0.0:1788270112.460691:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253251328 00000100:00100000:0.0:1788270112.460748:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 373 00000100:00100000:0.0:1788270112.460759:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38891:x1875136253251328:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788270112.460826:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460842:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460852:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460862:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460867:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460871:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460886:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460892:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460895:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270112.460926:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00000004:00200000:0.0:1788270112.460929:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270112.460939:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460950:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460954:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460958:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460962:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460966:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.460969:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460974:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460984:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270112.460987:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.460991:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.460997:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a088 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461009:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461015:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461021:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461035:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.461081:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461088:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461096:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdcf8d881 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270112.461099:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.461102:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461108:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a08f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461125:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461131:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461137:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461142:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.461145:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461154:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461161:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.461164:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.461166:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.461173:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a096 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270112.461243:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38891:x1875136253251328:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 485us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.461251:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 373 00000100:00100000:1.0:1788270112.464846:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.464962:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253251584 00000100:00100000:0.0:1788270112.464971:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253251584 00000100:00100000:0.0:1788270112.465027:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 374 00000100:00100000:0.0:1788270112.465249:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:38891:x1875136253251584:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270112.465267:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.465365:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a09d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e94 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465467:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465483:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465494:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270112.465506:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00010000:00010000:0.0:1788270112.465579:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465585:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465589:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465593:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.465596:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465601:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465610:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:0.0:1788270112.465612:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270112.465615:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465618:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a0a4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465652:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a09d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e94 expref: 64 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465662:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270112.465664:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270112.465668:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a09d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e94 expref: 64 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.465678:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:0.0:1788270112.465732:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38891:x1875136253251584:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 691us (889us total) trans 30064771341 rc 301/301 00000100:00100000:0.0:1788270112.465739:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 374 00000100:00100000:1.0:1788270112.469715:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.469775:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253251712 00000100:00100000:0.0:1788270112.469784:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253251712 00000100:00100000:0.0:1788270112.469841:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 375 00000100:00100000:0.0:1788270112.469853:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38891:x1875136253251712:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788270112.469888:0:45777:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788270112.470008:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38891:x1875136253251712:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.470016:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 375 00000100:00100000:1.0:1788270112.471892:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.471963:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253251968 00000100:00100000:2.0:1788270112.471971:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253251968 00000100:00100000:2.0:1788270112.472030:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 376 00000100:00100000:2.0:1788270112.472072:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38891:x1875136253251968:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270112.472090:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270112.472093:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270112.472120:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e09f62 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e39 expref: 63 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.472137:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:2.0:1788270112.472141:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270112.472153:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0b2 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101e9b expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270112.472513:0:48110:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc8:0x0], index 0: 0 00010000:00010000:2.0:1788270112.472929:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a0b9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.472944:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a0b9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.472955:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a0b9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.473004:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0b2 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e9b expref: 65 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.473019:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a0b9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e9b expref: 64 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.473027:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:2.0:1788270112.473030:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270112.473033:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fc00, rc 0) 00000100:00100000:2.0:1788270112.473117:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:38891:x1875136253251968:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1078us (1231us total) trans 30064771342 rc 0/0 00000100:00100000:2.0:1788270112.473129:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 376 00000100:00100000:1.0:1788270112.478408:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.478584:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253252224 00000100:00100000:0.0:1788270112.478593:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253252224 00000100:00100000:0.0:1788270112.478679:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 377 00000100:00100000:0.0:1788270112.478691:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:38891:x1875136253252224:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270112.478751:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270112.478779:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a0b9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e9b expref: 64 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478798:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429fa800) 00010000:00010000:0.0:1788270112.478809:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270112.478829:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478846:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478856:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478917:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478926:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478933:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478988:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.478996:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479001:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479005:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.479008:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479012:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479020:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:0.0:1788270112.479024:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.479027:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479034:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a0c7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479073:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479078:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479084:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479089:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.479092:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479098:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479105:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x9c98915f (ffff98c1429f2f00) 00010000:00010000:0.0:1788270112.479108:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270112.479111:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.479116:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a0ce lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x9c98915f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270112.479192:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38891:x1875136253252224:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 503us (795us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788270112.479200:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 377 00000100:00100000:1.0:1788270112.481834:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.482107:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253252352 00000100:00100000:0.0:1788270112.482117:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253252352 00000100:00100000:0.0:1788270112.482287:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 378 00000100:00100000:0.0:1788270112.482298:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38891:x1875136253252352:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270112.482397:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270112.482419:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a0d5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ea2 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.482456:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.482469:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.482480:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.482605:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a0d5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 65 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.482625:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 64 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.482634:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:0.0:1788270112.482636:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270112.482640:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192400, rc 0) 00000100:00100000:0.0:1788270112.482690:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:38891:x1875136253252352:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 394us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.482698:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 378 00000100:00100000:3.0:1788270112.486821:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.486936:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253252608 00000100:00100000:0.0:1788270112.486945:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253252608 00000100:00100000:0.0:1788270112.486984:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 379 00000100:00100000:0.0:1788270112.486991:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:38891:x1875136253252608:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788270112.487097:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.487116:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.487128:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270112.487320:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].11, 88 off8992 00000004:00010000:0.0:1788270112.487383:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af16b216 reply state 00000000029fdbda transno 30064771343 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.487396:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.487404:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:0.0:1788270112.487407:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788270112.487410:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270112.487575:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:38891:x1875136253252608:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 582us (765us total) trans 30064771343 rc 0/0 00000100:00100000:0.0:1788270112.487585:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 379 00000100:00100000:1.0:1788270112.491764:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.491824:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253252736 00000100:00100000:2.0:1788270112.491833:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253252736 00000100:00100000:2.0:1788270112.491893:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 380 00000100:00100000:2.0:1788270112.491904:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:38891:x1875136253252736:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270112.491937:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270112.491957:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ea9 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.492012:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 67 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.492026:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 67 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.492249:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:2.0:1788270112.492254:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270112.492258:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fe00, rc 0) 00000100:00100000:2.0:1788270112.492313:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:38891:x1875136253252736:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 410us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.492320:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 380 00000100:00100000:2.0:1788270112.497151:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.497574:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253252864 00000100:00100000:1.0:1788270112.497584:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253252864 00000100:00100000:1.0:1788270112.497647:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:1.0:1788270112.497659:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253252864:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788270112.498099:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253252864:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 440us (955us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1788270112.498108:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:3.0:1788270112.500643:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.500873:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253253120 00000100:00100000:0.0:1788270112.500883:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253253120 00000100:00100000:0.0:1788270112.500937:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788270112.500948:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:38891:x1875136253253120:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788270112.501190:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:38891:x1875136253253120:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 243us (553us total) trans 30064771344 rc 0/0 00000100:00100000:0.0:1788270112.501198:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788270112.502961:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.503066:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253253376 00000100:00100000:2.0:1788270112.503074:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253253376 00000100:00100000:2.0:1788270112.503117:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 381 00000100:00100000:2.0:1788270112.503125:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:38891:x1875136253253376:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270112.503205:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:38891:x1875136253253376:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.503212:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 381 00000100:00100000:2.0:1788270112.504536:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270112.504867:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253253504 00000100:00100000:3.0:1788270112.504874:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253253504 00000100:00100000:3.0:1788270112.504918:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 382 00000100:00100000:3.0:1788270112.504927:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:38891:x1875136253253504:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270112.504943:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270112.504962:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a0f1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101eb0 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.505071:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e0a0f8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.505086:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e0a0f8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.505101:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e0a0f8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270112.505402:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270112.505424:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e0a0f8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.505457:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a0f1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb0 expref: 70 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.505475:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e0a0f8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb0 expref: 69 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.505484:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:2.0:1788270112.505487:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270112.505491:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf000, rc 0) 00000100:00100000:2.0:1788270112.505535:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:38891:x1875136253253504:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 609us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.505542:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 382 00000100:00100000:3.0:1788270112.507423:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.507496:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253253632 00000100:00100000:1.0:1788270112.507504:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253253632 00000100:00100000:1.0:1788270112.507554:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:1.0:1788270112.507566:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253253632:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270112.507581:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270112.507611:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101eb7 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270112.507638:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d620, blocks: 0x0 00010000:00010000:1.0:1788270112.507658:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=904s v=(0 0) 00010000:00010000:1.0:1788270112.507664:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270112.507674:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 17 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.507692:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 17 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.507714:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:1.0:1788270112.507768:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253253632:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 205us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270112.507775:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:0.0:1788270112.512446:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.512507:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253253888 00000100:00100000:2.0:1788270112.512518:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253253888 00000100:00100000:2.0:1788270112.512696:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 383 00000100:00100000:2.0:1788270112.512707:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:38891:x1875136253253888:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270112.512837:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:38891:x1875136253253888:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.512857:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 383 00000100:00100000:2.0:1788270112.519108:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.519284:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254016 00000100:00100000:1.0:1788270112.519294:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254016 00000100:00100000:1.0:1788270112.519403:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788270112.519413:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:38891:x1875136253254016:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788270112.519428:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270112.519442:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ebe expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.519467:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.519478:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270112.519482:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270112.519485:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 18 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.519510:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.519519:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 1004 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270112.519529:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262663552:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270112.519596:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246ed8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270112.522989:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:47284:1875136262663552:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270112.523025:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 18 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.523081:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d200, rc 0) 00000100:00100000:1.0:1788270112.523143:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:38891:x1875136253254016:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3730us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270112.523152:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:0.0:1788270112.523679:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270112.523766:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254144 00000100:00100000:3.0:1788270112.523773:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254144 00010000:00010000:3.0:1788270112.523801:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 1004 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.523867:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:3.0:1788270112.523878:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253254144:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270112.523890:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270112.523911:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 1004 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.523924:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 1004 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.523945:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bfd87d/0xc5f5d7a016e0a0ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb7 expref: 18 pid: 48230 timeout: 1004 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.523964:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270112.523968:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270112.523975:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 17 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.523986:0:45763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 17 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.524018:0:45763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 17 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.524033:0:45763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:45763:1875136262663680:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270112.524117:0:45763:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24844e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788270112.525273:0:45763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:45763:1875136262663680:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270112.525289:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270112.525331:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253254144:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 1455us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270112.525340:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:1.0:1788270112.585327:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.585413:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254272 00000100:00100000:0.0:1788270112.585423:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254272 00002000:00100000:0.0:1788270112.585482:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc8:0x0] (0->4194303) req@ffff98c27c2b7480 x1875136253254272/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270112.585493:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2b7480 with x1875136253254272 ext(0->4194303) 00002000:00010000:0.0:1788270112.585499:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c2b7480 00000100:00100000:0.0:1788270112.585524:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:0.0:1788270112.585532:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253254272:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270112.617481:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253254272:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 31938us (32153us total) trans 30064771109 rc 0/0 00000100:00100000:0.0:1788270112.617496:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00002000:00100000:0.0:1788270112.617511:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc8:0x0] (0->4194303) req@ffff98c27c2b7480 x1875136253254272/t30064771109(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270112.617522:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2b7480 with x1875136253254272 ext(0->4194303) 00002000:00010000:0.0:1788270112.617530:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c2b7480 00000100:00100000:2.0:1788270112.628799:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270112.628859:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254400 00000100:00100000:3.0:1788270112.628869:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254400 00002000:00100000:3.0:1788270112.628920:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc8:0x0] (4194304->8388607) req@ffff98c144099c00 x1875136253254400/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270112.628932:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144099c00 with x1875136253254400 ext(4194304->8388607) 00002000:00010000:3.0:1788270112.628938:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c144099c00 00000100:00100000:3.0:1788270112.629020:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:3.0:1788270112.629028:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2403:x1875136253254400:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270112.652449:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253254400:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 23406us (23645us total) trans 30064771110 rc 0/0 00000100:00100000:0.0:1788270112.652467:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00002000:00100000:0.0:1788270112.652481:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc8:0x0] (4194304->8388607) req@ffff98c144099c00 x1875136253254400/t30064771110(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270112.652495:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144099c00 with x1875136253254400 ext(4194304->8388607) 00002000:00010000:0.0:1788270112.652501:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c144099c00 00000100:00100000:2.0:1788270112.677609:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.677665:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254528 00000100:00100000:1.0:1788270112.677673:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254528 00002000:00100000:1.0:1788270112.677725:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc8:0x0] (8388608->12582911) req@ffff98c14409b100 x1875136253254528/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270112.677734:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14409b100 with x1875136253254528 ext(8388608->12582911) 00002000:00010000:1.0:1788270112.677744:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14409b100 00000100:00100000:1.0:1788270112.677770:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:1.0:1788270112.677777:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2402:x1875136253254528:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270112.709884:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2402:x1875136253254528:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 32094us (32270us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1788270112.709899:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00002000:00100000:2.0:1788270112.710198:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc8:0x0] (8388608->12582911) req@ffff98c14409b100 x1875136253254528/t30064771111(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270112.710211:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14409b100 with x1875136253254528 ext(8388608->12582911) 00002000:00010000:2.0:1788270112.710218:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14409b100 00000100:00100000:0.0:1788270112.715796:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.716372:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254656 00000100:00100000:2.0:1788270112.716382:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254656 00002000:00100000:2.0:1788270112.716432:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc8:0x0] (12582912->16777215) req@ffff98c27a620e00 x1875136253254656/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270112.716443:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a620e00 with x1875136253254656 ext(12582912->16777215) 00002000:00010000:2.0:1788270112.716449:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a620e00 00000100:00100000:2.0:1788270112.716484:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:2.0:1788270112.716493:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2403:x1875136253254656:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270112.746446:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2403:x1875136253254656:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 29862us (30570us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1788270112.746465:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00002000:00100000:0.0:1788270112.746476:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc8:0x0] (12582912->16777215) req@ffff98c27a620e00 x1875136253254656/t30064771112(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270112.746485:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a620e00 with x1875136253254656 ext(12582912->16777215) 00002000:00010000:0.0:1788270112.746491:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a620e00 00000100:00100000:1.0:1788270112.760559:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.760623:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254784 00000100:00100000:0.0:1788270112.760635:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254784 00002000:00100000:0.0:1788270112.760685:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc8:0x0] (16777216->20971519) req@ffff98c27c2b4700 x1875136253254784/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270112.760696:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2b4700 with x1875136253254784 ext(16777216->20971519) 00002000:00010000:0.0:1788270112.760703:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c2b4700 00000100:00100000:0.0:1788270112.760965:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788270112.760977:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2403:x1875136253254784:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270112.795120:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2403:x1875136253254784:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 34132us (34555us total) trans 30064771113 rc 0/0 00000100:00100000:0.0:1788270112.795136:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00002000:00100000:0.0:1788270112.795153:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc8:0x0] (16777216->20971519) req@ffff98c27c2b4700 x1875136253254784/t30064771113(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270112.795164:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2b4700 with x1875136253254784 ext(16777216->20971519) 00002000:00010000:0.0:1788270112.795172:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c2b4700 00000100:00100000:1.0:1788270112.799480:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.799569:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253254912 00000100:00100000:2.0:1788270112.799577:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253254912 00000100:00100000:2.0:1788270112.799754:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 384 00000100:00100000:2.0:1788270112.799764:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:38891:x1875136253254912:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788270112.803881:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771344 is committed 00000020:00080000:3.0:1788270112.803922:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c24880e240 refcount 2 committed 0 result 0 batchid 25769803846 00000020:00080000:3.0:1788270112.803928:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c250d4e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c242bf79c0 00000020:00080000:3.0:1788270112.803931:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c250d4e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1436b8000 00000004:00080000:3.0:1788270112.803966:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788270112.804016:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803846 committed batchid 25769803845 00010000:00010000:2.0:1788270112.804068:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804079:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804087:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804093:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804097:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804105:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788270112.804105:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803845 00010000:00010000:2.0:1788270112.804122:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff98c1429f2600) 00010000:00010000:2.0:1788270112.804125:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.804139:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804146:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9fa00/0xc5f5d7a016e09e97 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804166:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804172:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804177:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804183:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804186:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804192:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804199:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:2.0:1788270112.804202:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.804205:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804211:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e200/0xc5f5d7a016e09e9e lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804223:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804227:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804230:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804233:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26bf9e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804235:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804238:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804245:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x4f74ecdb (ffff98c1429f2700) 00010000:00010000:2.0:1788270112.804247:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.804249:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804253:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9e600/0xc5f5d7a016e09edd lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804262:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804265:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804268:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804271:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804273:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804276:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804280:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xa92decdb (ffff98c1429f2100) 00010000:00010000:2.0:1788270112.804281:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.804282:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804285:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db400/0xc5f5d7a016e09f07 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1a:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804294:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804298:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804301:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804304:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2821db600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804305:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804308:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804312:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.804313:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270112.804315:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804318:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2821db600/0xc5f5d7a016e09f31 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804323:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804326:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804329:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804333:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804334:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804338:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804342:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff98c1429f2900) 00010000:00010000:2.0:1788270112.804343:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270112.804344:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804347:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e09f4d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804376:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804385:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804390:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804395:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804398:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804403:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804415:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.804421:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.804423:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804429:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a073 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804439:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804445:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804450:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804454:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.804456:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804461:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804469:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:2.0:1788270112.804470:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270112.804473:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.804477:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a0e3 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270112.804565:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270112.804584:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262663808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788270112.804650:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788270112.804711:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788270112.804725:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771315 is committed 00000100:00100000:2.0:1788270112.804850:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38891:x1875136253254912:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 5084us (5375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.804860:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 384 00000100:00100000:1.0:1788270112.804878:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262663936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788270112.804912:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270112.806056:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262663808 00000100:00100000:3.0:1788270112.806063:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262663808 00000100:00100000:3.0:1788270112.806114:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262663936 00000100:00100000:3.0:1788270112.806117:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262663936 00000100:00100000:3.0:1788270112.806141:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788270112.806150:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262663808:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788270112.806168:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788270112.806298:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb size from disk: 12582912 -> 12582912 00002000:00010000:3.0:1788270112.806302:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb mtime from disk: 1788270111 -> 1788270111 00002000:00010000:3.0:1788270112.806304:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270112.806306:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb ctime from disk: 1788270111 -> 1788270111 00002000:00010000:3.0:1788270112.806308:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc7:0x0] updating lvb blocks from disk: 24576 -> 24576 00000100:00100000:3.0:1788270112.806372:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262663808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (1722us total) trans 30064771142 rc 0/0 00000100:00100000:3.0:1788270112.806379:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788270112.806394:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788270112.806400:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262663936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788270112.806495:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262663936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (1581us total) trans 30064771114 rc 0/0 00000100:00100000:3.0:1788270112.806502:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:1.0:1788270112.806704:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c2b6300/2, rc 0, transno 30064771142 00000100:00100000:1.0:1788270112.806710:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262663808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1788270112.806733:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c2b5880/2, rc 0, transno 30064771114 00000100:00100000:1.0:1788270112.806780:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262663936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788270112.807336:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.807392:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253255040 00000100:00100000:0.0:1788270112.807398:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253255040 00000100:00100000:3.0:1788270112.807459:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:3.0:1788270112.807467:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2401:x1875136253255040:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788270112.808426:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771114 is committed 00000001:00080000:0.0:1788270112.808432:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771113 is committed 00000100:00100000:3.0:1788270112.808571:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253255040:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1102us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270112.808578:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:3.0:1788270112.822244:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.822504:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253255296 00000100:00100000:2.0:1788270112.822515:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253255296 00000100:00100000:2.0:1788270112.822577:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 385 00000100:00100000:2.0:1788270112.822587:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38891:x1875136253255296:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270112.822791:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270112.822814:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf000/0xc5f5d7a016e0a0f8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eb0 expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.822829:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:2.0:1788270112.822833:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270112.822856:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.822866:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.822873:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270112.822980:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9adad24 reply state 000000004ead6fed transno 30064771345 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.822997:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.823004:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:2.0:1788270112.823006:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270112.823009:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270112.823166:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:38891:x1875136253255296:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 579us (929us total) trans 30064771345 rc 0/0 00000100:00100000:2.0:1788270112.823174:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 385 00000100:00100000:1.0:1788270112.824893:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270112.825233:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253255424 00000100:00100000:3.0:1788270112.825242:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253255424 00000100:00100000:3.0:1788270112.825287:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788270112.825296:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253255424:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788270112.825451:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:3.0:1788270112.825455:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb mtime from disk: 0 -> 1788270112 00002000:00010000:3.0:1788270112.825457:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb atime from disk: 0 -> 1788270111 00002000:00010000:3.0:1788270112.825459:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb ctime from disk: 1788270112 -> 1788270112 00002000:00010000:3.0:1788270112.825461:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb blocks from disk: 0 -> 40960 00000100:00100000:3.0:1788270112.825517:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253255424:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 221us (628us total) trans 30064771115 rc 0/0 00000100:00100000:3.0:1788270112.825524:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:1.0:1788270112.826944:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.826987:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253255680 00000100:00100000:2.0:1788270112.826994:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253255680 00000100:00100000:2.0:1788270112.827033:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 386 00000100:00100000:2.0:1788270112.827064:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:38891:x1875136253255680:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788270112.827121:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.827137:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 29 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.827145:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.827178:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 29 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.827190:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 29 pid: 45777 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270112.827208:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262664064:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270112.827267:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495240 going to sleep for 11 seconds 00000100:00100000:2.0:1788270112.829371:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.829439:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253255808 00000100:00100000:1.0:1788270112.829448:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253255808 00010000:00010000:1.0:1788270112.829487:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 30 pid: 45777 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270112.829551:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262664064:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270112.829566:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00010000:00010000:0.0:1788270112.829571:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270112.829574:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:2401:x1875136253255808:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270112.829586:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270112.829593:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 30 pid: 45777 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.829605:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 30 pid: 45777 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.829624:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192400/0xc5f5d7a016e0a0dc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea2 expref: 30 pid: 45777 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.829639:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:1.0:1788270112.829643:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.829653:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.829660:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.829684:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270112.829733:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2401:x1875136253255808:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270112.829741:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00010000:00010000:0.0:1788270112.829758:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829766:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829803:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829810:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829816:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829822:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270112.829827:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829834:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829843:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:0.0:1788270112.829845:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788270112.829849:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.829855:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a114 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270112.829947:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38891:x1875136253255680:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 2907us (3038us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788270112.829956:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 386 00000100:00100000:2.0:1788270112.831449:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.831494:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253255936 00000100:00100000:1.0:1788270112.831501:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253255936 00000100:00100000:1.0:1788270112.831547:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788270112.831557:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2401:x1875136253255936:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788270112.831594:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.831610:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 8 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.831616:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270112.831619:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270112.831622:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 4/1,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.831651:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 8 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.831664:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 8 pid: 47284 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270112.831679:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:47281:1875136262664192:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270112.831734:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246ed8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788270112.834516:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:47281:1875136262664192:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270112.834537:0:47281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/1,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270112.852488:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270112.852828:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256064 00000100:00100000:3.0:1788270112.852839:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256064 00010000:00010000:3.0:1788270112.852876:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 9 pid: 47284 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.852952:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:3.0:1788270112.852960:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2400:x1875136253256064:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270112.852972:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270112.852989:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 9 pid: 47284 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.852999:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 9 pid: 47284 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.853016:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009eb2a51/0xc5f5d7a016e0a106 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ebe expref: 9 pid: 47284 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.853029:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270112.853032:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270112.853102:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.853110:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.853133:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270112.853161:0:47281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853176:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.853189:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253256064:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 229us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270112.853196:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00010000:00010000:1.0:1788270112.853197:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853204:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853212:0:47281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853219:0:47281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d000 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270112.853223:0:47281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853231:0:47281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853243:0:47281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.853250:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a11b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270112.853299:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:2401:x1875136253255936:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 21744us (21853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270112.853307:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:3.0:1788270112.854609:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.854746:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256320 00000100:00100000:2.0:1788270112.854753:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256320 00000100:00100000:2.0:1788270112.854827:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 387 00000100:00100000:2.0:1788270112.854837:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:38891:x1875136253256320:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788270112.854895:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.854906:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.854913:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.854936:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.854945:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 28 pid: 45778 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270112.854955:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262664320:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270112.855035:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142495240 going to sleep for 11 seconds 00000100:00100000:0.0:1788270112.856863:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.856962:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262664320:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270112.856981:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.857134:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256448 00000100:00100000:3.0:1788270112.857139:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256448 00010000:00010000:3.0:1788270112.857163:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 29 pid: 45778 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.857209:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:3.0:1788270112.857216:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2400:x1875136253256448:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270112.857226:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270112.857230:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 29 pid: 45778 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857238:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 29 pid: 45778 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857254:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a06c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e86 expref: 29 pid: 45778 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857266:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:3.0:1788270112.857270:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 28 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857277:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857281:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857286:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270112.857306:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270112.857340:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2400:x1875136253256448:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 124us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270112.857347:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00010000:00010000:0.0:1788270112.857410:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.857417:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.857580:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.857591:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.857606:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.857642:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.857654:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 28 pid: 46770 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270112.857667:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262664448:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270112.857732:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1440a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270112.859184:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262664448:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270112.859206:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270112.859897:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270112.859949:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256576 00000100:00100000:0.0:1788270112.859955:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256576 00010000:00010000:0.0:1788270112.859984:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 29 pid: 46770 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270112.860057:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788270112.860068:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:2401:x1875136253256576:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270112.860080:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270112.860086:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 29 pid: 46770 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.860098:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 29 pid: 46770 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.860114:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a0ea lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ea9 expref: 29 pid: 46770 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.860127:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:0.0:1788270112.860131:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.860137:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.860142:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270112.860162:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270112.860200:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2401:x1875136253256576:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 134us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270112.860207:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00010000:00010000:2.0:1788270112.860288:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.860296:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270112.860400:0:48110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771346 00000001:00080000:2.0:1788270112.860512:0:48110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771347 00000001:00080000:2.0:1788270112.860557:0:48110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771348 00000100:00100000:2.0:1788270112.860644:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262664576:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788270112.860680:0:48110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270112.860709:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2751dee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270112.860713:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262664576 00000100:00100000:3.0:1788270112.860718:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262664576 00000100:00100000:3.0:1788270112.860755:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788270112.860763:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262664576:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788270112.860957:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262664576:12345-0@lo:1000:mdt00_004.0 Request processed in 194us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270112.860965:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788270112.861012:0:48110:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771114 gen 2 00000004:00080000:2.0:1788270112.861018:0:48110:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771107 committed transno 30064771114 00000004:00080000:2.0:1788270112.861035:0:48110:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c2b5880, transno 30064771114 00000100:00100000:2.0:1788270112.861460:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262664576:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788270112.861565:0:48110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771349 00000100:00100000:2.0:1788270112.861604:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262664704:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788270112.861749:0:48110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270112.861769:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2751de900 going to sleep for 11 seconds 00000100:00100000:3.0:1788270112.861773:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262664704 00000100:00100000:3.0:1788270112.861778:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262664704 00000100:00100000:3.0:1788270112.861869:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788270112.861876:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262664704:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788270112.861962:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:48110:x1875136262664704:12345-0@lo:1000:mdt00_004.0 Request processed in 87us (212us total) trans 30064771116 rc 0/0 00000100:00100000:3.0:1788270112.861969:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788270112.861976:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262664704:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788270112.862002:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862011:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862018:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862023:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.862027:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862034:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862110:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:2.0:1788270112.862113:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270112.862118:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862124:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a129 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862147:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862153:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862158:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862165:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.862168:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862173:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862180:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.862182:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270112.862187:0:48110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862196:0:48110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862203:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.862221:0:48110:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1a00/0xc5f5d7a016e0a081 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101e8d expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270112.862228:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262664832:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270112.862295:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2751de900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270112.863990:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.864005:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262664832:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270112.864026:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.864122:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256704 00010000:00010000:2.0:1788270112.864124:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a07a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.864128:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256704 00010000:00010000:2.0:1788270112.864151:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864163:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864173:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864182:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864189:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864194:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864200:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e000 already unused, calling callback (ffffffffc1aac4f0) 00000100:00100000:3.0:1788270112.864201:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00010000:00010000:2.0:1788270112.864203:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.864210:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38890:x1875136253256704:12345-192.168.201.42@tcp:49:dd.500 00010000:00010000:2.0:1788270112.864210:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864219:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.864222:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270112.864225:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864230:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a130 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864238:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864244:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864248:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864252:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270112.864255:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864261:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864267:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.864269:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270112.864271:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.864276:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a122 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270112.864350:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38890:x1875136253256704:12345-192.168.201.42@tcp:49:dd.500 Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270112.864367:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788270112.864470:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:38891:x1875136253256320:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 9634us (9863us total) trans 30064771350 rc 0/0 00000100:00100000:2.0:1788270112.864478:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 387 00000020:00080000:2.0:1788270112.864482:0:48110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788270112.864569:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270112.864573:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270112.865528:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 9 00000040:00080000:2.0:1788270112.865541:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270112.869611:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270112.869712:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256832 00000100:00100000:1.0:1788270112.869722:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256832 00000100:00100000:1.0:1788270112.869934:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788270112.869946:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:38890:x1875136253256832:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270112.869964:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270112.869989:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a137 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ec5 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270112.870016:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc8:0x0] initial LVB size: 20971520, mtime: 0x6a96d620, atime: 0x6a96d61f, ctime: 0x6a96d620, blocks: 0xa000 00010000:00010000:1.0:1788270112.870069:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=904s v=(0 0) 00010000:00010000:1.0:1788270112.870075:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270112.870086:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a137 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ec5 expref: 8 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.870102:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f3c0f31/0xc5f5d7a016e0a137 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ec5 expref: 8 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.870115:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d000, rc 0) 00000100:00100000:1.0:1788270112.870184:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:38890:x1875136253256832:12345-192.168.201.42@tcp:101:dd.500 Request processed in 240us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270112.870192:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788270112.877452:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.877550:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253256960 00000100:00100000:2.0:1788270112.877563:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253256960 00000100:00100000:2.0:1788270112.877681:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 388 00000100:00100000:2.0:1788270112.877692:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:38890:x1875136253256960:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270112.877721:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270112.877742:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a13e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ecc expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.877777:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a145 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.877803:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a145 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.877816:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a145 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.877952:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a13e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ecc expref: 33 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.877970:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e000/0xc5f5d7a016e0a145 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ecc expref: 32 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.877979:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270112.877982:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270112.877986:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418e000, rc 0) 00000100:00100000:2.0:1788270112.878084:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38890:x1875136253256960:12345-192.168.201.42@tcp:101:dd.500 Request processed in 394us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270112.878092:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 388 00000100:00100000:3.0:1788270112.920954:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.923337:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253257216 00000100:00100000:2.0:1788270112.923421:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253257216 00000100:00100000:2.0:1788270112.923501:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:2.0:1788270112.923513:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:38891:x1875136253257216:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788270112.923862:0:49484:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788270112.923896:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771351 00010000:00010000:2.0:1788270112.924092:0:49484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.924111:0:49484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.924123:0:49484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.924132:0:49484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.924139:0:49484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.924146:0:49484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270112.924171:0:49484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788270112.924288:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:38891:x1875136253257216:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 776us (3343us total) trans 30064771352 rc 0/0 00000100:00100000:2.0:1788270112.924299:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000020:00080000:2.0:1788270112.924304:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788270112.924449:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270112.924457:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.924466:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270112.924471:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.924479:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.924493:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:1.0:1788270112.924495:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270112.924500:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.924507:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a14c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270112.924520:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270112.924522:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270112.924524:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270112.942798:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.942870:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253257344 00000100:00100000:2.0:1788270112.942878:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253257344 00002000:00100000:2.0:1788270112.942927:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc8:0x0] (20971520->25165823) req@ffff98c27a623800 x1875136253257344/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788270112.942936:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623800 with x1875136253257344 ext(20971520->25165823) 00002000:00010000:2.0:1788270112.942941:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a623800 00000100:00100000:2.0:1788270112.942969:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788270112.942979:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253257344:12345-192.168.201.42@tcp:4:dd.500 00000100:00100000:1.0:1788270112.975581:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253257344:12345-192.168.201.42@tcp:4:dd.500 Request processed in 32589us (32777us total) trans 30064771117 rc 0/0 00000100:00100000:1.0:1788270112.975597:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00002000:00100000:1.0:1788270112.975612:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc8:0x0] (20971520->25165823) req@ffff98c27a623800 x1875136253257344/t30064771117(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788270112.975630:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623800 with x1875136253257344 ext(20971520->25165823) 00002000:00010000:1.0:1788270112.975638:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a623800 00000100:00100000:0.0:1788270112.999804:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270112.999972:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253257472 00000100:00100000:2.0:1788270112.999983:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253257472 00002000:00100000:2.0:1788270113.000034:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc8:0x0] (25165824->29360127) req@ffff98c27a623b80 x1875136253257472/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/0 e 0 to 0 dl 1788270123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788270113.000090:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623b80 with x1875136253257472 ext(25165824->29360127) 00002000:00010000:2.0:1788270113.000096:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a623b80 00000100:00100000:2.0:1788270113.000120:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:2.0:1788270113.000145:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253257472:12345-192.168.201.42@tcp:4:dd.500 00000100:00080000:1.0:1788270113.000439:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270113.010906:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270113.010957:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253257728 00000100:00100000:0.0:1788270113.010968:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253257728 00000100:00080000:2.0:1788270113.011100:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270113.011211:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:0.0:1788270113.011223:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:38890:x1875136253257728:12345-192.168.201.42@tcp:35:dd.500 00000001:00080000:0.0:1788270113.011445:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771353 00000001:00080000:0.0:1788270113.011480:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771354 00000100:00100000:0.0:1788270113.011561:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38890:x1875136253257728:12345-192.168.201.42@tcp:35:dd.500 Request processed in 341us (661us total) trans 30064771355 rc 0/0 00000100:00100000:0.0:1788270113.011570:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000020:00080000:0.0:1788270113.011574:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788270113.029314:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253257472:12345-192.168.201.42@tcp:4:dd.500 Request processed in 29170us (29503us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1788270113.029328:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00002000:00100000:2.0:1788270113.029343:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc8:0x0] (25165824->29360127) req@ffff98c27a623b80 x1875136253257472/t30064771118(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:528/0 lens 488/448 e 0 to 0 dl 1788270123 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788270113.029375:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623b80 with x1875136253257472 ext(25165824->29360127) 00002000:00010000:2.0:1788270113.029381:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27a623b80 00000100:00100000:0.0:1788270113.049306:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270113.049387:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253257856 00000100:00100000:2.0:1788270113.049397:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253257856 00000100:00100000:2.0:1788270113.049453:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 389 00000100:00100000:2.0:1788270113.049465:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38901:x1875136253257856:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270113.049539:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049553:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049561:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049573:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049577:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049584:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049657:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049666:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049678:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270113.049719:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049732:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049739:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049746:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049752:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049758:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270113.049763:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049770:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049782:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff98c1429f2000) 00010000:00010000:2.0:1788270113.049785:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270113.049790:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049796:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a153 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049811:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049817:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049823:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049828:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270113.049831:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049837:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049845:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x4f74ecdb (ffff98c1429fe500) 00010000:00010000:2.0:1788270113.049847:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270113.049850:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049856:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a15a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049869:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049876:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049882:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049886:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270113.049888:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049892:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049897:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff98c1429f2a00) 00010000:00010000:2.0:1788270113.049899:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270113.049900:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270113.049903:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a161 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270113.049970:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38901:x1875136253257856:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 507us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270113.049977:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 389 00010000:00010000:0.0:1788270113.220588:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270113.988473:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262664960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270113.988555:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270113.988695:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262664960 00000100:00100000:3.0:1788270113.988705:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262664960 00000100:00100000:3.0:1788270113.988753:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788270113.988763:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262664960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270113.988807:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788270113.990690:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262664960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1921us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270113.990702:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788270113.991087:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262664960:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270114.247853:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270114.305855:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270114.305907:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270114.305978:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270114.306021:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270114.306077:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270114.306097:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270114.306164:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258112 00000100:00100000:0.0:1788270114.306176:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258112 00000100:00100000:0.0:1788270114.306225:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258624 00000100:00100000:0.0:1788270114.306228:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258624 00000100:00100000:0.0:1788270114.306252:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258240 00000100:00100000:0.0:1788270114.306255:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258240 00000100:00100000:0.0:1788270114.306274:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:0.0:1788270114.306283:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:2402:x1875136253258112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270114.306369:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:2402:x1875136253258112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 87us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270114.306377:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:0.0:1788270114.306396:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:0.0:1788270114.306403:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253258624:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270114.306429:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253258624:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270114.306436:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:0.0:1788270114.306448:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:0.0:1788270114.306454:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253258240:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270114.306477:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253258240:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270114.306483:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:0.0:1788270114.306623:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253257984 00000100:00100000:0.0:1788270114.306627:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253257984 00000100:00100000:0.0:1788270114.306655:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00100000:0.0:1788270114.306662:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253257984:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270114.306703:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253257984:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270114.306709:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00080000:2.0:1788270114.306808:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270114.306812:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270114.308960:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270114.309200:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258752 00000100:00100000:0.0:1788270114.309210:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258752 00000100:00100000:0.0:1788270114.309273:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:0.0:1788270114.309282:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253258752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270114.309363:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253258752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 82us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270114.309374:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00080000:1.0:1788270114.309679:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270114.310023:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258368 00000100:00100000:3.0:1788270114.310029:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258368 00000100:00100000:3.0:1788270114.310087:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258496 00000100:00100000:3.0:1788270114.310091:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258496 00000100:00100000:3.0:1788270114.310121:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270114.310129:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253258368:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270114.310170:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253258368:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270114.310176:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788270114.310190:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:3.0:1788270114.310196:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2402:x1875136253258496:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270114.310222:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2402:x1875136253258496:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270114.310229:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00080000:0.0:1788270114.311176:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270114.500202:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262665088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270114.500275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.500314:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665088 00000100:00100000:3.0:1788270114.500322:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665088 00000100:00100000:3.0:1788270114.500397:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788270114.500407:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262665088:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788270114.500496:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270114.500508:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262665216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270114.500536:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788270114.500597:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5500928 granted 180920000 pending 12656640 free 3821953024 avail 3590430720 00000100:00100000:3.0:1788270114.500650:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262665088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 244us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270114.500658:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:1.0:1788270114.500663:0:45801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906207622743ns, next at 907207619676ns, rc = 0 00000100:00100000:3.0:1788270114.500673:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665216 00000100:00100000:3.0:1788270114.500676:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665216 00000100:00100000:1.0:1788270114.500687:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262665344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270114.500698:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788270114.500703:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262665216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270114.500715:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5500928 granted 180920000 pending 12656640 free 3821953024 avail 3590430720 00000100:00100000:1.0:1788270114.500715:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270114.500745:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665344 00000100:00100000:1.0:1788270114.500749:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665344 00000100:00100000:3.0:1788270114.500760:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262665216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270114.500766:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788270114.500769:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788270114.500775:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262665344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270114.500790:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 110091968 pending 8437760 free 3865825280 avail 3634302976 00000100:00100000:1.0:1788270114.500830:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262665344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.500837:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788270114.500965:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262665856:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.500992:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.501009:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262666368:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.501032:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270114.501036:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262665472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.501083:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262665344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270114.501084:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.501108:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665856 00000100:00100000:1.0:1788270114.501110:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262665984:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.501111:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665856 00000100:00100000:1.0:1788270114.501132:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.501134:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788270114.501139:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262665856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.501148:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262666496:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.501168:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.501175:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262665856:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.501192:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665472 00000100:00100000:3.0:1788270114.501193:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788270114.501195:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665472 00000100:00100000:3.0:1788270114.501216:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771315 gen 2 00000100:00100000:1.0:1788270114.501217:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000004:00080000:3.0:1788270114.501221:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771315 committed transno 30064771315 00000100:00100000:1.0:1788270114.501222:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262665472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.501236:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262665856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.501254:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262665472:12345-0@lo:400:kworker.0 Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.501260:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788270114.501287:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665984 00000100:00100000:1.0:1788270114.501290:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665984 00000100:00100000:1.0:1788270114.501335:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788270114.501342:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262665984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.501369:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262665984:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.501374:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788270114.501397:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262665472:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.501407:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262665984:0@lo:400:kworker.0 00000100:00080000:0.0:1788270114.502369:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270114.502374:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270114.502386:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262665728:0@lo:400:kworker.0 00000100:00100000:0.0:1788270114.502415:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270114.502445:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262666240:0@lo:400:kworker.0 00000100:00100000:0.0:1788270114.502466:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.502503:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666368 00000100:00100000:0.0:1788270114.502504:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262665216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270114.502508:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666368 00000100:00100000:0.0:1788270114.502519:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788270114.502525:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262665600:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.502544:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666496 00000100:00100000:3.0:1788270114.502547:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666496 00000100:00100000:0.0:1788270114.502548:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.502560:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665728 00000100:00100000:3.0:1788270114.502563:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665728 00000100:00100000:0.0:1788270114.502565:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262666112:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.502572:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666240 00000100:00100000:3.0:1788270114.502574:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666240 00000100:00100000:0.0:1788270114.502583:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270114.502586:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666112 00000100:00100000:3.0:1788270114.502588:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666112 00000100:00100000:0.0:1788270114.502594:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262666624:0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.502600:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788270114.502606:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262666368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270114.502611:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270114.502629:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666624 00000100:00100000:0.0:1788270114.502632:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666624 00000100:00100000:3.0:1788270114.502646:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262666368:12345-0@lo:400:kworker.0 Request processed in 40us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270114.502651:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788270114.502656:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262666496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270114.502698:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262666496:12345-0@lo:400:kworker.0 Request processed in 41us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270114.502724:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788270114.502740:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788270114.502747:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262665728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.502747:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788270114.502754:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262666240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.502779:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262665728:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.502781:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262666240:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270114.502785:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788270114.502788:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788270114.502796:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788270114.502799:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788270114.502802:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262666112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.502804:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262666624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270114.502826:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262666112:12345-0@lo:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.502826:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262666624:12345-0@lo:400:kworker.0 Request processed in 22us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270114.502832:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788270114.502842:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788270114.502868:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262666368:0@lo:400:kworker.0 00000100:00100000:2.0:1788270114.502888:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262665600 00000100:00100000:2.0:1788270114.502892:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262665600 00000100:00100000:2.0:1788270114.502919:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788270114.502926:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262665600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270114.502958:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262665600:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270114.502963:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1788270114.503019:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270114.503022:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270114.503067:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262665088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270114.503099:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262666496:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.503120:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262665600:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.503125:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262666112:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.503130:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262666624:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.503135:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262665728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270114.503140:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262666240:0@lo:400:kworker.0 00000100:00100000:0.0:1788270114.503386:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00010000:1.0:1788270115.269117:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270115.701538:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270115.702002:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253258880 00000100:00100000:3.0:1788270115.702012:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253258880 00000100:00080000:1.0:1788270115.702199:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270115.702460:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 390 00000100:00100000:2.0:1788270115.702472:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38833:x1875136253258880:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788270115.702588:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38833:x1875136253258880:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 118us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270115.702596:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 390 00000100:00100000:3.0:1788270115.706144:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270115.706206:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253259008 00000100:00100000:2.0:1788270115.706215:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253259008 00000100:00100000:2.0:1788270115.706333:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 391 00000100:00100000:2.0:1788270115.706344:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:38833:x1875136253259008:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788270115.706443:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:38833:x1875136253259008:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270115.706450:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 391 00000100:00100000:1.0:1788270115.708719:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270115.709153:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253259264 00000100:00100000:2.0:1788270115.709163:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253259264 00000100:00100000:2.0:1788270115.709275:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:2.0:1788270115.709291:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:38833:x1875136253259264:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270115.709525:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:38833:x1875136253259264:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 240us (812us total) trans 30064771356 rc 0/0 00000100:00100000:2.0:1788270115.709542:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:1.0:1788270115.841425:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270115.841926:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253259392 00000100:00100000:0.0:1788270115.841938:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253259392 00000100:00100000:0.0:1788270115.842012:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 392 00000100:00100000:0.0:1788270115.842022:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:39347:x1875136253259392:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:0.0:1788270115.842070:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270115.842090:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ed3 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270115.842150:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270115.842164:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270115.842176:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270115.842224:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270115.842228:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270115.842246:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270115.842268:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192000/0xc5f5d7a016e0a168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 7 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270115.842286:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 6 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270115.842295:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270115.842298:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270115.842684:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192600, rc 0) 00000100:00100000:0.0:1788270115.842745:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:39347:x1875136253259392:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 723us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270115.842753:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 392 00010000:00010000:0.0:1788270116.292239:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270116.548280:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262666752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270116.548366:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270116.548430:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666752 00000100:00100000:1.0:1788270116.548440:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666752 00000100:00080000:0.0:1788270116.548477:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270116.548507:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788270116.548524:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262666752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270116.548554:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 110091968 pending 8437760 free 3865825280 avail 3634302976 00000100:00100000:1.0:1788270116.549327:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262666752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 804us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270116.549337:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788270116.549523:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262666752:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788270117.061378:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771142 is committed 00000001:00080000:3.0:1788270117.061392:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771141 is committed 00000001:00080000:3.0:1788270117.061410:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771137 is committed 00000100:00100000:3.0:1788270117.061655:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270117.061676:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262666880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270117.061743:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270117.061824:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262666880 00000100:00100000:3.0:1788270117.061833:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262666880 00000100:00100000:3.0:1788270117.061878:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788270117.061887:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262666880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270117.061916:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446141952 avail 1299902464 00000100:00100000:3.0:1788270117.061949:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262666880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270117.061954:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788270117.061988:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262666880:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788270117.063124:0:46509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 25769803851 batchid updated 00000020:00080000:2.0:1788270117.063643:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 25769803851 00000020:00080000:2.0:1788270117.063655:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 25769803851 00010000:00010000:1.0:1788270117.318252:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788270117.335521:0:50258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 09:41:56 (1788270116) 00000001:00080000:0.0:1788270118.086280:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771118 is committed 00000001:00080000:0.0:1788270118.086301:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771116 is committed 00000001:00080000:3.0:1788270118.087288:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771356 is committed 00000004:00080000:3.0:1788270118.087300:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:3.0:1788270118.087335:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c2751dee40 refcount 2 committed 0 result 0 batchid 25769803847 00000020:00080000:3.0:1788270118.087341:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c249095100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c2751de240 00000020:00080000:3.0:1788270118.087355:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c249095700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1427e5e00 00000020:00080000:3.0:1788270118.087379:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803846 batchid updated 00000020:00080000:3.0:1788270118.087393:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803847 committed batchid 25769803846 00000100:00100000:2.0:1788270118.087452:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262667008:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788270118.087459:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803846 00000100:00100000:3.0:1788270118.087485:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262667136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788270118.087523:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270118.087558:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262667008 00000100:00100000:3.0:1788270118.087567:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262667008 00000100:00100000:2.0:1788270118.087607:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270118.089787:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.089803:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.089816:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.089823:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270118.089827:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.089834:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.089851:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:0.0:1788270118.089854:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270118.089858:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.089864:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a10d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270118.091418:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262667136 00000100:00100000:3.0:1788270118.091432:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262667136 00000100:00100000:3.0:1788270118.091538:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788270118.091548:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262667008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788270118.091577:0:48230:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:199 count 1 00002000:00010000:3.0:1788270118.091606:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc7:0x0] initial LVB size: 15728640, mtime: 0x6a96d61f, atime: 0x6a96d61f, ctime: 0x6a96d61f, blocks: 0x7800 00010000:00010000:3.0:1788270118.091613:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.091627:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=909s v=(0 0) 00010000:00010000:3.0:1788270118.091632:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270118.091637:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.091650:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.091658:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.091665:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.091684:0:48230:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788270118.091883:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262667008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 336us (4360us total) trans 30064771119 rc 0/0 00000100:00100000:3.0:1788270118.091891:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788270118.091907:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788270118.091913:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262667136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788270118.091976:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb size from disk: 20971520 -> 29360128 00002000:00010000:3.0:1788270118.091979:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb mtime from disk: 1788270112 -> 1788270113 00002000:00010000:3.0:1788270118.091982:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb atime from disk: 1788270111 -> 1788270111 00002000:00010000:3.0:1788270118.091984:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb ctime from disk: 1788270112 -> 1788270113 00002000:00010000:3.0:1788270118.091986:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc8:0x0] updating lvb blocks from disk: 40960 -> 57344 00000100:00100000:3.0:1788270118.092016:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262667136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (4411us total) trans 30064771120 rc 0/0 00000100:00100000:3.0:1788270118.092023:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:0.0:1788270118.095574:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270118.095588:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.095602:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270118.095607:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.095618:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.095638:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.095650:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6544d28/0xc5f5d7a016e0a176 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.095675:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270118.095677:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270118.095679:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788270118.095743:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270118.095863:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771116 gen 2 00000004:00080000:3.0:1788270118.095869:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771116 committed transno 30064771116 00000100:00100000:3.0:1788270118.095891:0:3610:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c27fb72a00 x1875136262667008/t30064771119(30064771119) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788270134 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788270118.095902:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27fb72a00/2, rc 0, transno 30064771119 00000100:00100000:3.0:1788270118.095908:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262667008:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788270118.095945:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27fb70a80/2, rc 0, transno 30064771120 00000100:00100000:3.0:1788270118.095950:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262667136:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788270118.340212:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270118.385098:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.385186:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253259648 00000100:00100000:2.0:1788270118.385196:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253259648 00000100:00100000:2.0:1788270118.385282:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 393 00000100:00100000:2.0:1788270118.385292:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:39632:x1875136253259648:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270118.385315:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270118.385347:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a17d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101eda expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385485:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385499:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385511:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385526:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385534:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385540:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385630:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a192 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385640:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a192 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385645:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a192 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270118.385654:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788270118.385729:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385737:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385743:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385750:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385755:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270118.385759:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385766:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385778:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:2.0:1788270118.385782:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270118.385787:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385792:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a184 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385803:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385806:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385810:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385813:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270118.385814:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385818:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385821:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429feb00) 00010000:00010000:2.0:1788270118.385823:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270118.385824:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.385827:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a18b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788270118.386125:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788270118.386449:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a17d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eda expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.386466:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a192 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eda expref: 27 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.386474:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270118.386476:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270118.386479:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ee00, rc 0) 00000100:00100000:2.0:1788270118.386551:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:39632:x1875136253259648:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1260us (1461us total) trans 30064771357 rc 0/0 00000100:00100000:2.0:1788270118.386558:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 393 00000100:00100000:1.0:1788270118.391948:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.392065:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253259776 00000100:00100000:2.0:1788270118.392075:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253259776 00000100:00100000:2.0:1788270118.392139:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 394 00000100:00100000:2.0:1788270118.392150:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:39632:x1875136253259776:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788270118.392281:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:39632:x1875136253259776:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 133us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270118.392289:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 394 00000100:00100000:3.0:1788270118.394642:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.395094:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253259904 00000100:00100000:2.0:1788270118.395104:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253259904 00000100:00100000:2.0:1788270118.395175:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788270118.395191:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2402:x1875136253259904:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270118.395207:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270118.395234:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a192 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eda expref: 27 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270118.395244:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:2.0:1788270118.395278:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270118.395283:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270118.395348:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:2402:x1875136253259904:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 159us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270118.395356:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788270118.395481:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260032 00000100:00100000:3.0:1788270118.395485:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260032 00000100:00100000:3.0:1788270118.395569:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 395 00000100:00100000:3.0:1788270118.395577:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:39632:x1875136253260032:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270118.395636:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:39632:x1875136253260032:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 60us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.395641:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 395 00000100:00080000:2.0:1788270118.396289:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270118.497481:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270118.497539:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270118.497621:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260160 00000100:00100000:0.0:1788270118.497632:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260160 00000100:00100000:0.0:1788270118.497690:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260416 00000100:00100000:0.0:1788270118.497694:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260416 00000100:00100000:0.0:1788270118.497721:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 396 00000100:00100000:0.0:1788270118.497731:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253260160:12345-192.168.201.42@tcp:41:mkdir.0 00000004:00000024:0.0:1788270118.497778:0:45776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788270118.497912:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253260160:12345-192.168.201.42@tcp:41:mkdir.0 Request processed in 182us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.497918:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 396 00000100:00100000:0.0:1788270118.497939:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 397 00000100:00100000:0.0:1788270118.497946:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:39647:x1875136253260416:12345-192.168.201.42@tcp:36:mkdir.0 00000100:00100000:0.0:1788270118.498070:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262667264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.498113:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.498157:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c272618900 going to sleep for 11 seconds 00000100:00100000:0.0:1788270118.498176:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262667264 00000100:00100000:0.0:1788270118.498180:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262667264 00000100:00100000:0.0:1788270118.498208:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788270118.498215:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262667264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.498288:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262667264:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.498295:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788270118.498423:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262667264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.498463:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262667392:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.498767:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.498794:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c272618900 going to sleep for 11 seconds 00000100:00100000:2.0:1788270118.498817:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262667392 00000100:00100000:2.0:1788270118.498824:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262667392 00000100:00100000:2.0:1788270118.500033:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788270118.500071:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262667392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270118.500192:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262667392:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (1425us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270118.500200:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788270118.501386:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262667392:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788270118.501446:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.501454:0:45776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.501462:0:45776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270118.501484:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262667520:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788270118.501524:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.501563:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2726183c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.501592:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262667520 00000100:00100000:3.0:1788270118.501600:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262667520 00000100:00100000:3.0:1788270118.501647:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788270118.501656:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:45776:x1875136262667520:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788270118.501667:0:46517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270118.501685:0:46517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0a1a0 expref: -99 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.501711:0:46517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 25 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.501722:0:46517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.501730:0:46517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 7 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.501753:0:46517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.501766:0:46517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 5 pid: 45777 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270118.501783:0:46517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:46517:1875136262667648:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270118.501855:0:46517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 25 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.501866:0:46517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 25 pid: 46770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270118.501876:0:46517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:46517:1875136262667776:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270118.501913:0:46517:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246f3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.506692:0:46517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:46517:1875136262667648:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270118.506708:0:46517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:46517:1875136262667776:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270118.506742:0:46517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 7 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.506754:0:46517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270118.506758:0:46517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270118.506762:0:46517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 7 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.506772:0:46517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfa00, rc 0) 00000100:00100000:3.0:1788270118.506831:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:45776:x1875136262667520:12345-0@lo:101:mdt00_000.0 Request processed in 5175us (5306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.506839:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788270118.506885:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262667520:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788270118.506903:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.506915:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270118.510330:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270118.510378:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270118.510510:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260544 00000100:00100000:3.0:1788270118.510519:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260544 00010000:00010000:3.0:1788270118.510626:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 6 pid: 45777 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270118.510666:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260672 00000100:00100000:3.0:1788270118.510676:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260672 00010000:00010000:3.0:1788270118.510691:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 26 pid: 46770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270118.510716:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:3.0:1788270118.510727:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253260544:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270118.510754:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270118.510761:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 6 pid: 45777 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510774:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 6 pid: 45777 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510794:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c144192600/0xc5f5d7a016e0a16f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ed3 expref: 6 pid: 45777 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510812:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270118.510820:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510829:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270118.510879:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253260544:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 155us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.510889:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:3.0:1788270118.510906:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:3.0:1788270118.510912:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:2400:x1875136253260672:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270118.510921:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270118.510926:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 26 pid: 46770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510936:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 26 pid: 46770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510949:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26bf9f200/0xc5f5d7a016e09eac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101df3 expref: 26 pid: 46770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510973:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270118.510978:0:45763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510988:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.510998:0:45763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511030:0:45763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 6 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270118.511091:0:45763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:45763:1875136262667904:0@lo:105: 00000100:00100000:3.0:1788270118.511129:0:45763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270118.511164:0:45763:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246f3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.511182:0:45759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262667904 00000100:00100000:3.0:1788270118.511186:0:45759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262667904 00000100:00100000:3.0:1788270118.511212:0:45759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788270118.511219:0:45759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:45763:x1875136262667904:12345-0@lo:105: 00010000:00010000:3.0:1788270118.511229:0:45759:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511238:0:45759:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511246:0:45759:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511267:0:45759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511275:0:45759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511283:0:45759:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.511302:0:45759:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98c144192000) 00000100:00100000:3.0:1788270118.511336:0:45759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:45763:x1875136262667904:12345-0@lo:105: Request processed in 118us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.511342:0:45759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788270118.511445:0:45763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:45763:1875136262667904:0@lo:105: 00010000:00010000:3.0:1788270118.511460:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270118.511483:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2400:x1875136253260672:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 571us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.511490:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00010000:00010000:0.0:1788270118.511827:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.511837:0:45776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270118.511859:0:45776:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788270118.511891:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.511899:0:45776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.511908:0:45776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270118.511920:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668032:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788270118.511942:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.511968:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2726183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270118.511990:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668032 00000100:00100000:1.0:1788270118.511995:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668032 00000100:00100000:1.0:1788270118.512030:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788270118.512056:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:45776:x1875136262668032:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788270118.512071:0:45782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270118.512086:0:45782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5f5d7a016e0a1ae expref: -99 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.512103:0:45782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1ae expref: 8 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.512114:0:45782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1ae expref: 8 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.512123:0:45782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff98c143876a00) 00010000:00010000:1.0:1788270118.512125:0:45782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270118.512128:0:45782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d200, rc 0) 00000100:00100000:1.0:1788270118.512229:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668032:12345-0@lo:101:mdt00_000.0 Request processed in 191us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270118.512235:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788270118.512599:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668032:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788270118.512613:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.512622:0:45776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270118.512641:0:45776:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788270118.512673:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668160:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.512699:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.512960:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c272618900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270118.513011:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668160 00000100:00100000:1.0:1788270118.513017:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668160 00000100:00100000:1.0:1788270118.513065:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788270118.513072:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513135:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668160:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270118.513141:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788270118.513259:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668160:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513309:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668288:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513334:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270118.513351:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270118.513375:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668288 00000100:00100000:1.0:1788270118.513378:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668288 00000100:00100000:1.0:1788270118.513395:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788270118.513401:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513471:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668288:12345-0@lo:1000:mdt00_000.0 Request processed in 69us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788270118.513476:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788270118.513502:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668288:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513579:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668416:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513604:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270118.513625:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb68180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.513714:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668416 00000100:00100000:3.0:1788270118.513719:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668416 00000100:00100000:3.0:1788270118.513748:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788270118.513756:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270118.513813:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668416:12345-0@lo:1000:mdt00_000.0 Request processed in 58us (208us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788270118.513820:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788270118.513828:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668416:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513885:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668544:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.513915:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270118.513935:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788270118.514034:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668544 00000100:00100000:0.0:1788270118.514049:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668544 00000100:00100000:0.0:1788270118.514118:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788270118.514125:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.514184:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668544:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.514191:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788270118.514327:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270118.514426:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668544:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.514458:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668672:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270118.514475:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270118.514493:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb68180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.514506:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668672 00000100:00100000:3.0:1788270118.514510:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668672 00000100:00100000:0.0:1788270118.514536:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788270118.514547:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788270118.514599:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668672:12345-0@lo:1000:mdt00_000.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.514605:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788270118.514764:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668672:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270118.514798:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668800:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270118.514817:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270118.514833:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27524d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.514871:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262668800 00000100:00100000:3.0:1788270118.514875:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262668800 00000100:00100000:3.0:1788270118.514904:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788270118.514912:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270118.514988:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:45776:x1875136262668800:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.514992:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788270118.515024:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:45776:1875136262668800:0@lo:1000:mdt00_000.0 00000040:00080000:2.0:1788270118.515647:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400032e1:0x1:0x0].2, 992 off34752 00000040:00080000:2.0:1788270118.515851:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e2:0x1:0x0].2, 1144 off35056 00000004:00080000:2.0:1788270118.515858:0:45776:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c27524d540 with version 9 00000004:00080000:0.0:1788270118.515942:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 9 rpc_version 9 00000020:00100000:0.0:1788270118.515965:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788270118.515972:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c25ef77100 x1875136262669056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788270118.515989:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262669056:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788270118.516027:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.516134:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2726180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270118.516396:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669056 00000100:00100000:1.0:1788270118.516402:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669056 00000100:00100000:1.0:1788270118.516445:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788270118.516454:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24676b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:46515:x1875136262669056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788270118.516775:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24676b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:46515:x1875136262669056:12345-0@lo:1000:osp_up0-1.0 Request processed in 321us (746us total) trans 30064771358 rc 0/0 00000100:00100000:1.0:1788270118.516782:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788270118.516853:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262669056:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788270118.516978:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.516998:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517008:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270118.517027:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006666ffba reply state 00000000ac82186a transno 30064771118 ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517066:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517075:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:2.0:1788270118.517078:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270118.517082:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788270118.517087:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x6:0x0]: returning size 4096 00000004:00080000:2.0:1788270118.517096:0:45776:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788270118.517104:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517112:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517120:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517135:0:45776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788270118.517139:0:45776:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788270118.517144:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.517155:0:45776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270118.517285:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:39647:x1875136253260416:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 19338us (19743us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1788270118.517293:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 397 00010000:00010000:1.0:1788270118.517549:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270118.517556:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.517564:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:1.0:1788270118.517570:0:45765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270118.517579:0:45765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.517604:0:45765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.517611:0:45765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788270118.517664:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788270118.517683:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.517690:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144192000/0xc5f5d7a016e0a1a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc5f5d7a016e0a1a7 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.517704:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270118.517705:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270118.517707:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270118.517741:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262669184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788270118.517774:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270118.517907:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669184 00000100:00100000:1.0:1788270118.517913:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669184 00000100:00100000:1.0:1788270118.518008:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788270118.518017:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3607:x1875136262669184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788270118.518027:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270118.518076:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a1a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1a0 expref: 9 pid: 46517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.518090:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270118.518093:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270118.518124:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3607:x1875136262669184:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270118.518130:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788270118.518195:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262669184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270118.525201:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270118.525246:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260800 00000100:00100000:1.0:1788270118.525267:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260800 00000100:00100000:1.0:1788270118.525376:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 398 00000100:00100000:1.0:1788270118.525387:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:39648:x1875136253260800:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270118.525407:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270118.525439:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a1c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ee1 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.525501:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0a1ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.525515:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.525526:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270118.525561:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270118.525563:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270118.525578:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.525597:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a1c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ee1 expref: 27 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.525615:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ee1 expref: 26 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.525624:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270118.525627:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270118.525631:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5ce00, rc 0) 00000100:00100000:1.0:1788270118.525694:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39648:x1875136253260800:12345-192.168.201.42@tcp:101:dd.0 Request processed in 308us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270118.525702:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 398 00000100:00100000:3.0:1788270118.527729:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.527781:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253260928 00000100:00100000:2.0:1788270118.527788:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253260928 00000100:00100000:2.0:1788270118.527868:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 399 00000100:00100000:2.0:1788270118.527878:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39648:x1875136253260928:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270118.527893:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270118.527908:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a1d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ee8 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.527963:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.527973:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.527980:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.527987:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.527994:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc5f5d7a016e0a1ae expref: 7 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.528003:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.528026:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc5f5d7a016e0a1ae expref: 7 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270118.528036:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262669312:0@lo:104: 00000100:00100000:2.0:1788270118.528093:0:48110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270118.528136:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2452150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.528242:0:45760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669312 00000100:00100000:3.0:1788270118.528247:0:45760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669312 00000100:00100000:3.0:1788270118.528332:0:45760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788270118.528341:0:45760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:48110:x1875136262669312:12345-0@lo:104: 00010000:00010000:3.0:1788270118.528353:0:45760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.528408:0:45760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788270118.528414:0:45760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:48110:x1875136262669312:12345-0@lo:104: Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.528432:0:45760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788270118.528559:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270118.528567:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.528575:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144193400 already unused, calling callback (ffffffffc1ab8ee0) 00010000:00010000:0.0:1788270118.528580:0:47309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270118.528589:0:47309:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.528615:0:47309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.528623:0:47309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788270118.528654:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.528661:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98c144193400/0xc5f5d7a016e0a1ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc5f5d7a016e0a1b5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.528681:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270118.528683:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270118.528684:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270118.528710:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262669312:0@lo:104: 00010000:00010000:0.0:1788270118.528727:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270118.528781:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262669440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788270118.528814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270118.528920:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669440 00000100:00100000:0.0:1788270118.528924:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669440 00010000:00010000:0.0:1788270118.528943:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc5f5d7a016e0a1ae expref: 8 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270118.528971:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788270118.528978:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3609:x1875136262669440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788270118.528988:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1788270118.543004:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771358 is committed 00000001:00080000:2.0:1788270118.543015:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771357 is committed 00000020:00080000:2.0:1788270118.543021:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803847 batchid updated 00000020:00080000:3.0:1788270118.543078:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803847 00000020:00080000:3.0:1788270118.543091:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803847 00010000:00010000:0.0:1788270118.543285:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a1b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc5f5d7a016e0a1ae expref: 7 pid: 45782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.543309:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff98c143876a00) 00010000:00010000:0.0:1788270118.543315:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.543326:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.543334:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.543398:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270118.543500:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262669440:12345-0@lo:103:ldlm_bl.0 Request processed in 14521us (14684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.543508:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:2.0:1788270118.543549:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.543555:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270118.543670:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262669568:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788270118.543712:0:48110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270118.543744:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270118.543801:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669568 00000100:00100000:3.0:1788270118.543808:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669568 00000100:00100000:3.0:1788270118.543896:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788270118.543906:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262669568:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788270118.543987:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:48110:x1875136262669568:12345-0@lo:1000:mdt00_004.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270118.543994:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788270118.544070:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:48110:1875136262669568:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788270118.544115:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a1e6 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544126:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a1e6 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544133:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a1e6 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270118.544154:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a1e6 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544165:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544171:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544178:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544184:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270118.544189:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544196:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544206:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270118.544209:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270118.544213:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544219:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a1d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544229:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544235:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544240:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544244:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270118.544247:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544263:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544271:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff98c143876a00) 00010000:00010000:0.0:1788270118.544274:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270118.544277:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544283:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a1df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544321:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a1d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ee8 expref: 27 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544335:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c144193400/0xc5f5d7a016e0a1e6 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ee8 expref: 26 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.544347:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429f2400) 00010000:00010000:0.0:1788270118.544349:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270118.544352:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144193400, rc 0) 00000100:00100000:0.0:1788270118.544399:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39648:x1875136253260928:12345-192.168.201.42@tcp:101:dd.0 Request processed in 16523us (16674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.544407:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 399 00000100:00100000:1.0:1788270118.544486:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262669440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788270118.546478:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.546533:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253261056 00000100:00100000:2.0:1788270118.546542:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253261056 00000100:00100000:2.0:1788270118.546633:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 400 00000100:00100000:2.0:1788270118.546644:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:39648:x1875136253261056:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270118.546665:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270118.546685:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a1ed lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101eef expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.546742:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a1f4 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.546752:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a1f4 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.546759:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a1f4 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270118.546809:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1788270118.546814:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788270118.546846:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a1ed lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eef expref: 16 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.546859:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e800/0xc5f5d7a016e0a1f4 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101eef expref: 15 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.546865:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:2.0:1788270118.546867:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788270118.546869:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418e800, rc 0) 00000100:00100000:2.0:1788270118.546916:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:39648:x1875136253261056:12345-192.168.201.42@tcp:101:dd.0 Request processed in 275us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270118.546922:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 400 00000100:00100000:3.0:1788270118.549383:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270118.549553:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253261312 00000100:00100000:1.0:1788270118.549562:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253261312 00000100:00100000:1.0:1788270118.549712:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 401 00000100:00100000:1.0:1788270118.549724:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:39648:x1875136253261312:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270118.549743:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270118.549761:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a1fb lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ef6 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.549859:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 3/0,1 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.549872:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.549882:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.549896:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.549903:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270118.549909:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270118.550091:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262669696:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788270118.550143:0:46770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270118.550166:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24dcc8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788270118.550277:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669696 00000100:00100000:2.0:1788270118.550283:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669696 00000100:00100000:2.0:1788270118.550320:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788270118.550328:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46770:x1875136262669696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788270118.550423:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46770:x1875136262669696:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270118.550430:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788270118.550499:0:46770:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771358 gen 2 00000004:00080000:3.0:1788270118.550505:0:46770:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771358 committed transno 30064771358 00000100:00100000:3.0:1788270118.550527:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:46770:1875136262669696:0@lo:1000:mdt00_003.0 00000004:00080000:3.0:1788270118.550794:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc3:0x0], index 0: 0 00010000:00010000:3.0:1788270118.550934:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a210 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.550946:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a210 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.550954:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a210 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.550988:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 4/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.550996:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 4/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551002:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551008:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551015:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270118.551019:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551027:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 5/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551068:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:3.0:1788270118.551072:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270118.551076:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 3/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551082:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a202 lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270118.551097:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018eefb61 reply state 0000000001042b35 transno 30064771119 ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551109:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551115:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x852f64c2 (ffff98c143876600) 00010000:00010000:3.0:1788270118.551117:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270118.551120:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270118.551150:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a1fb lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ef6 expref: 18 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551165:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a210 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ef6 expref: 17 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.551171:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:3.0:1788270118.551173:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270118.551175:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bee00, rc 0) 00000100:00100000:3.0:1788270118.551227:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:39648:x1875136253261312:12345-192.168.201.42@tcp:101:dd.0 Request processed in 1505us (1853us total) trans 30064771119 rc 0/0 00000100:00100000:3.0:1788270118.551235:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 401 00000100:00100000:3.0:1788270118.558007:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270118.558198:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253261440 00000100:00100000:0.0:1788270118.558209:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253261440 00000100:00080000:2.0:1788270118.558326:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270118.558384:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:0.0:1788270118.558396:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+7:39648:x1875136253261440:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270118.558414:0:47283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270118.558436:0:47283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0a21e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101efd expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270118.558461:0:47283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270118.558483:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=910s v=(0 0) 00010000:00010000:0.0:1788270118.558487:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270118.558496:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0a21e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101efd expref: 8 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.558511:0:47283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028735e95/0xc5f5d7a016e0a21e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101efd expref: 8 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270118.558523:0:47283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192400, rc 0) 00000100:00100000:0.0:1788270118.558581:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:39648:x1875136253261440:12345-192.168.201.42@tcp:101:dd.0 Request processed in 188us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270118.558589:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000040:00080000:0.0:1788270118.596374:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270118.596382:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270118.596400:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:0.0:1788270118.596407:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788270118.623728:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270118.623917:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253261568 00000100:00100000:0.0:1788270118.623930:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253261568 00002000:00100000:0.0:1788270118.624003:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (0->4194303) req@ffff98c27fb71f80 x1875136253261568/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/0 e 0 to 0 dl 1788270129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270118.624016:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb71f80 with x1875136253261568 ext(0->4194303) 00002000:00010000:0.0:1788270118.624022:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fb71f80 00000100:00100000:0.0:1788270118.624133:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:0.0:1788270118.624146:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253261568:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270118.668878:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253261568:12345-192.168.201.42@tcp:4:dd.0 Request processed in 44724us (45151us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1788270118.668892:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00002000:00100000:1.0:1788270118.668904:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (0->4194303) req@ffff98c27fb71f80 x1875136253261568/t30064771121(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/448 e 0 to 0 dl 1788270129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270118.668922:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb71f80 with x1875136253261568 ext(0->4194303) 00002000:00010000:1.0:1788270118.668929:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fb71f80 00000100:00100000:2.0:1788270118.699374:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270118.700007:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253261696 00000100:00100000:0.0:1788270118.700020:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253261696 00002000:00100000:0.0:1788270118.700148:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (4194304->8388607) req@ffff98c27fb71880 x1875136253261696/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/0 e 0 to 0 dl 1788270129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270118.700162:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb71880 with x1875136253261696 ext(4194304->8388607) 00002000:00010000:0.0:1788270118.700169:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fb71880 00000100:00100000:0.0:1788270118.700210:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:0.0:1788270118.700222:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253261696:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270118.739184:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2403:x1875136253261696:12345-192.168.201.42@tcp:4:dd.0 Request processed in 38953us (39810us total) trans 30064771122 rc 0/0 00000100:00100000:1.0:1788270118.739198:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00002000:00100000:1.0:1788270118.739212:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (4194304->8388607) req@ffff98c27fb71880 x1875136253261696/t30064771122(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/448 e 0 to 0 dl 1788270129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270118.739292:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb71880 with x1875136253261696 ext(4194304->8388607) 00002000:00010000:1.0:1788270118.739300:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fb71880 00000100:00100000:2.0:1788270118.763851:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270118.763926:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253261824 00000100:00100000:1.0:1788270118.763937:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253261824 00002000:00100000:1.0:1788270118.763994:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (8388608->12582911) req@ffff98c27fb72680 x1875136253261824/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/0 e 0 to 0 dl 1788270129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270118.764005:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb72680 with x1875136253261824 ext(8388608->12582911) 00002000:00010000:1.0:1788270118.764011:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fb72680 00000100:00100000:1.0:1788270118.764077:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:1.0:1788270118.764088:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253261824:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270118.797998:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253261824:12345-192.168.201.42@tcp:4:dd.0 Request processed in 33901us (34149us total) trans 30064771123 rc 0/0 00000100:00100000:1.0:1788270118.798013:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00002000:00100000:1.0:1788270118.798026:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (8388608->12582911) req@ffff98c27fb72680 x1875136253261824/t30064771123(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/448 e 0 to 0 dl 1788270129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270118.798064:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb72680 with x1875136253261824 ext(8388608->12582911) 00002000:00010000:1.0:1788270118.798072:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fb72680 00000100:00100000:0.0:1788270118.802601:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270118.802725:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253262080 00000100:00100000:1.0:1788270118.802735:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253262080 00000100:00100000:1.0:1788270118.802826:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:1.0:1788270118.802835:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:39648:x1875136253262080:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:1.0:1788270118.803144:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:39648:x1875136253262080:12345-192.168.201.42@tcp:35:dd.0 Request processed in 310us (555us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1788270118.803149:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:0.0:1788270118.816324:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.816460:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253262336 00000100:00100000:2.0:1788270118.816468:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253262336 00000100:00100000:2.0:1788270118.816519:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 402 00000100:00100000:2.0:1788270118.816526:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:39649:x1875136253262336:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270118.816548:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270118.816565:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a225 lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f04 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.816657:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 3/0,1 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.816668:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.816676:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.816685:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.816689:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.816693:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270118.816953:0:48110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc4:0x0], index 1: 0 00010000:00010000:2.0:1788270118.817090:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a23a lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817097:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a23a lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817102:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a23a lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817124:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 3/0,1 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817129:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 2/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817133:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817136:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270118.817139:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 3/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817144:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 4/0,0 mode: CW/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817152:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:2.0:1788270118.817154:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270118.817157:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 2/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817164:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a22c lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270118.817173:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ad0f7d reply state 00000000b42c3631 transno 30064771121 ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817180:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817184:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0xdee864c2 (ffff98c24a952800) 00010000:00010000:2.0:1788270118.817186:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270118.817188:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270118.817214:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a225 lrc: 0/0,0 mode: --/CW res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f04 expref: 22 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817241:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a23a lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f04 expref: 21 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270118.817257:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:2.0:1788270118.817259:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270118.817262:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270118.817320:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:39649:x1875136253262336:12345-192.168.201.42@tcp:101:dd.0 Request processed in 792us (1003us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1788270118.817328:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 402 00000100:00100000:2.0:1788270118.822679:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270118.822828:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253262464 00000100:00100000:3.0:1788270118.822838:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253262464 00000100:00080000:2.0:1788270118.822886:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270118.822966:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:3.0:1788270118.822976:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:39649:x1875136253262464:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270118.822996:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270118.823018:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001931efbc/0xc5f5d7a016e0a248 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f0b expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270118.823074:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270118.823098:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc4:0x0].0x0 since=910s v=(0 0) 00010000:00010000:3.0:1788270118.823102:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270118.823111:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001931efbc/0xc5f5d7a016e0a248 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f0b expref: 11 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.823131:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001931efbc/0xc5f5d7a016e0a248 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f0b expref: 11 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270118.823145:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bec00, rc 0) 00000100:00100000:1.0:1788270118.823409:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:39649:x1875136253262464:12345-192.168.201.42@tcp:101:dd.0 Request processed in 272us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270118.823416:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:0.0:1788270118.882193:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270118.882310:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253262592 00000100:00100000:2.0:1788270118.882321:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253262592 00002000:00100000:2.0:1788270118.882372:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc4:0x0] (0->4194303) req@ffff98c25ef75f80 x1875136253262592/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/0 e 0 to 0 dl 1788270129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270118.882383:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef75f80 with x1875136253262592 ext(0->4194303) 00002000:00010000:2.0:1788270118.882389:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c25ef75f80 00000100:00100000:2.0:1788270118.882426:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:2.0:1788270118.882436:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253262592:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270118.928635:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253262592:12345-192.168.201.42@tcp:4:dd.0 Request processed in 46188us (46440us total) trans 30064771143 rc 0/0 00000100:00100000:1.0:1788270118.928650:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00002000:00100000:1.0:1788270118.928665:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc4:0x0] (0->4194303) req@ffff98c25ef75f80 x1875136253262592/t30064771143(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/448 e 0 to 0 dl 1788270129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270118.928677:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef75f80 with x1875136253262592 ext(0->4194303) 00002000:00010000:1.0:1788270118.928684:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c25ef75f80 00000100:00100000:2.0:1788270118.942993:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270118.943988:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253262720 00000100:00100000:0.0:1788270118.943999:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253262720 00002000:00100000:0.0:1788270118.944064:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc4:0x0] (4194304->8388607) req@ffff98c27fb73480 x1875136253262720/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/0 e 0 to 0 dl 1788270129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270118.944072:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73480 with x1875136253262720 ext(4194304->8388607) 00002000:00010000:0.0:1788270118.944078:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb73480 00000100:00100000:0.0:1788270118.944106:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:0.0:1788270118.944116:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253262720:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270118.979122:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253262720:12345-192.168.201.42@tcp:4:dd.0 Request processed in 34995us (36128us total) trans 30064771144 rc 0/0 00000100:00100000:0.0:1788270118.979139:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00002000:00100000:0.0:1788270118.979153:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc4:0x0] (4194304->8388607) req@ffff98c27fb73480 x1875136253262720/t30064771144(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/448 e 0 to 0 dl 1788270129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270118.979165:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73480 with x1875136253262720 ext(4194304->8388607) 00002000:00010000:0.0:1788270118.979172:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb73480 00000100:00100000:2.0:1788270118.989668:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270118.989883:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253262848 00000100:00100000:1.0:1788270118.989903:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253262848 00002000:00100000:1.0:1788270118.990093:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc4:0x0] (8388608->12582911) req@ffff98c27fb73100 x1875136253262848/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/0 e 0 to 0 dl 1788270129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270118.990105:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73100 with x1875136253262848 ext(8388608->12582911) 00002000:00010000:1.0:1788270118.990112:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb73100 00000100:00100000:1.0:1788270118.990149:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:1.0:1788270118.990159:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253262848:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270119.037341:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253262848:12345-192.168.201.42@tcp:4:dd.0 Request processed in 47173us (47674us total) trans 30064771145 rc 0/0 00000100:00100000:2.0:1788270119.037356:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00002000:00100000:2.0:1788270119.037370:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc4:0x0] (8388608->12582911) req@ffff98c27fb73100 x1875136253262848/t30064771145(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:534/0 lens 488/448 e 0 to 0 dl 1788270129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270119.037382:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73100 with x1875136253262848 ext(8388608->12582911) 00002000:00010000:2.0:1788270119.037389:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb73100 00000040:00080000:2.0:1788270119.044302:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270119.044313:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270119.044341:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 9 count 9 00000040:00080000:2.0:1788270119.044354:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270119.046150:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.046264:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253263104 00000100:00100000:2.0:1788270119.046278:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253263104 00000100:00100000:2.0:1788270119.046383:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:2.0:1788270119.046395:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:39649:x1875136253263104:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:2.0:1788270119.046671:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:39649:x1875136253263104:12345-192.168.201.42@tcp:35:dd.0 Request processed in 278us (531us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1788270119.046681:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:0.0:1788270119.059488:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.059557:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253263232 00000100:00100000:2.0:1788270119.059568:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253263232 00000100:00100000:2.0:1788270119.059630:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 403 00000100:00100000:2.0:1788270119.059643:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:39650:x1875136253263232:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:2.0:1788270119.059669:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270119.059693:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a24f lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f12 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.059731:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a256 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.059745:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a256 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.059757:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a256 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.060076:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0a24f lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f12 expref: 25 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.060102:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e600/0xc5f5d7a016e0a256 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f12 expref: 24 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.060111:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:2.0:1788270119.060114:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270119.060118:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418e600, rc 0) 00000100:00100000:2.0:1788270119.060230:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:39650:x1875136253263232:12345-192.168.201.42@tcp:101:chown.0 Request processed in 590us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270119.060238:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 403 00000100:00100000:0.0:1788270119.062448:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.063326:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253263488 00000100:00100000:3.0:1788270119.063337:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253263488 00000100:00100000:3.0:1788270119.063433:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 404 00000100:00100000:3.0:1788270119.063448:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:39650:x1875136253263488:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:3.0:1788270119.063501:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270119.063541:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a210 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ef6 expref: 24 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.063561:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:3.0:1788270119.063566:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270119.063593:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.063607:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.063620:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270119.063831:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].3, 88 off8432 00000004:00080000:3.0:1788270119.063853:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 910770813069ns, next at 911770810515ns, rc = 0 00000004:00010000:3.0:1788270119.063899:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc17412c reply state 000000003fecd889 transno 30064771123 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.063911:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.063918:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:3.0:1788270119.063920:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788270119.063923:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270119.064021:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:39650:x1875136253263488:12345-192.168.201.42@tcp:36:chown.0 Request processed in 579us (1580us total) trans 30064771123 rc 0/0 00000100:00100000:3.0:1788270119.064029:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 404 00000100:00100000:1.0:1788270119.066595:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.066753:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253263616 00000100:00100000:2.0:1788270119.066763:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253263616 00000100:00100000:2.0:1788270119.066913:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 405 00000100:00100000:2.0:1788270119.066922:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:39650:x1875136253263616:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:2.0:1788270119.066944:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270119.066959:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a264 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f19 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.067006:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a264 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f19 expref: 26 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.067016:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a264 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f19 expref: 26 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.067029:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:2.0:1788270119.067031:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270119.067034:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f400, rc 0) 00000100:00100000:2.0:1788270119.067115:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39650:x1875136253263616:12345-192.168.201.42@tcp:101:chown.0 Request processed in 195us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270119.067120:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 405 00000100:00100000:2.0:1788270119.070633:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.070806:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253263744 00000100:00100000:1.0:1788270119.070814:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253263744 00000100:00100000:1.0:1788270119.070904:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788270119.070912:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2403:x1875136253263744:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:1.0:1788270119.071026:0:47281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:1.0:1788270119.071029:0:47281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788270118 00002000:00010000:1.0:1788270119.071031:0:47281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270119.071032:0:47281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 0 -> 1788270119 00002000:00010000:1.0:1788270119.071034:0:47281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:1.0:1788270119.071105:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2403:x1875136253263744:12345-192.168.201.42@tcp:2:chown.0 Request processed in 194us (480us total) trans 30064771124 rc 0/0 00000100:00100000:1.0:1788270119.071110:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788270119.091843:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.091933:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253263872 00000100:00100000:2.0:1788270119.091944:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253263872 00000100:00100000:2.0:1788270119.092011:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 406 00000100:00100000:2.0:1788270119.092021:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39651:x1875136253263872:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:2.0:1788270119.092082:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270119.092104:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a26b lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f20 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.092142:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ea00/0xc5f5d7a016e0a272 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.092156:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ea00/0xc5f5d7a016e0a272 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.092167:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ea00/0xc5f5d7a016e0a272 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.092299:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a26b lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f20 expref: 28 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.092319:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ea00/0xc5f5d7a016e0a272 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f20 expref: 27 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.092328:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:2.0:1788270119.092331:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270119.092335:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ea00, rc 0) 00000100:00100000:2.0:1788270119.092402:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:39651:x1875136253263872:12345-192.168.201.42@tcp:101:chown.0 Request processed in 382us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270119.092410:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 406 00000100:00100000:2.0:1788270119.094566:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.094782:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253264128 00000100:00100000:3.0:1788270119.094791:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253264128 00000100:00100000:3.0:1788270119.094882:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 407 00000100:00100000:3.0:1788270119.094890:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:39651:x1875136253264128:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:3.0:1788270119.094930:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270119.094951:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a23a lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f04 expref: 27 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.094965:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:3.0:1788270119.094968:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270119.094988:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,1 mode: --/PW res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.094997:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.095004:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270119.095200:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].5, 88 off8584 00000004:00080000:3.0:1788270119.095208:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 910802167768ns, next at 911802166368ns, rc = 0 00000004:00010000:3.0:1788270119.095269:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d56db5c reply state 00000000290af881 transno 30064771124 ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,1 mode: PW/PW res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.095282:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.095289:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:3.0:1788270119.095292:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788270119.095294:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270119.095378:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:39651:x1875136253264128:12345-192.168.201.42@tcp:36:chown.0 Request processed in 488us (816us total) trans 30064771124 rc 0/0 00000100:00100000:3.0:1788270119.095385:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 407 00000100:00100000:2.0:1788270119.097035:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.097178:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253264256 00000100:00100000:3.0:1788270119.097185:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253264256 00000100:00100000:3.0:1788270119.097262:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 408 00000100:00100000:3.0:1788270119.097272:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:39651:x1875136253264256:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:3.0:1788270119.097289:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270119.097304:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a280 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f27 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.097349:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a280 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f27 expref: 29 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.097359:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a280 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f27 expref: 29 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.097370:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:3.0:1788270119.097372:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270119.097375:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfc00, rc 0) 00000100:00100000:3.0:1788270119.097414:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:39651:x1875136253264256:12345-192.168.201.42@tcp:101:chown.0 Request processed in 144us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270119.097429:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 408 00000100:00100000:1.0:1788270119.098726:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.098816:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253264384 00000100:00100000:0.0:1788270119.098822:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253264384 00000100:00100000:0.0:1788270119.098866:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:0.0:1788270119.098875:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2403:x1875136253264384:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:0.0:1788270119.099006:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:0.0:1788270119.099010:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788270119 00002000:00010000:0.0:1788270119.099013:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788270119.099015:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb ctime from disk: 0 -> 1788270119 00002000:00010000:0.0:1788270119.099018:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:0.0:1788270119.099085:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2403:x1875136253264384:12345-192.168.201.42@tcp:2:chown.0 Request processed in 210us (363us total) trans 30064771146 rc 0/0 00000100:00100000:0.0:1788270119.099092:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:1.0:1788270119.108976:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270119.109002:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262669824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270119.109099:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.109167:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669824 00000100:00100000:3.0:1788270119.109177:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669824 00000100:00100000:3.0:1788270119.109292:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788270119.109304:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262669824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270119.109332:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788270119.109384:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262669824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270119.109393:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788270119.109433:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262669824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270119.136879:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.136984:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253264512 00000100:00100000:0.0:1788270119.136994:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253264512 00000100:00100000:0.0:1788270119.137071:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 409 00000100:00100000:0.0:1788270119.137081:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:39657:x1875136253264512:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270119.137099:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270119.137122:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f2e expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.137194:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e0a28e lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.137208:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e0a28e lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.137220:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e0a28e lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270119.137289:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1788270119.137292:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270119.137309:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e0a28e lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.137330:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f2e expref: 31 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.137347:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192200/0xc5f5d7a016e0a28e lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f2e expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.137354:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:0.0:1788270119.137356:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270119.137359:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192200, rc 0) 00000100:00100000:0.0:1788270119.137415:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:39657:x1875136253264512:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 336us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270119.137420:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 409 00000100:00100000:3.0:1788270119.140427:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.140817:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253264640 00000100:00100000:1.0:1788270119.140826:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253264640 00000100:00100000:1.0:1788270119.140888:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 410 00000100:00100000:1.0:1788270119.140899:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:39657:x1875136253264640:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270119.140916:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270119.140935:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a295 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f35 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.140994:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141007:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141018:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141028:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141035:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141084:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141165:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141175:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141182:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270119.141214:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x7:0x0]: returning size 15728640 00000004:00200000:1.0:1788270119.141218:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270119.141236:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141256:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141265:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141272:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141278:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141285:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141291:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.141295:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141302:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141320:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:1.0:1788270119.141323:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.141328:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141334:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a29c lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141348:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141355:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141361:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141366:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.141368:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141374:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141380:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x852f64c2 (ffff98c143876600) 00010000:00010000:1.0:1788270119.141383:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.141386:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141391:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2a3 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141423:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a295 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f35 expref: 32 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141437:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f35 expref: 31 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.141444:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.141446:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270119.141449:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5d400, rc 0) 00000100:00100000:1.0:1788270119.141521:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:39657:x1875136253264640:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 623us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.141527:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 410 00000100:00100000:2.0:1788270119.144818:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.145130:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253264896 00000100:00100000:3.0:1788270119.145140:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253264896 00000100:00100000:3.0:1788270119.145238:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 411 00000100:00100000:3.0:1788270119.145265:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+31:39657:x1875136253264896:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:3.0:1788270119.145292:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270119.145312:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a2b1 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f3c expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.145412:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a2b8 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.145427:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a2b8 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.145437:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a2b8 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270119.145447:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x7:0x0]: returning size 15728640 00010000:00010000:3.0:1788270119.145553:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a2b1 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f3c expref: 34 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.145571:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a2b8 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f3c expref: 33 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.145580:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:3.0:1788270119.145583:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270119.145587:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be800, rc 0) 00000100:00100000:3.0:1788270119.145701:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:39657:x1875136253264896:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 440us (892us total) trans 30064771125 rc 0/0 00000100:00100000:3.0:1788270119.145708:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 411 00000100:00100000:2.0:1788270119.148794:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.148886:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265152 00000100:00100000:1.0:1788270119.148896:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265152 00000100:00100000:1.0:1788270119.148952:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 412 00000100:00100000:1.0:1788270119.148963:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:39657:x1875136253265152:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270119.149395:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270119.149399:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1788270119.149427:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a264 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f19 expref: 33 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149452:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a2b8 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f3c expref: 32 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149465:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a2aa lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f35 expref: 31 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149481:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.149486:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270119.149501:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a2c6 lrc: 2/0,0 mode: --/EX res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f43 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149666:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149680:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149689:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149704:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149710:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149717:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149723:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.149727:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149734:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149745:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.149748:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270119.149751:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149757:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a2cd lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149776:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a2d4 lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149785:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a2d4 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149791:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a2d4 lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149931:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a2d4 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f43 expref: 33 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149939:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.149942:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270119.149950:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a2c6 lrc: 0/0,0 mode: --/EX res: [0x2400032e0:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f43 expref: 33 pid: 45777 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149961:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c800/0xc5f5d7a016e0a2d4 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f43 expref: 32 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.149988:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.149991:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270119.149993:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5c800, rc 0) 00000100:00100000:1.0:1788270119.150152:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:39657:x1875136253265152:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 1190us (1366us total) trans 30064771126 rc 0/0 00000100:00100000:1.0:1788270119.150159:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 412 00000100:00100000:2.0:1788270119.155358:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.155442:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265280 00000100:00100000:1.0:1788270119.155452:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265280 00002000:00100000:1.0:1788270119.155499:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (12582912->15728639) req@ffff98c26bf28a80 x1875136253265280/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270119.155510:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28a80 with x1875136253265280 ext(12582912->15728639) 00002000:00010000:1.0:1788270119.155516:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c26bf28a80 00000100:00100000:1.0:1788270119.155703:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:1.0:1788270119.155713:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253265280:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:3.0:1788270119.184423:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253265280:12345-192.168.201.42@tcp:4:dd.0 Request processed in 28700us (29063us total) trans 30064771125 rc 0/0 00000100:00100000:3.0:1788270119.184443:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00002000:00100000:3.0:1788270119.184456:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (12582912->15728639) req@ffff98c26bf28a80 x1875136253265280/t30064771125(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/448 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270119.184466:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28a80 with x1875136253265280 ext(12582912->15728639) 00002000:00010000:3.0:1788270119.184472:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c26bf28a80 00000100:00100000:2.0:1788270119.208733:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.208792:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265408 00000100:00100000:1.0:1788270119.208803:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265408 00002000:00100000:1.0:1788270119.208854:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->1048575) req@ffff98c26bf28000 x1875136253265408/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270119.208866:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28000 with x1875136253265408 ext(0->1048575) 00002000:00010000:1.0:1788270119.208872:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c26bf28000 00000100:00100000:1.0:1788270119.208967:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:1.0:1788270119.208978:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2403:x1875136253265408:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270119.218992:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2403:x1875136253265408:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 10006us (10258us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788270119.219005:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00002000:00100000:0.0:1788270119.219018:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->1048575) req@ffff98c26bf28000 x1875136253265408/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.219029:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28000 with x1875136253265408 ext(0->1048575) 00002000:00010000:0.0:1788270119.219035:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c26bf28000 00000100:00100000:1.0:1788270119.236061:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.236236:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265536 00000100:00100000:0.0:1788270119.236257:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265536 00002000:00100000:0.0:1788270119.236304:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (1048576->4194303) req@ffff98c14299dc00 x1875136253265536/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.236316:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14299dc00 with x1875136253265536 ext(1048576->4194303) 00002000:00010000:0.0:1788270119.236323:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14299dc00 00000100:00100000:0.0:1788270119.236353:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:0.0:1788270119.236364:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253265536:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270119.266449:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253265536:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 30075us (30409us total) trans 0 rc 3145728/3145728 00000100:00100000:0.0:1788270119.266466:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00002000:00100000:0.0:1788270119.266479:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (1048576->4194303) req@ffff98c14299dc00 x1875136253265536/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.266489:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14299dc00 with x1875136253265536 ext(1048576->4194303) 00002000:00010000:0.0:1788270119.266496:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14299dc00 00000100:00100000:3.0:1788270119.306710:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.306798:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265664 00000100:00100000:2.0:1788270119.306810:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265664 00000100:00100000:3.0:1788270119.306811:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00002000:00100000:2.0:1788270119.306860:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (4194304->8388607) req@ffff98c276266d80 x1875136253265664/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270119.306870:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276266d80 with x1875136253265664 ext(4194304->8388607) 00002000:00010000:2.0:1788270119.306876:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c276266d80 00000100:00100000:3.0:1788270119.306886:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.307073:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265920 00000100:00100000:2.0:1788270119.307079:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265920 00002000:00100000:2.0:1788270119.307097:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (12582912->15728639) req@ffff98c276265500 x1875136253265920/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788270119.307104:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253265792 00002000:00100000:2.0:1788270119.307107:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276265500 with x1875136253265920 ext(12582912->15728639) 00000100:00100000:3.0:1788270119.307110:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253265792 00002000:00010000:2.0:1788270119.307112:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c276265500 00000100:00100000:2.0:1788270119.307130:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00002000:00100000:3.0:1788270119.307137:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (8388608->12582911) req@ffff98c276265c00 x1875136253265792/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788270119.307144:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253265664:12345-192.168.201.42@tcp:3:lfs.0 00002000:00100000:3.0:1788270119.307156:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276265c00 with x1875136253265792 ext(8388608->12582911) 00002000:00010000:3.0:1788270119.307160:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c276265c00 00000100:00100000:3.0:1788270119.307173:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:3.0:1788270119.307181:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253265920:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270119.325602:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253265920:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 18412us (18782us total) trans 0 rc 3145728/3145728 00000100:00100000:0.0:1788270119.325617:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00002000:00100000:0.0:1788270119.325630:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (12582912->15728639) req@ffff98c276265500 x1875136253265920/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.325641:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276265500 with x1875136253265920 ext(12582912->15728639) 00002000:00010000:0.0:1788270119.325647:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c276265500 00000100:00100000:0.0:1788270119.325678:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:0.0:1788270119.325690:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253265792:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270119.349106:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253265664:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 41956us (42395us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1788270119.349119:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00002000:00100000:0.0:1788270119.349145:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (4194304->8388607) req@ffff98c276266d80 x1875136253265664/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.349155:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276266d80 with x1875136253265664 ext(4194304->8388607) 00002000:00010000:0.0:1788270119.349161:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c276266d80 00010000:00010000:0.0:1788270119.364326:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270119.378605:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253265792:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 52907us (71709us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1788270119.378617:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00002000:00100000:0.0:1788270119.378629:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc3:0x0] (8388608->12582911) req@ffff98c276265c00 x1875136253265792/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.378637:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276265c00 with x1875136253265792 ext(8388608->12582911) 00002000:00010000:0.0:1788270119.378643:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c276265c00 00000100:00100000:2.0:1788270119.427408:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.427448:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.427534:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253266048 00000100:00100000:0.0:1788270119.427544:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253266048 00000100:00100000:0.0:1788270119.427604:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 182 00000100:00100000:2.0:1788270119.427706:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.427719:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253266048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270119.427836:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253266048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 223us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270119.427843:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 182 00000100:00100000:2.0:1788270119.431158:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.431765:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253266304 00000100:00100000:1.0:1788270119.431777:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253266304 00000100:00100000:1.0:1788270119.431839:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253266176 00000100:00100000:1.0:1788270119.431843:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253266176 00000100:00100000:1.0:1788270119.431877:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788270119.431887:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253266304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270119.431952:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788270119.431964:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:2402:x1875136253266176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270119.432034:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:2402:x1875136253266176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 72us (4327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270119.432058:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:1.0:1788270119.432106:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253266304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 219us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.432114:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788270119.434394:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253266432 00000100:00100000:1.0:1788270119.434410:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253266432 00000100:00080000:2.0:1788270119.434477:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270119.434501:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788270119.434524:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253266432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270119.434605:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253266432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 94us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.434612:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:3.0:1788270119.449781:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.449847:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253266688 00000100:00100000:1.0:1788270119.449855:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253266688 00000100:00100000:1.0:1788270119.449917:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:1.0:1788270119.449928:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+32:39657:x1875136253266688:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:1.0:1788270119.450193:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:39657:x1875136253266688:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 266us (422us total) trans 30064771127 rc 0/0 00000100:00100000:1.0:1788270119.450198:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:3.0:1788270119.502729:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.502792:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253266816 00000100:00100000:2.0:1788270119.502801:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253266816 00000100:00100000:2.0:1788270119.502896:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 413 00000100:00100000:2.0:1788270119.502907:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:39663:x1875136253266816:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270119.502931:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270119.502953:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04a00/0xc5f5d7a016e0a2db lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f4a expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503016:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503027:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503034:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503069:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503075:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503079:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503147:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503153:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503158:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270119.503183:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x8:0x0]: returning size 15728640 00000004:00200000:2.0:1788270119.503186:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270119.503199:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503207:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503213:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503218:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503221:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503225:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503229:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fc05800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270119.503231:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503249:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503264:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:2.0:1788270119.503267:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270119.503271:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503277:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05800/0xc5f5d7a016e0a2e2 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503290:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503297:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503303:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503308:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fc05000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270119.503311:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503316:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503323:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0xdee864c2 (ffff98c24a952800) 00010000:00010000:2.0:1788270119.503326:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270119.503328:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503334:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc05000/0xc5f5d7a016e0a2e9 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503359:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04a00/0xc5f5d7a016e0a2db lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f4a expref: 35 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503372:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f4a expref: 34 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270119.503380:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:2.0:1788270119.503382:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270119.503385:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14fc04000, rc 0) 00000100:00100000:2.0:1788270119.503440:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:39663:x1875136253266816:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 534us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270119.503446:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 413 00000100:00100000:2.0:1788270119.506450:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.506546:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267072 00000100:00100000:3.0:1788270119.506557:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267072 00000100:00100000:3.0:1788270119.506719:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 414 00000100:00100000:3.0:1788270119.506741:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:39663:x1875136253267072:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:3.0:1788270119.506763:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270119.506781:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a2f7 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f51 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.506880:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40a00/0xc5f5d7a016e0a2fe lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.506893:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40a00/0xc5f5d7a016e0a2fe lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.506903:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40a00/0xc5f5d7a016e0a2fe lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270119.506914:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x8:0x0]: returning size 15728640 00010000:00010000:3.0:1788270119.507013:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a2f7 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f51 expref: 37 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.507030:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40a00/0xc5f5d7a016e0a2fe lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f51 expref: 36 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270119.507062:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:3.0:1788270119.507066:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270119.507070:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14fb40a00, rc 0) 00000100:00100000:3.0:1788270119.507127:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:39663:x1875136253267072:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 399us (686us total) trans 30064771128 rc 0/0 00000100:00100000:3.0:1788270119.507139:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 414 00000100:00100000:3.0:1788270119.509864:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.509936:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267200 00000100:00100000:0.0:1788270119.509946:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267200 00000100:00100000:0.0:1788270119.510000:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788270119.510010:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:2403:x1875136253267200:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270119.510025:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270119.510079:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fb40a00/0xc5f5d7a016e0a2fe lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f51 expref: 36 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.510097:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:0.0:1788270119.510102:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270119.510162:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:2403:x1875136253267200:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 153us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270119.510172:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:1.0:1788270119.511362:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.511397:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267456 00000100:00100000:0.0:1788270119.511403:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267456 00000100:00100000:0.0:1788270119.511444:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 415 00000100:00100000:0.0:1788270119.511452:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:39663:x1875136253267456:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270119.511477:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270119.511480:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1788270119.511496:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a280 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f27 expref: 35 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511510:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14fc04000/0xc5f5d7a016e0a2f0 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f4a expref: 34 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511517:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:0.0:1788270119.511519:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270119.511528:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a30c lrc: 2/0,0 mode: --/EX res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f58 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511558:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511569:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511578:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511591:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511599:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511606:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511612:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c144192000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270119.511616:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511623:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511631:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:0.0:1788270119.511634:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270119.511638:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511644:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a313 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511675:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a31a lrc: 3/0,1 mode: --/EX res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511680:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a31a lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511685:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a31a lrc: 3/0,1 mode: EX/EX res: [0x2400032e0:0x8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511818:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a31a lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f58 expref: 36 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511823:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:0.0:1788270119.511825:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270119.511830:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a30c lrc: 0/0,0 mode: --/EX res: [0x2400032e0:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f58 expref: 36 pid: 45778 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511838:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192a00/0xc5f5d7a016e0a31a lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f58 expref: 35 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.511855:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:0.0:1788270119.511857:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270119.511858:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192a00, rc 0) 00000100:00100000:0.0:1788270119.511901:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:39663:x1875136253267456:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 449us (540us total) trans 30064771129 rc 0/0 00000100:00100000:0.0:1788270119.511915:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 415 00000100:00100000:2.0:1788270119.515957:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.516018:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267584 00000100:00100000:0.0:1788270119.516028:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267584 00002000:00100000:0.0:1788270119.516097:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc4:0x0] (12582912->15728639) req@ffff98c26bf2ad80 x1875136253267584/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.516108:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2ad80 with x1875136253267584 ext(12582912->15728639) 00002000:00010000:0.0:1788270119.516114:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2ad80 00000100:00100000:0.0:1788270119.516150:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:0.0:1788270119.516160:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253267584:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270119.545414:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253267584:12345-192.168.201.42@tcp:4:dd.0 Request processed in 29243us (29455us total) trans 30064771147 rc 0/0 00000100:00100000:0.0:1788270119.545432:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00002000:00100000:0.0:1788270119.545445:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc4:0x0] (12582912->15728639) req@ffff98c26bf2ad80 x1875136253267584/t30064771147(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/448 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.545455:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2ad80 with x1875136253267584 ext(12582912->15728639) 00002000:00010000:0.0:1788270119.545461:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2ad80 00000100:00100000:2.0:1788270119.570276:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.570343:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267712 00000100:00100000:0.0:1788270119.570353:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267712 00002000:00100000:0.0:1788270119.570404:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc4:0x0] (0->1048575) req@ffff98c26bf2b100 x1875136253267712/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.570429:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2b100 with x1875136253267712 ext(0->1048575) 00002000:00010000:0.0:1788270119.570437:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2b100 00000100:00100000:0.0:1788270119.570475:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:0.0:1788270119.570486:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253267712:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270119.578715:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253267712:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 8218us (8435us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788270119.578728:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00002000:00100000:0.0:1788270119.578743:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc4:0x0] (0->1048575) req@ffff98c26bf2b100 x1875136253267712/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.578753:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2b100 with x1875136253267712 ext(0->1048575) 00002000:00010000:0.0:1788270119.578760:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2b100 00000100:00100000:1.0:1788270119.595611:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.595712:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267840 00000100:00100000:3.0:1788270119.595720:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267840 00002000:00100000:3.0:1788270119.595758:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc4:0x0] (1048576->4194303) req@ffff98c14299d180 x1875136253267840/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270119.595766:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14299d180 with x1875136253267840 ext(1048576->4194303) 00002000:00010000:3.0:1788270119.595771:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14299d180 00000100:00100000:3.0:1788270119.595797:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:3.0:1788270119.595807:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253267840:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:3.0:1788270119.616120:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253267840:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 20303us (20506us total) trans 0 rc 3145728/3145728 00000100:00100000:3.0:1788270119.616133:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00002000:00100000:3.0:1788270119.616146:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc4:0x0] (1048576->4194303) req@ffff98c14299d180 x1875136253267840/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270119.616157:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14299d180 with x1875136253267840 ext(1048576->4194303) 00002000:00010000:3.0:1788270119.616163:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14299d180 00000100:00100000:1.0:1788270119.620588:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262670208:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620661:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620706:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262670720:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620732:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620750:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262671232:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620770:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620786:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262671744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620803:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620826:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788270119.620831:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262670336:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620856:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620875:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262670848:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620896:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620909:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262671360:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.620928:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620943:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262671872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270119.620964:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270119.620993:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670720 00000100:00100000:1.0:1788270119.621000:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670720 00000100:00100000:1.0:1788270119.621059:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671232 00000100:00100000:1.0:1788270119.621062:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671232 00000100:00100000:1.0:1788270119.621075:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671744 00000100:00100000:1.0:1788270119.621077:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671744 00000100:00100000:1.0:1788270119.621096:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671360 00000100:00100000:1.0:1788270119.621099:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671360 00000100:00100000:1.0:1788270119.621113:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788270119.621120:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262670720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621170:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262670720:12345-0@lo:400:kworker.0 Request processed in 50us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.621177:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788270119.621194:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788270119.621200:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262671232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621227:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262671232:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.621243:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788270119.621256:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788270119.621263:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262671744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621291:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262671744:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.621297:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788270119.621310:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788270119.621315:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262671360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621340:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262671360:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.621346:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788270119.621364:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670336 00000100:00100000:1.0:1788270119.621367:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670336 00000100:00100000:1.0:1788270119.621388:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670848 00000100:00100000:1.0:1788270119.621390:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670848 00000100:00100000:1.0:1788270119.621402:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788270119.621407:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262670336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621437:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262670336:12345-0@lo:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.621443:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788270119.621455:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788270119.621460:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262670848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621487:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262670848:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.621492:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788270119.621528:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262670336:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621537:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262670848:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621546:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262671360:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621554:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262670720:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621562:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262671232:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.621570:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262671744:0@lo:400:kworker.0 00000100:00100000:0.0:1788270119.621719:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670208 00000100:00100000:0.0:1788270119.621724:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670208 00000100:00100000:0.0:1788270119.621758:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788270119.621765:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262670208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270119.621806:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262670208:12345-0@lo:400:kworker.0 Request processed in 41us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270119.621812:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788270119.622066:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262670208:0@lo:400:kworker.0 00000100:00100000:2.0:1788270119.622751:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671872 00000100:00100000:2.0:1788270119.622758:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671872 00000100:00100000:2.0:1788270119.622844:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788270119.622853:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262671872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270119.622869:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8671232 granted 202014400 pending 15826944 free 3821953024 avail 3590430720 00000100:00100000:2.0:1788270119.622923:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262671872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270119.622931:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788270119.622949:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270119.622953:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270119.622956:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270119.623033:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262670080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270119.623087:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623114:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788270119.623149:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623165:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788270119.623184:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623204:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262671616:0@lo:400:kworker.0 00000100:00100000:3.0:1788270119.623225:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623260:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788270119.623267:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262669952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270119.623285:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623299:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262670464:0@lo:400:kworker.0 00000100:00100000:3.0:1788270119.623309:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623320:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788270119.623331:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623339:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262671488:0@lo:400:kworker.0 00000100:00100000:3.0:1788270119.623350:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270119.623369:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670080 00000100:00100000:3.0:1788270119.623371:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670080 00000100:00100000:3.0:1788270119.623389:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262669952 00000100:00100000:3.0:1788270119.623390:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262669952 00000100:00100000:3.0:1788270119.623402:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788270119.623406:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262670080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270119.623416:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 135405248 pending 15826944 free 3881553920 avail 3650031616 00000100:00100000:3.0:1788270119.623449:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262670080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270119.623456:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788270119.623469:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788270119.623475:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262669952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270119.623484:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8671232 granted 202014400 pending 15826944 free 3821953024 avail 3590430720 00000100:00100000:3.0:1788270119.623508:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262669952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270119.623517:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788270119.623535:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670592 00000100:00100000:3.0:1788270119.623538:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670592 00000100:00100000:3.0:1788270119.623557:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671104 00000100:00100000:3.0:1788270119.623560:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671104 00000100:00100000:3.0:1788270119.623568:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670464 00000100:00100000:3.0:1788270119.623571:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670464 00000100:00100000:1.0:1788270119.623672:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671616 00000100:00100000:1.0:1788270119.623677:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671616 00000100:00100000:1.0:1788270119.623703:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262671488 00000100:00100000:1.0:1788270119.623706:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262671488 00000100:00100000:1.0:1788270119.623723:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788270119.623730:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262671616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.623763:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262671616:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.623769:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788270119.623781:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788270119.623785:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262671488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.623814:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262671488:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.623819:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788270119.623848:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771142 gen 2 00000004:00080000:1.0:1788270119.623853:0:3609:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c2b6300, transno 30064771142 00000100:00100000:1.0:1788270119.623865:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262671872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270119.623969:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262670976 00000100:00100000:1.0:1788270119.623972:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262670976 00000100:00100000:1.0:1788270119.623985:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788270119.623988:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262670592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624016:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262670592:12345-0@lo:400:kworker.0 Request processed in 26us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.624021:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788270119.624032:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788270119.624059:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262671104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624087:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262671104:12345-0@lo:400:kworker.0 Request processed in 49us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.624093:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788270119.624105:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788270119.624110:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262670976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624136:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262670976:12345-0@lo:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.624142:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788270119.624184:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 30064771137 gen 2 00000004:00080000:1.0:1788270119.624188:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14a49ea00, transno 30064771137 00000100:00100000:1.0:1788270119.624201:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262669952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270119.624212:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262670976:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624221:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262671488:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624245:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262670080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270119.624255:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262670592:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624262:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262671104:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.624270:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262671616:0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.626818:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788270119.626829:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262670464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270119.626893:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262670464:12345-0@lo:400:kworker.0 Request processed in 68us (3583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.626898:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788270119.626930:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262670464:0@lo:400:kworker.0 00000100:00080000:2.0:1788270119.627035:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270119.627113:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270119.627115:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270119.627117:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270119.671347:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.671436:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.674978:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.675107:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253268096 00000100:00100000:3.0:1788270119.675119:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253268096 00000100:00100000:0.0:1788270119.675538:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253267968 00000100:00100000:0.0:1788270119.675543:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253267968 00002000:00100000:2.0:1788270119.675589:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc4:0x0] (8388608->12582911) req@ffff98c26bf2aa00 x1875136253268096/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.675589:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc4:0x0] (4194304->8388607) req@ffff98c26bf29180 x1875136253267968/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270119.675601:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2aa00 with x1875136253268096 ext(8388608->12582911) 00002000:00100000:0.0:1788270119.675601:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf29180 with x1875136253267968 ext(4194304->8388607) 00002000:00010000:2.0:1788270119.675607:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2aa00 00002000:00010000:0.0:1788270119.675607:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf29180 00000100:00100000:2.0:1788270119.676014:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253268224 00000100:00100000:2.0:1788270119.676020:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253268224 00002000:00100000:2.0:1788270119.676058:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc4:0x0] (12582912->15728639) req@ffff98c26bf28380 x1875136253268224/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270119.676068:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28380 with x1875136253268224 ext(12582912->15728639) 00002000:00010000:2.0:1788270119.676072:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf28380 00000100:00100000:0.0:1788270119.676230:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:0.0:1788270119.676250:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:2401:x1875136253268096:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270119.676909:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:1.0:1788270119.676920:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253267968:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270119.722290:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253267968:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 45360us (50841us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1788270119.722306:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00002000:00100000:1.0:1788270119.722319:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc4:0x0] (4194304->8388607) req@ffff98c26bf29180 x1875136253267968/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270119.722330:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf29180 with x1875136253267968 ext(4194304->8388607) 00002000:00010000:1.0:1788270119.722337:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf29180 00000100:00100000:1.0:1788270119.722373:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:1.0:1788270119.722387:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:2400:x1875136253268224:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270119.748578:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:2401:x1875136253268096:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 72318us (77230us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1788270119.748593:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00002000:00100000:0.0:1788270119.748609:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc4:0x0] (8388608->12582911) req@ffff98c26bf2aa00 x1875136253268096/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.748620:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf2aa00 with x1875136253268096 ext(8388608->12582911) 00002000:00010000:0.0:1788270119.748627:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf2aa00 00000100:00100000:0.0:1788270119.759462:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253268224:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 37068us (84481us total) trans 0 rc 3145728/3145728 00000100:00100000:0.0:1788270119.759475:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00002000:00100000:0.0:1788270119.759488:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc4:0x0] (12582912->15728639) req@ffff98c26bf28380 x1875136253268224/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 488/440 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.759505:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26bf28380 with x1875136253268224 ext(12582912->15728639) 00002000:00010000:0.0:1788270119.759512:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26bf28380 00000100:00100000:1.0:1788270119.773177:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.773270:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253268480 00000100:00100000:2.0:1788270119.773281:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253268480 00000100:00100000:2.0:1788270119.773390:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788270119.773402:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:39663:x1875136253268480:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:2.0:1788270119.773625:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:39663:x1875136253268480:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 225us (455us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1788270119.773633:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788270119.830774:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.830848:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253268736 00000100:00100000:0.0:1788270119.830868:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253268736 00000100:00100000:0.0:1788270119.830938:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 416 00000100:00100000:0.0:1788270119.830950:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:39673:x1875136253268736:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270119.830976:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270119.831001:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f5f expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270119.831137:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1788270119.831246:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a321 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f5f expref: 38 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.831262:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f2f00) 00010000:00010000:0.0:1788270119.831265:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270119.831270:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f5f expref: 38 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.831288:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192600, rc 0) 00000100:00100000:0.0:1788270119.831345:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:39673:x1875136253268736:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 398us (579us total) trans 30064771131 rc 301/301 00000100:00100000:0.0:1788270119.831352:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 416 00000100:00100000:3.0:1788270119.833130:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.833194:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253268864 00000100:00100000:1.0:1788270119.833202:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253268864 00000100:00100000:1.0:1788270119.833265:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 417 00000100:00100000:1.0:1788270119.833275:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:39673:x1875136253268864:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270119.833333:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833348:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833360:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833372:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833380:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833386:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833460:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833467:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833472:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270119.833508:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833519:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833525:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833532:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833538:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833545:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204aa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.833549:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833557:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833569:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:1.0:1788270119.833572:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.833577:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833583:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a32f lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833672:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833678:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833684:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833688:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204ac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.833691:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833696:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833703:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x852f64c2 (ffff98c143876600) 00010000:00010000:1.0:1788270119.833705:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.833708:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833713:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a336 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833721:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833726:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833731:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833735:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.833737:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833742:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833748:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.833751:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.833754:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.833760:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a33d lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270119.833823:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:39673:x1875136253268864:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 549us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.833832:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 417 00000100:00100000:2.0:1788270119.837909:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270119.838020:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253269120 00000100:00100000:3.0:1788270119.838033:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253269120 00000100:00100000:3.0:1788270119.838322:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:3.0:1788270119.838333:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:39673:x1875136253269120:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270119.838628:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:39673:x1875136253269120:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 296us (728us total) trans 30064771132 rc 0/0 00000100:00100000:3.0:1788270119.838636:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:2.0:1788270119.890450:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.892316:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253269376 00000100:00100000:0.0:1788270119.892332:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253269376 00000100:00100000:0.0:1788270119.892413:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 418 00000100:00100000:0.0:1788270119.892424:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:39683:x1875136253269376:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270119.892450:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270119.892477:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f66 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.892585:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a34b lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.892600:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a34b lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.892612:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a34b lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270119.892624:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1788270119.892721:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192600/0xc5f5d7a016e0a344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f66 expref: 41 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.892744:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c144192000/0xc5f5d7a016e0a34b lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f66 expref: 40 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270119.892753:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:0.0:1788270119.892756:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788270119.892760:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c144192000, rc 0) 00000100:00100000:0.0:1788270119.892827:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:39683:x1875136253269376:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 404us (2387us total) trans 30064771133 rc 0/0 00000100:00100000:0.0:1788270119.892834:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 418 00000100:00100000:2.0:1788270119.896917:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.897077:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253269504 00000100:00100000:1.0:1788270119.897088:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253269504 00000100:00100000:1.0:1788270119.897143:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 419 00000100:00100000:1.0:1788270119.897153:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:39683:x1875136253269504:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270119.897226:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897257:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897270:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897282:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897290:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897296:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897365:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897373:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897380:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270119.897433:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897445:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897451:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 2/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897459:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897465:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.897469:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897477:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897489:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:1.0:1788270119.897492:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.897496:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897503:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a359 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897516:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897523:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897528:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897533:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204ac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.897535:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897541:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897549:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0xdee864c2 (ffff98c24a952800) 00010000:00010000:1.0:1788270119.897551:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.897554:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897560:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a360 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897574:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897580:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897586:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897591:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204aa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.897594:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897600:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897607:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:1.0:1788270119.897609:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.897612:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.897618:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a367 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270119.897694:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:39683:x1875136253269504:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 542us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.897703:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 419 00000100:00100000:2.0:1788270119.939937:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.940269:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253269632 00000100:00100000:0.0:1788270119.940281:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253269632 00002000:00100000:0.0:1788270119.940335:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc5:0x0] (0->11) req@ffff98c1448f2300 x1875136253269632/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 504/0 e 0 to 0 dl 1788270130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.940347:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f2300 with x1875136253269632 ext(0->11) 00002000:00010000:0.0:1788270119.940352:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1448f2300 00000100:00100000:0.0:1788270119.940389:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:0.0:1788270119.940400:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253269632:12345-192.168.201.42@tcp:4:cat.0 00000100:00100000:0.0:1788270119.941629:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+22:2400:x1875136253269632:12345-192.168.201.42@tcp:4:cat.0 Request processed in 1225us (1695us total) trans 30064771148 rc 0/0 00000100:00100000:0.0:1788270119.941643:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00002000:00100000:0.0:1788270119.941653:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc5:0x0] (0->11) req@ffff98c1448f2300 x1875136253269632/t30064771148(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:535/0 lens 504/448 e 0 to 0 dl 1788270130 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270119.941664:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f2300 with x1875136253269632 ext(0->11) 00002000:00010000:0.0:1788270119.941668:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1448f2300 00000100:00100000:3.0:1788270119.946341:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.946988:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253269760 00000100:00100000:1.0:1788270119.947000:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253269760 00000100:00100000:1.0:1788270119.947306:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 420 00000100:00100000:1.0:1788270119.947318:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:39689:x1875136253269760:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270119.947340:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270119.947361:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a36e lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f6d expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947428:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 3/1,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947443:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947453:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 3/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947464:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947472:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947478:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947551:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204be00/0xc5f5d7a016e0a383 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947561:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204be00/0xc5f5d7a016e0a383 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947568:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204be00/0xc5f5d7a016e0a383 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270119.947611:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x7:0x0]: returning size 15728640 00000004:00200000:1.0:1788270119.947616:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270119.947633:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204be00/0xc5f5d7a016e0a383 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947645:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204be00/0xc5f5d7a016e0a383 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947655:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947661:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 4/1,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947669:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 3/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947675:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947680:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204ac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.947685:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 4/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947692:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 5/0,0 mode: CR/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947704:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:1.0:1788270119.947707:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.947712:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 3/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947723:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204ac00/0xc5f5d7a016e0a375 lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947737:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.947997:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 2/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948006:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948011:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28204b000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270119.948014:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948019:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 4/0,0 mode: PR/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948027:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x852f64c2 (ffff98c143876600) 00010000:00010000:1.0:1788270119.948030:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270119.948033:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 2/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948138:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204b000/0xc5f5d7a016e0a37c lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948170:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204aa00/0xc5f5d7a016e0a36e lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f6d expref: 42 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948200:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204be00/0xc5f5d7a016e0a383 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f6d expref: 41 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.948207:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.948209:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270119.948212:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28204be00, rc 0) 00000100:00100000:1.0:1788270119.948290:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:39689:x1875136253269760:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 974us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.948298:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 420 00000100:00100000:2.0:1788270119.951154:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270119.951377:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253270016 00000100:00100000:0.0:1788270119.951386:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253270016 00000100:00100000:1.0:1788270119.951520:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 421 00000100:00100000:1.0:1788270119.951534:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:39689:x1875136253270016:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270119.951553:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270119.951574:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204a000/0xc5f5d7a016e0a38a lrc: 2/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f74 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.951683:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204bc00/0xc5f5d7a016e0a391 lrc: 3/1,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.951697:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204bc00/0xc5f5d7a016e0a391 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.951708:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204bc00/0xc5f5d7a016e0a391 lrc: 3/1,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270119.951718:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400032e0:0x7:0x0]: returning size 15728640 00010000:00010000:1.0:1788270119.951817:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204a000/0xc5f5d7a016e0a38a lrc: 0/0,0 mode: --/CR res: [0x2400032e0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f74 expref: 44 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.951856:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204bc00/0xc5f5d7a016e0a391 lrc: 3/0,0 mode: PR/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f74 expref: 43 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.951865:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.951868:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270119.951872:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28204bc00, rc 0) 00000100:00100000:1.0:1788270119.951937:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:39689:x1875136253270016:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 406us (790us total) trans 30064771134 rc 0/0 00000100:00100000:1.0:1788270119.951945:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 421 00000100:00100000:2.0:1788270119.955590:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270119.955642:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270119.955747:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253270400 00000100:00100000:1.0:1788270119.955757:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253270400 00000100:00100000:3.0:1788270119.955922:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253270272 00000100:00100000:3.0:1788270119.955926:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253270272 00000100:00100000:1.0:1788270119.955982:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788270119.955995:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:2403:x1875136253270400:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270119.956014:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270119.956070:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c28204bc00/0xc5f5d7a016e0a391 lrc: 0/0,0 mode: --/PR res: [0x2400032e0:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f74 expref: 44 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270119.956239:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:1.0:1788270119.956244:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270119.956348:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:2403:x1875136253270400:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 356us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270119.956357:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788270119.957296:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:3.0:1788270119.957309:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:39689:x1875136253270272:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270119.957492:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:39689:x1875136253270272:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 187us (1910us total) trans 30064771135 rc 0/0 00000100:00100000:3.0:1788270119.957500:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00010000:00010000:0.0:1788270120.391427:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270121.414698:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788270121.669129:0:46519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 913376088080ns, next at 914376085681ns, rc = 0 00000100:00100000:1.0:1788270121.669129:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270121.669154:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262672000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270121.669246:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270121.669296:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672000 00000100:00100000:2.0:1788270121.669303:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672000 00000100:00100000:2.0:1788270121.669359:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788270121.669366:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262672000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270121.669389:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 135405248 pending 15826944 free 3865825280 avail 3634302976 00000100:00100000:2.0:1788270121.669426:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262672000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270121.669431:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788270121.671292:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270121.671351:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262672000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270122.181542:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270122.181570:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262672128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270122.181648:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270122.181779:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672128 00000100:00100000:3.0:1788270122.181787:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672128 00000100:00100000:3.0:1788270122.181844:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788270122.181854:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262672128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270122.181888:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446137856 avail 1299898368 00000100:00100000:3.0:1788270122.181939:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262672128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270122.181946:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788270122.181977:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262672128:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270122.436320:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270122.900111:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270122.900269:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253270528 00000100:00100000:1.0:1788270122.900281:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253270528 00000100:00100000:1.0:1788270122.900585:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 422 00000100:00100000:1.0:1788270122.900597:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39632:x1875136253270528:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788270122.900756:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39632:x1875136253270528:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 162us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270122.900774:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 422 00000100:00080000:2.0:1788270122.900938:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270122.902711:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270122.902824:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253270656 00000100:00100000:1.0:1788270122.902831:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253270656 00000100:00100000:1.0:1788270122.902904:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 423 00000100:00100000:1.0:1788270122.902910:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:39632:x1875136253270656:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788270122.903067:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:39632:x1875136253270656:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 157us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270122.903072:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 423 00000100:00080000:2.0:1788270122.909666:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270122.910374:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270122.910682:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253270912 00000100:00100000:2.0:1788270122.910692:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253270912 00000100:00100000:2.0:1788270122.910749:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:2.0:1788270122.910759:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:39632:x1875136253270912:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270122.911277:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:39632:x1875136253270912:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 518us (907us total) trans 30064771359 rc 0/0 00000100:00100000:2.0:1788270122.911297:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:3.0:1788270123.052241:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270123.052480:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271040 00000100:00100000:1.0:1788270123.052490:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271040 00000100:00100000:1.0:1788270123.052586:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 424 00000100:00080000:2.0:1788270123.052589:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270123.052600:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:40135:x1875136253271040:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:1.0:1788270123.052621:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270123.052641:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204b800/0xc5f5d7a016e0a39f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f7b expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270123.052919:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270123.052935:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270123.052946:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270123.053269:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270123.053274:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270123.053296:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270123.053321:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204b800/0xc5f5d7a016e0a39f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 7 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270123.053342:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 6 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270123.053351:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270123.053354:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270123.053358:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28204a800, rc 0) 00000100:00100000:1.0:1788270123.053423:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:40135:x1875136253271040:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 827us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270123.053430:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 424 00010000:00010000:0.0:1788270123.461683:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270124.228350:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262672256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270124.228417:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270124.228556:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672256 00000100:00100000:2.0:1788270124.228568:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672256 00000100:00100000:2.0:1788270124.228609:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788270124.228618:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262672256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270124.228662:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270124.228710:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262672256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.228717:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788270124.228764:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262672256:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1788270124.232112:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000001:00080000:1.0:1788270124.232165:0:46509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771135 is committed 00000004:00080000:1.0:1788270124.232189:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000004:00080000:1.0:1788270124.232208:0:46509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:1.0:1788270124.232221:0:46509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98c27524d180 refcount 2 committed 0 result 0 batchid 25769803852 00000020:00080000:1.0:1788270124.232226:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98c27524d540 00000020:00080000:1.0:1788270124.232230:0:46509:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000032e2:0x1:0x0].2 00000020:00080000:1.0:1788270124.232233:0:46509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c279e10100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14ca48200 00000020:00080000:1.0:1788270124.232235:0:46509:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400032e1:0x1:0x0].2 00010000:00010000:2.0:1788270124.232625:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270124.232636:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788270124.232639:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232649:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232655:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ee00 already unused, calling callback (ffffffffc1aac4f0) 00000100:00100000:1.0:1788270124.232659:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262672384:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1788270124.232661:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232672:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232690:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x0 (ffff98c1429feb00) 00010000:00010000:2.0:1788270124.232693:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270124.232698:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232705:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a1bc lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232726:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270124.232731:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788270124.232739:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232746:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232752:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5c600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270124.232756:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232763:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232772:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0x852f64c2 (ffff98c143876600) 00010000:00010000:2.0:1788270124.232776:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270124.232779:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270124.232783:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672384 00010000:00010000:2.0:1788270124.232787:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c26ab5c600/0xc5f5d7a016e0a209 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x6:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270124.232792:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672384 00010000:00010000:2.0:1788270124.232813:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232821:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232827:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232831:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270124.232834:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232844:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232852:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x6:0x0].0xdee864c2 (ffff98c24a952800) 00010000:00010000:2.0:1788270124.232853:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270124.232856:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232862:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a233 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x6:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232877:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232884:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232890:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232895:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf200 already unused, calling callback (ffffffffc1aac4f0) 00000100:00100000:1.0:1788270124.232898:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00010000:00010000:2.0:1788270124.232900:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.232909:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270124.232913:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262672384:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1788270124.232922:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x7:0x0].0x0 (ffff98c1429fd800) 00010000:00010000:2.0:1788270124.232925:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270124.232928:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270124.233071:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262672512:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1788270124.233086:0:47281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 12582912 -> 15728640 00002000:00010000:1.0:1788270124.233089:0:47281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1788270118 -> 1788270118 00002000:00010000:1.0:1788270124.233091:0:47281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270124.233093:0:47281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1788270119 -> 1788270119 00002000:00010000:1.0:1788270124.233095:0:47281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 24576 -> 30720 00000100:00100000:3.0:1788270124.233107:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270124.233137:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262672384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 228us (409us total) trans 30064771126 rc 0/0 00000100:00100000:1.0:1788270124.233143:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788270124.233164:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672512 00000100:00100000:3.0:1788270124.233170:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672512 00000004:00080000:1.0:1788270124.233201:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1448f1180/2, rc 0, transno 30064771126 00000100:00100000:3.0:1788270124.233207:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788270124.233211:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262672384:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1788270124.233220:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262672512:12345-0@lo:2:osp-syn-1-1.0 00000020:00080000:1.0:1788270124.233249:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769803852 committed batchid 25769803851 00000020:00080000:1.0:1788270124.233287:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 25769803851 00000100:00080000:1.0:1788270124.233298:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270124.233302:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788270124.233327:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb size from disk: 12582912 -> 15728640 00002000:00010000:3.0:1788270124.233332:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb mtime from disk: 1788270119 -> 1788270119 00002000:00010000:3.0:1788270124.233335:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270124.233337:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb ctime from disk: 1788270119 -> 1788270119 00002000:00010000:3.0:1788270124.233339:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc4:0x0] updating lvb blocks from disk: 24576 -> 30720 00000004:00080000:1.0:1788270124.233442:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14ad94000/2, rc 0, transno 30064771149 00000100:00100000:1.0:1788270124.233449:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262672512:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1788270124.233608:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262672512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 167us (277us total) trans 30064771149 rc 0/0 00000100:00100000:3.0:1788270124.233623:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:2.0:1788270124.233776:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a25d lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233790:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,1 mode: TXN/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233797:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 2/0,0 mode: TXN/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233803:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233808:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270124.233812:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 3/0,0 mode: TXN/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233818:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 4/0,0 mode: TXN/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233828:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400032e0:0x8:0x0].0x0 (ffff98c24a952d00) 00010000:00010000:2.0:1788270124.233831:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270124.233835:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 2/0,0 mode: --/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270124.233841:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a279 lrc: 0/0,0 mode: --/TXN res: [0x2400032e0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270124.234586:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771125 is committed 00000001:00080000:3.0:1788270124.234607:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771120 is committed 00000001:00080000:2.0:1788270124.234804:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771148 is committed 00010000:00010000:0.0:1788270124.485549:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270124.546470:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270124.546717:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270124.546824:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270124.546863:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270124.546921:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271680 00000100:00100000:1.0:1788270124.546932:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271680 00000100:00100000:1.0:1788270124.546995:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:1.0:1788270124.547006:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2400:x1875136253271680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270124.547103:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2400:x1875136253271680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270124.547111:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00080000:1.0:1788270124.547135:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270124.547573:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271168 00000100:00100000:0.0:1788270124.547578:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271168 00000100:00100000:0.0:1788270124.547608:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:0.0:1788270124.547615:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253271168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270124.547650:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253271168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270124.547657:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:2.0:1788270124.547875:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271424 00000100:00100000:1.0:1788270124.547875:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271936 00000100:00100000:2.0:1788270124.547882:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271424 00000100:00100000:1.0:1788270124.547882:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271936 00000100:00100000:1.0:1788270124.547930:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:1.0:1788270124.547936:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253271936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270124.547960:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253271936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270124.547964:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:1.0:1788270124.547978:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:1.0:1788270124.547983:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253271424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270124.548005:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253271424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270124.548011:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:3.0:1788270124.548018:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270124.548100:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271296 00000100:00100000:1.0:1788270124.548103:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271296 00000100:00100000:1.0:1788270124.548123:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:1.0:1788270124.548130:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2400:x1875136253271296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270124.548144:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270124.548183:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2400:x1875136253271296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 53us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270124.548192:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:3.0:1788270124.548214:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270124.548225:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271552 00000100:00100000:1.0:1788270124.548230:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271552 00000100:00080000:3.0:1788270124.548286:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270124.548291:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270124.548294:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270124.548313:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:3.0:1788270124.548316:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253271808 00000100:00100000:1.0:1788270124.548320:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253271552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270124.548321:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253271808 00000100:00100000:1.0:1788270124.548356:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:2400:x1875136253271552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270124.548361:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:1.0:1788270124.548365:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:3.0:1788270124.548374:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253271808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270124.548413:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253271808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270124.548420:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:3.0:1788270124.740302:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262672640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270124.740302:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262672896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270124.740322:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262672768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270124.740381:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270124.740412:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672640 00000100:00100000:2.0:1788270124.740416:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270124.740429:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672640 00000100:00100000:2.0:1788270124.740473:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672768 00000100:00100000:2.0:1788270124.740477:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672768 00000100:00100000:0.0:1788270124.740512:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788270124.740531:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262672640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270124.740561:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 119578304 pending 0 free 3865825280 avail 3634302976 00000100:00100000:3.0:1788270124.740578:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788270124.740590:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262672768:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788270124.740606:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788270124.740611:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8642560 granted 194596544 pending 0 free 3806220288 avail 3574697984 00000100:00100000:0.0:1788270124.740614:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262672640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270124.740624:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788270124.740656:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270124.740658:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771120 gen 2 00000100:00100000:3.0:1788270124.740661:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262672768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000004:00080000:2.0:1788270124.740665:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27fb72a00, transno 30064771119 00000100:00100000:3.0:1788270124.740672:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:2.0:1788270124.740678:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27fb70a80, transno 30064771120 00000100:00100000:3.0:1788270124.740694:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262672896 00000100:00100000:2.0:1788270124.740695:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262672640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270124.740698:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262672896 00000100:00100000:3.0:1788270124.740731:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788270124.740736:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262672896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270124.740745:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8642560 granted 194596544 pending 0 free 3806220288 avail 3574697984 00000100:00100000:3.0:1788270124.740768:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262672896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270124.740773:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788270124.740775:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270124.740823:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262672896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270124.740838:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262672768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270124.741269:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262673024:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741307:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270124.741335:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262673536:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741351:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262673408:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741361:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270124.741390:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270124.741391:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262674048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741414:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262673920:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741424:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270124.741453:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788270124.741461:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270124.741463:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262673152:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741492:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270124.741493:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673408 00000100:00100000:0.0:1788270124.741494:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788270124.741500:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673408 00000100:00100000:0.0:1788270124.741505:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262673280:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741518:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262673664:0@lo:400:kworker.0 00000100:00100000:2.0:1788270124.741535:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673152 00000100:00100000:2.0:1788270124.741539:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673152 00000100:00100000:0.0:1788270124.741543:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270124.741561:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673024 00000100:00100000:2.0:1788270124.741566:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788270124.741567:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673024 00000100:00100000:2.0:1788270124.741576:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262673408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741577:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262673792:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741602:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788270124.741612:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262673024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741625:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270124.741642:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262673408:12345-0@lo:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.741654:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788270124.741663:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262673024:12345-0@lo:400:kworker.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270124.741671:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788270124.741676:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788270124.741676:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262673408:0@lo:400:kworker.0 00000100:00100000:2.0:1788270124.741690:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262673152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741705:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674048 00000100:00100000:0.0:1788270124.741711:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674048 00000100:00100000:3.0:1788270124.741712:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673536 00000100:00100000:3.0:1788270124.741717:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673536 00000100:00100000:2.0:1788270124.741727:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262673152:12345-0@lo:400:kworker.0 Request processed in 41us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.741736:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788270124.741753:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788270124.741764:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262673536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741767:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673920 00000100:00100000:0.0:1788270124.741773:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673920 00000100:00100000:2.0:1788270124.741780:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673280 00000100:00100000:2.0:1788270124.741786:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673280 00000100:00100000:0.0:1788270124.741799:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673792 00000100:00100000:0.0:1788270124.741804:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673792 00000100:00100000:3.0:1788270124.741811:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262673536:12345-0@lo:400:kworker.0 Request processed in 48us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.741817:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788270124.741823:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788270124.741829:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262674048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741834:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788270124.741846:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262673920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.741853:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788270124.741864:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262673280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270124.741875:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262674048:12345-0@lo:400:kworker.0 Request processed in 49us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.741883:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788270124.741907:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788270124.741909:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262673920:12345-0@lo:400:kworker.0 Request processed in 62us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.741918:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262673792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.741922:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788270124.741924:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262673280:12345-0@lo:400:kworker.0 Request processed in 59us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270124.741934:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788270124.741958:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262673792:12345-0@lo:400:kworker.0 Request processed in 42us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270124.741966:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788270124.741967:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270124.741972:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270124.741996:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270124.742025:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262674176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.742031:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262673664 00000100:00100000:0.0:1788270124.742080:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270124.742106:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262673024:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742119:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262673536:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742131:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262674048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742169:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262673152:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742185:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674176 00000100:00100000:0.0:1788270124.742188:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674176 00000100:00100000:0.0:1788270124.742226:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788270124.742234:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262674176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742271:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262674176:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270124.742277:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788270124.742305:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262674176:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742325:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262673280:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742339:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262673792:0@lo:400:kworker.0 00000100:00100000:0.0:1788270124.742353:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262673920:0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.742368:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262673664 00000100:00100000:3.0:1788270124.742404:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788270124.742415:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262673664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270124.742456:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262673664:12345-0@lo:400:kworker.0 Request processed in 44us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270124.742462:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788270124.742470:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262673664:0@lo:400:kworker.0 00000100:00080000:2.0:1788270124.742496:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:2.0:1788270124.742875:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771359 is committed 00000001:02000400:2.0:1788270124.790097:0:50453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 09:42:04 (1788270124) 00000100:00100000:3.0:1788270125.498194:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270125.499375:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253272192 00000100:00100000:2.0:1788270125.499391:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253272192 00000100:00100000:2.0:1788270125.499463:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 425 00000100:00100000:2.0:1788270125.499475:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+26:40420:x1875136253272192:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270125.499496:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270125.499518:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e0a3ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f82 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499608:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499627:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499641:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499655:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499664:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499670:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499760:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a3c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499769:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499776:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270125.499785:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788270125.499867:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499875:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499882:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499887:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499893:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19ba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270125.499898:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499910:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499922:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:2.0:1788270125.499925:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270125.499929:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499935:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a3b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499956:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499963:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499969:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499974:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270125.499977:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499983:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.499991:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c24a952200) 00010000:00010000:2.0:1788270125.499993:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270125.499997:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.500007:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a3bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.501440:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a200/0xc5f5d7a016e0a3ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f82 expref: 29 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.501462:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f82 expref: 28 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.501470:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270125.501473:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270125.501476:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b400, rc 0) 00000100:00100000:2.0:1788270125.501547:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:40420:x1875136253272192:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2074us (3361us total) trans 30064771360 rc 0/0 00000100:00100000:2.0:1788270125.501555:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 425 00000100:00100000:3.0:1788270125.503718:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270125.503784:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253272320 00000100:00100000:3.0:1788270125.503785:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270125.503795:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253272320 00000100:00100000:1.0:1788270125.503884:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253272448 00000100:00100000:1.0:1788270125.503889:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253272448 00000100:00100000:1.0:1788270125.503930:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 426 00000100:00100000:1.0:1788270125.503939:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:40420:x1875136253272448:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270125.504103:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:40420:x1875136253272448:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 164us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270125.504110:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 426 00000100:00100000:0.0:1788270125.504225:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788270125.504233:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2402:x1875136253272320:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270125.504243:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270125.504265:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a3c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f82 expref: 28 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.504284:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270125.504289:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270125.504311:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+27:2402:x1875136253272320:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 79us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270125.504319:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788270125.508111:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:1.0:1788270125.508183:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270125.508287:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253272576 00000100:00100000:3.0:1788270125.508297:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253272576 00000100:00100000:3.0:1788270125.508349:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 427 00000100:00100000:3.0:1788270125.508359:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:40420:x1875136253272576:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270125.508465:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:40420:x1875136253272576:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 107us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270125.508473:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 427 00000100:00100000:3.0:1788270125.583178:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270125.583227:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270125.586338:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253272704 00000100:00100000:2.0:1788270125.586354:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253272704 00000100:00100000:2.0:1788270125.586461:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253272960 00000100:00100000:2.0:1788270125.586464:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253272960 00000100:00100000:2.0:1788270125.586501:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 428 00000100:00100000:2.0:1788270125.586513:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2402:x1875136253272704:12345-192.168.201.42@tcp:41:mkdir.0 00000100:00100000:0.0:1788270125.586535:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 429 00000100:00100000:0.0:1788270125.586546:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:40435:x1875136253272960:12345-192.168.201.42@tcp:36:mkdir.0 00000004:00000024:2.0:1788270125.586550:0:45776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446137856 avail 1299898368 00010000:00010000:0.0:1788270125.586584:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270125.586609:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5ce00/0xc5f5d7a016e0a1ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ee1 expref: 28 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270125.586624:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:2402:x1875136253272704:12345-192.168.201.42@tcp:41:mkdir.0 Request processed in 113us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270125.586633:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 428 00010000:00010000:0.0:1788270125.586635:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270125.586642:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270125.586708:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.586723:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.586732:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.586763:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.586776:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 5 pid: 48110 timeout: 1017 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270125.586791:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262674304:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270125.586843:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2751de900 going to sleep for 11 seconds 00000100:00100000:0.0:1788270125.589060:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262674304:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270125.589087:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270125.589940:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270125.590023:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273088 00000100:00100000:0.0:1788270125.590032:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273088 00010000:00010000:0.0:1788270125.590265:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 6 pid: 48110 timeout: 1017 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270125.590313:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:0.0:1788270125.590322:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253273088:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270125.590336:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270125.590343:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 6 pid: 48110 timeout: 1017 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.590355:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 6 pid: 48110 timeout: 1017 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.590377:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28204a800/0xc5f5d7a016e0a3a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f7b expref: 6 pid: 48110 timeout: 1017 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.590395:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270125.590401:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.590419:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.590427:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.590454:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270125.590503:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253273088:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 181us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270125.590510:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00010000:00010000:3.0:1788270125.590693:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.590701:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.590723:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.590734:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.590742:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591328:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591338:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591346:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270125.591362:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27df97b reply state 00000000e177c951 transno 30064771361 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591372:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591378:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:3.0:1788270125.591381:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270125.591385:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788270125.591390:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 4096 00010000:00010000:3.0:1788270125.591397:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591404:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591410:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591417:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591423:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270125.591428:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591436:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591445:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270125.591447:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270125.591450:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591456:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a3d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270125.591468:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27df97b reply state 00000000e177c951 transno 30064771361 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591481:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.591487:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff98c1429fd600) 00010000:00010000:3.0:1788270125.591490:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270125.591492:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788270125.591555:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:40435:x1875136253272960:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 5011us (8326us total) trans 30064771361 rc 0/0 00000100:00100000:3.0:1788270125.591562:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 429 00000100:00080000:2.0:1788270125.593727:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270125.599992:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270125.601257:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273216 00000100:00100000:0.0:1788270125.601272:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273216 00000100:00100000:0.0:1788270125.601330:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 430 00000100:00100000:0.0:1788270125.601341:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+28:40436:x1875136253273216:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270125.601365:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270125.601386:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f89 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.601464:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a3ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.601478:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a3ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.601490:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a3ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270125.601532:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270125.601535:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270125.601552:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a3ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.601576:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f89 expref: 30 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.601594:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a3ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f89 expref: 29 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.601603:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270125.601605:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270125.601609:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0a00, rc 0) 00000100:00100000:0.0:1788270125.601667:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:40436:x1875136253273216:12345-192.168.201.42@tcp:101:dd.0 Request processed in 329us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270125.601673:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 430 00000100:00100000:1.0:1788270125.606181:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270125.606227:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273344 00000100:00100000:0.0:1788270125.606238:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273344 00000100:00100000:0.0:1788270125.606352:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 431 00000100:00100000:0.0:1788270125.606362:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+29:40436:x1875136253273344:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270125.606381:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270125.606398:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a3f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f90 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606452:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606463:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606471:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606477:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606482:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606485:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606551:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a408 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606556:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a408 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606560:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a408 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270125.606592:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 4096 00000004:00200000:0.0:1788270125.606595:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270125.606609:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a408 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606617:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606622:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606626:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606630:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f1c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270125.606633:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606638:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606646:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270125.606648:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270125.606651:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606657:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a3fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606666:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606669:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606672:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606675:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1410f0c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270125.606677:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606680:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606683:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff98c1429fd600) 00010000:00010000:0.0:1788270125.606685:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270125.606686:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606689:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a401 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606716:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f90 expref: 31 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606724:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0600/0xc5f5d7a016e0a408 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f90 expref: 30 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270125.606729:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:0.0:1788270125.606731:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788270125.606732:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0600, rc 0) 00000100:00100000:0.0:1788270125.606785:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:40436:x1875136253273344:12345-192.168.201.42@tcp:101:dd.0 Request processed in 425us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270125.606790:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 431 00000100:00100000:1.0:1788270125.609212:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270125.609309:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273600 00000100:00100000:3.0:1788270125.609320:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273600 00000100:00100000:3.0:1788270125.609375:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 432 00000100:00100000:3.0:1788270125.609386:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+30:40436:x1875136253273600:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270125.609406:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270125.609427:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40400/0xc5f5d7a016e0a40f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f97 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.609530:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.609545:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.609556:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.609569:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.609577:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.609583:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270125.609903:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc8:0x0], index 1: 0 00010000:00010000:3.0:1788270125.610021:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a424 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610031:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a424 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610176:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a424 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610212:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610220:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610227:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610234:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610239:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fb41000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270125.610243:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610256:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 5/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610268:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:3.0:1788270125.610271:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270125.610274:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 3/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610281:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a416 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270125.610296:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3280c02 reply state 000000002b0c1bed transno 30064771362 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610307:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610314:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff98c1429fd300) 00010000:00010000:3.0:1788270125.610316:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270125.610318:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270125.610343:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40400/0xc5f5d7a016e0a40f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f97 expref: 33 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610358:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a424 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f97 expref: 32 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270125.610365:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:3.0:1788270125.610367:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270125.610370:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14fb41600, rc 0) 00000100:00100000:3.0:1788270125.610470:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:40436:x1875136253273600:12345-192.168.201.42@tcp:101:dd.0 Request processed in 1085us (1267us total) trans 30064771362 rc 0/0 00000100:00100000:3.0:1788270125.610478:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 432 00000100:00100000:1.0:1788270125.622331:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270125.622491:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273728 00000100:00100000:2.0:1788270125.622500:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273728 00000100:00100000:2.0:1788270125.622547:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:2.0:1788270125.622558:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:40436:x1875136253273728:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270125.622583:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270125.622605:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b972b2b/0xc5f5d7a016e0a432 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101f9e expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270125.622633:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270125.622654:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=917s v=(0 0) 00010000:00010000:2.0:1788270125.622658:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270125.622665:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b972b2b/0xc5f5d7a016e0a432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f9e expref: 12 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.622678:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b972b2b/0xc5f5d7a016e0a432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f9e expref: 12 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.622688:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19a200, rc 0) 00000100:00100000:2.0:1788270125.622739:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:40436:x1875136253273728:12345-192.168.201.42@tcp:101:dd.0 Request processed in 183us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270125.622746:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788270125.672026:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270125.672313:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273856 00000100:00100000:0.0:1788270125.672326:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273856 00002000:00100000:0.0:1788270125.672389:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc8:0x0] (0->4194303) req@ffff98c27c2c4000 x1875136253273856/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/0 e 0 to 0 dl 1788270136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270125.672401:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c4000 with x1875136253273856 ext(0->4194303) 00002000:00010000:0.0:1788270125.672408:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c4000 00000100:00100000:0.0:1788270125.672448:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:0.0:1788270125.672458:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253273856:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270125.722405:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253273856:12345-192.168.201.42@tcp:4:dd.0 Request processed in 49927us (50377us total) trans 30064771150 rc 0/0 00000100:00100000:0.0:1788270125.722425:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00002000:00100000:0.0:1788270125.722448:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc8:0x0] (0->4194303) req@ffff98c27c2c4000 x1875136253273856/t30064771150(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/448 e 0 to 0 dl 1788270136 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270125.722461:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c2c4000 with x1875136253273856 ext(0->4194303) 00002000:00010000:0.0:1788270125.722471:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c2c4000 00000100:00100000:3.0:1788270125.754241:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270125.754357:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253273984 00000100:00100000:2.0:1788270125.754374:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253273984 00002000:00100000:2.0:1788270125.754436:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc8:0x0] (4194304->8388607) req@ffff98c14720b100 x1875136253273984/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/0 e 0 to 0 dl 1788270136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270125.754448:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720b100 with x1875136253273984 ext(4194304->8388607) 00002000:00010000:2.0:1788270125.754454:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720b100 00000100:00100000:2.0:1788270125.754570:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:2.0:1788270125.754581:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2403:x1875136253273984:12345-192.168.201.42@tcp:4:dd.0 00000040:00080000:2.0:1788270125.765072:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270125.765086:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270125.765114:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:2.0:1788270125.765135:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788270125.813481:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2403:x1875136253273984:12345-192.168.201.42@tcp:4:dd.0 Request processed in 58776us (59132us total) trans 30064771151 rc 0/0 00000100:00100000:0.0:1788270125.813499:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00002000:00100000:0.0:1788270125.813513:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc8:0x0] (4194304->8388607) req@ffff98c14720b100 x1875136253273984/t30064771151(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/448 e 0 to 0 dl 1788270136 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270125.813523:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720b100 with x1875136253273984 ext(4194304->8388607) 00002000:00010000:0.0:1788270125.813529:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720b100 00000100:00100000:2.0:1788270125.832156:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270125.835314:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253274112 00000100:00100000:1.0:1788270125.835330:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253274112 00002000:00100000:1.0:1788270125.835386:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (8388608->12582911) req@ffff98c1448f3800 x1875136253274112/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/0 e 0 to 0 dl 1788270136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270125.835403:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f3800 with x1875136253274112 ext(8388608->12582911) 00002000:00010000:1.0:1788270125.835410:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1448f3800 00000100:00100000:1.0:1788270125.835444:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:1.0:1788270125.835454:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253274112:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:3.0:1788270125.863856:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270125.864644:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253274368 00000100:00100000:1.0:1788270125.864655:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253274368 00000100:00100000:1.0:1788270125.864725:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:1.0:1788270125.864737:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+33:40436:x1875136253274368:12345-192.168.201.42@tcp:35:dd.0 00000001:00080000:1.0:1788270125.865668:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771363 00000100:00100000:1.0:1788270125.866514:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:40436:x1875136253274368:12345-192.168.201.42@tcp:35:dd.0 Request processed in 1774us (2663us total) trans 30064771364 rc 0/0 00000100:00100000:1.0:1788270125.866525:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000020:00080000:1.0:1788270125.866530:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270125.878435:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253274112:12345-192.168.201.42@tcp:4:dd.0 Request processed in 42969us (46276us total) trans 30064771152 rc 0/0 00000100:00100000:1.0:1788270125.878451:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00002000:00100000:1.0:1788270125.878478:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (8388608->12582911) req@ffff98c1448f3800 x1875136253274112/t30064771152(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/448 e 0 to 0 dl 1788270136 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270125.878489:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f3800 with x1875136253274112 ext(8388608->12582911) 00002000:00010000:1.0:1788270125.878496:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1448f3800 00000100:00100000:0.0:1788270125.879819:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270125.879881:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253274624 00000100:00100000:2.0:1788270125.879890:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253274624 00000100:00100000:2.0:1788270125.879976:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 433 00000100:00100000:2.0:1788270125.879985:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:40437:x1875136253274624:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270125.880004:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270125.880030:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0a439 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fa5 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880328:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880341:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880349:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880360:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880365:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880371:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270125.880647:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xc9:0x0], index 0: 0 00010000:00010000:2.0:1788270125.880754:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a44e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880760:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a44e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880767:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a44e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880809:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880815:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880819:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880823:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880827:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270125.880830:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880834:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 5/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880847:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:2.0:1788270125.880849:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270125.880852:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 3/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880857:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a440 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270125.880866:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a48e0e25 reply state 000000000e6de897 transno 30064771365 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880873:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880877:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff98c24a952b00) 00010000:00010000:2.0:1788270125.880878:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270125.880884:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270125.880905:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0a439 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fa5 expref: 38 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880914:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a44e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fa5 expref: 37 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270125.880919:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:2.0:1788270125.880920:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270125.880922:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19b400, rc 0) 00000100:00100000:2.0:1788270125.880970:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:40437:x1875136253274624:12345-192.168.201.42@tcp:101:dd.0 Request processed in 985us (1156us total) trans 30064771365 rc 0/0 00000100:00100000:2.0:1788270125.880977:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 433 00000100:00100000:2.0:1788270125.886968:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270125.887164:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253274752 00000100:00100000:1.0:1788270125.887176:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253274752 00000100:00100000:1.0:1788270125.887250:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788270125.887263:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+8:40437:x1875136253274752:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270125.887281:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270125.887304:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000178447cd/0xc5f5d7a016e0a45c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fac expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270125.887339:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270125.887366:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=917s v=(0 0) 00010000:00010000:1.0:1788270125.887371:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270125.887382:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000178447cd/0xc5f5d7a016e0a45c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fac expref: 9 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270125.887400:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000178447cd/0xc5f5d7a016e0a45c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fac expref: 9 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270125.887414:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28204b000, rc 0) 00000100:00100000:1.0:1788270125.887483:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:40437:x1875136253274752:12345-192.168.201.42@tcp:101:dd.0 Request processed in 211us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270125.887491:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:2.0:1788270125.968534:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270125.968728:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253274880 00000100:00100000:3.0:1788270125.968740:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253274880 00002000:00100000:3.0:1788270125.968864:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc9:0x0] (0->4194303) req@ffff98c1448f3480 x1875136253274880/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/0 e 0 to 0 dl 1788270136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270125.968876:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f3480 with x1875136253274880 ext(0->4194303) 00002000:00010000:3.0:1788270125.968883:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1448f3480 00000100:00100000:3.0:1788270125.968959:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:3.0:1788270125.968969:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2401:x1875136253274880:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270126.011120:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253274880:12345-192.168.201.42@tcp:4:dd.0 Request processed in 42139us (42583us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1788270126.011194:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00002000:00100000:2.0:1788270126.011210:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc9:0x0] (0->4194303) req@ffff98c1448f3480 x1875136253274880/t30064771127(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:541/0 lens 488/448 e 0 to 0 dl 1788270136 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270126.011221:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f3480 with x1875136253274880 ext(0->4194303) 00002000:00010000:2.0:1788270126.011228:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1448f3480 00000100:00100000:1.0:1788270126.093428:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.093596:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253275008 00000100:00100000:0.0:1788270126.093607:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253275008 00002000:00100000:0.0:1788270126.093677:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc9:0x0] (4194304->8388607) req@ffff98c1483a7100 x1875136253275008/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.093689:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a7100 with x1875136253275008 ext(4194304->8388607) 00002000:00010000:0.0:1788270126.093695:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1483a7100 00000100:00100000:0.0:1788270126.093728:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:0.0:1788270126.093739:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2402:x1875136253275008:12345-192.168.201.42@tcp:4:dd.0 00000100:00080000:2.0:1788270126.094218:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270126.139498:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253275008:12345-192.168.201.42@tcp:4:dd.0 Request processed in 45748us (46067us total) trans 30064771128 rc 0/0 00000100:00100000:0.0:1788270126.139512:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00002000:00100000:0.0:1788270126.139526:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc9:0x0] (4194304->8388607) req@ffff98c1483a7100 x1875136253275008/t30064771128(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/448 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.139537:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1483a7100 with x1875136253275008 ext(4194304->8388607) 00002000:00010000:0.0:1788270126.139543:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1483a7100 00000100:00100000:2.0:1788270126.200994:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.201094:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253275136 00000100:00100000:0.0:1788270126.201104:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253275136 00002000:00100000:0.0:1788270126.201176:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (8388608->12582911) req@ffff98c1448f0e00 x1875136253275136/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.201187:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f0e00 with x1875136253275136 ext(8388608->12582911) 00002000:00010000:0.0:1788270126.201193:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1448f0e00 00000100:00100000:0.0:1788270126.201287:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:0.0:1788270126.201298:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253275136:12345-192.168.201.42@tcp:4:dd.0 00000040:00080000:2.0:1788270126.212302:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270126.212315:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270126.212859:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 9 00000040:00080000:2.0:1788270126.212871:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270126.262345:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2403:x1875136253275136:12345-192.168.201.42@tcp:4:dd.0 Request processed in 61038us (61348us total) trans 30064771129 rc 0/0 00000100:00100000:1.0:1788270126.262359:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00002000:00100000:1.0:1788270126.262372:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (8388608->12582911) req@ffff98c1448f0e00 x1875136253275136/t30064771129(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/448 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270126.262380:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1448f0e00 with x1875136253275136 ext(8388608->12582911) 00002000:00010000:1.0:1788270126.262386:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1448f0e00 00000100:00100000:0.0:1788270126.315342:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270126.316241:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253275392 00000100:00100000:2.0:1788270126.316252:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253275392 00000100:00100000:2.0:1788270126.316333:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:2.0:1788270126.316345:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:40437:x1875136253275392:12345-192.168.201.42@tcp:35:dd.0 00000100:00080000:0.0:1788270126.316363:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270126.316648:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:40437:x1875136253275392:12345-192.168.201.42@tcp:35:dd.0 Request processed in 305us (1316us total) trans 30064771366 rc 0/0 00000100:00100000:2.0:1788270126.316656:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:2.0:1788270126.352897:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.352969:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253275520 00000100:00100000:0.0:1788270126.352979:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253275520 00000100:00100000:0.0:1788270126.353345:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 434 00000100:00100000:0.0:1788270126.353355:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:40438:x1875136253275520:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270126.353377:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.353409:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a463 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fb3 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.353449:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a46a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.353459:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a46a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.353472:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a46a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.353583:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a463 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fb3 expref: 41 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.353605:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0400/0xc5f5d7a016e0a46a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fb3 expref: 40 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.353615:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270126.353618:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270126.353621:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0400, rc 0) 00000100:00100000:0.0:1788270126.353680:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:40438:x1875136253275520:12345-192.168.201.42@tcp:101:chown.0 Request processed in 327us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270126.353685:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 434 00000100:00100000:0.0:1788270126.359610:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.359731:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253275776 00000100:00100000:3.0:1788270126.359742:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253275776 00000100:00100000:3.0:1788270126.359809:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 435 00000100:00100000:3.0:1788270126.359820:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:40438:x1875136253275776:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:3.0:1788270126.359877:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270126.359906:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a424 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f97 expref: 40 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.359928:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:3.0:1788270126.359933:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270126.359962:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.359976:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.359987:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270126.360387:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].10, 88 off9000 00000004:00080000:3.0:1788270126.360398:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 918067357963ns, next at 919067355328ns, rc = 0 00000004:00010000:3.0:1788270126.360445:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000334d8bab reply state 000000007f39f8f4 transno 30064771367 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.360458:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.360465:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:3.0:1788270126.360468:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788270126.360471:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270126.360627:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:40438:x1875136253275776:12345-192.168.201.42@tcp:36:chown.0 Request processed in 808us (1026us total) trans 30064771367 rc 0/0 00000100:00100000:3.0:1788270126.360635:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 435 00000100:00100000:1.0:1788270126.363981:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270126.364068:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253275904 00000100:00100000:2.0:1788270126.364078:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253275904 00000100:00100000:0.0:1788270126.364208:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 436 00000100:00100000:0.0:1788270126.364222:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:40438:x1875136253275904:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270126.364247:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.364268:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a478 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fba expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.364332:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a478 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fba expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.364347:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a478 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fba expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.364366:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270126.364369:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270126.364373:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1c00, rc 0) 00000100:00100000:0.0:1788270126.364435:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:40438:x1875136253275904:12345-192.168.201.42@tcp:101:chown.0 Request processed in 217us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270126.364442:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 436 00000100:00100000:2.0:1788270126.368450:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.368589:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276032 00000100:00100000:3.0:1788270126.368600:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276032 00000100:00100000:3.0:1788270126.368680:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788270126.368690:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253276032:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:3.0:1788270126.368845:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:3.0:1788270126.368849:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb mtime from disk: 0 -> 1788270126 00002000:00010000:3.0:1788270126.368851:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270126.368853:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb ctime from disk: 0 -> 1788270126 00002000:00010000:3.0:1788270126.368856:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00080000:0.0:1788270126.368875:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270126.368922:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253276032:12345-192.168.201.42@tcp:2:chown.0 Request processed in 233us (480us total) trans 30064771153 rc 0/0 00000100:00100000:3.0:1788270126.368930:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:2.0:1788270126.397071:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.397350:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276160 00000100:00100000:0.0:1788270126.397361:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276160 00000100:00100000:0.0:1788270126.397424:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 437 00000100:00100000:0.0:1788270126.397435:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:40439:x1875136253276160:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270126.397455:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.397476:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a47f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fc1 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.397513:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a486 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.397526:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a486 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.397537:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a486 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.397650:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a47f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fc1 expref: 44 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.397680:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1600/0xc5f5d7a016e0a486 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fc1 expref: 43 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.397690:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.397692:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270126.397697:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f1600, rc 0) 00000100:00100000:0.0:1788270126.397836:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:40439:x1875136253276160:12345-192.168.201.42@tcp:101:chown.0 Request processed in 403us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270126.397844:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 437 00000100:00100000:0.0:1788270126.405370:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.405514:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276416 00000100:00100000:3.0:1788270126.405525:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276416 00000100:00100000:3.0:1788270126.405587:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 438 00000100:00100000:3.0:1788270126.405598:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:40439:x1875136253276416:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:3.0:1788270126.405653:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270126.405682:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a44e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fa5 expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.405703:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:3.0:1788270126.405708:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270126.405738:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.405751:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.405761:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270126.405958:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].12, 88 off9080 00000004:00080000:3.0:1788270126.405969:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 918112929083ns, next at 919112926589ns, rc = 0 00000004:00010000:3.0:1788270126.406030:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d89cb70 reply state 00000000604c6bfd transno 30064771368 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.406092:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.406099:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:3.0:1788270126.406103:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788270126.406105:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270126.406406:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:40439:x1875136253276416:12345-192.168.201.42@tcp:36:chown.0 Request processed in 808us (1045us total) trans 30064771368 rc 0/0 00000100:00100000:3.0:1788270126.406413:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 438 00000100:00100000:2.0:1788270126.412134:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.412244:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276544 00000100:00100000:0.0:1788270126.412254:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276544 00000100:00100000:0.0:1788270126.412309:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 439 00000100:00100000:0.0:1788270126.412318:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:40439:x1875136253276544:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270126.412341:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.412362:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a494 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fc8 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.412419:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a494 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fc8 expref: 45 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.412442:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a494 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fc8 expref: 45 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.412460:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.412462:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270126.412466:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1410f0c00, rc 0) 00000100:00100000:0.0:1788270126.412520:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:40439:x1875136253276544:12345-192.168.201.42@tcp:101:chown.0 Request processed in 203us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270126.412527:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 439 00000100:00100000:0.0:1788270126.415881:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270126.415939:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276672 00000100:00100000:2.0:1788270126.415947:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276672 00000100:00100000:2.0:1788270126.415995:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:2.0:1788270126.416002:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2402:x1875136253276672:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:2.0:1788270126.416194:0:47281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:2.0:1788270126.416198:0:47281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb mtime from disk: 0 -> 1788270126 00002000:00010000:2.0:1788270126.416201:0:47281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788270126.416203:0:47281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb ctime from disk: 0 -> 1788270126 00002000:00010000:2.0:1788270126.416205:0:47281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb blocks from disk: 0 -> 24576 00000100:00100000:2.0:1788270126.416270:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2402:x1875136253276672:12345-192.168.201.42@tcp:2:chown.0 Request processed in 267us (396us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1788270126.416277:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788270126.511693:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.511762:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276800 00000100:00100000:0.0:1788270126.511773:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276800 00000100:00100000:0.0:1788270126.511856:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 440 00000100:00100000:0.0:1788270126.511868:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:40445:x1875136253276800:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270126.511892:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.511913:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a49b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fcf expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.512005:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995000/0xc5f5d7a016e0a4a2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.512020:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995000/0xc5f5d7a016e0a4a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.512201:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995000/0xc5f5d7a016e0a4a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270126.512264:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 4096 00000004:00200000:0.0:1788270126.512268:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270126.512289:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995000/0xc5f5d7a016e0a4a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.512320:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0e00/0xc5f5d7a016e0a49b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fcf expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.512352:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995000/0xc5f5d7a016e0a4a2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fcf expref: 46 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.512371:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:0.0:1788270126.512374:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270126.512377:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151995000, rc 0) 00000100:00100000:0.0:1788270126.512517:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:40445:x1875136253276800:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 651us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270126.512526:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 440 00000100:00100000:3.0:1788270126.516694:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270126.516795:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253276928 00000100:00100000:2.0:1788270126.516811:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253276928 00000100:00100000:2.0:1788270126.516888:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 441 00000100:00100000:2.0:1788270126.516901:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:40445:x1875136253276928:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270126.516921:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270126.516945:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0a4a9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fd6 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517012:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517835:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517852:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517868:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517877:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517883:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517964:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517973:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.517980:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270126.518014:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00000004:00200000:2.0:1788270126.518018:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270126.518036:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518072:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518081:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518088:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518098:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518104:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518110:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270126.518125:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518133:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518144:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:2.0:1788270126.518147:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270126.518152:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518157:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b400/0xc5f5d7a016e0a4b0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518171:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518176:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518182:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518187:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19a600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270126.518190:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518196:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518203:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff98c1429fd300) 00010000:00010000:2.0:1788270126.518206:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270126.518209:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518214:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a600/0xc5f5d7a016e0a4b7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518241:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19a800/0xc5f5d7a016e0a4a9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fd6 expref: 48 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518267:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fd6 expref: 47 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270126.518276:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:2.0:1788270126.518278:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270126.518281:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27c19ba00, rc 0) 00000100:00100000:2.0:1788270126.518358:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:40445:x1875136253276928:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 1459us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270126.518366:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 441 00000100:00100000:2.0:1788270126.525910:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.525996:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253277184 00000100:00100000:3.0:1788270126.526013:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253277184 00000100:00100000:3.0:1788270126.526142:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 442 00000100:00100000:3.0:1788270126.526154:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:40445:x1875136253277184:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:3.0:1788270126.526179:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270126.526206:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40400/0xc5f5d7a016e0a4c5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fdd expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.526340:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40000/0xc5f5d7a016e0a4cc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.526357:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40000/0xc5f5d7a016e0a4cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.526370:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40000/0xc5f5d7a016e0a4cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270126.526383:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:3.0:1788270126.526592:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40400/0xc5f5d7a016e0a4c5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fdd expref: 50 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.526611:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40000/0xc5f5d7a016e0a4cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fdd expref: 49 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270126.526627:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:3.0:1788270126.526630:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270126.526634:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14fb40000, rc 0) 00000100:00100000:3.0:1788270126.526715:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:40445:x1875136253277184:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 564us (816us total) trans 30064771369 rc 0/0 00000100:00100000:3.0:1788270126.526722:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 442 00000100:00100000:3.0:1788270126.530682:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.530840:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253277440 00000100:00100000:0.0:1788270126.530855:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253277440 00000100:00100000:0.0:1788270126.530935:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 443 00000100:00100000:0.0:1788270126.530948:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:40445:x1875136253277440:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270126.530983:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.530987:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1788270126.531024:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f1c00/0xc5f5d7a016e0a478 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fba expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531102:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40000/0xc5f5d7a016e0a4cc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fdd expref: 48 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531136:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19ba00/0xc5f5d7a016e0a4be lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fd6 expref: 47 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531149:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270126.531154:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270126.531171:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994000/0xc5f5d7a016e0a4da lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101fe4 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531221:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531235:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531246:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531263:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531269:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531276:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531282:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151995a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270126.531286:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531294:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531302:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270126.531305:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270126.531309:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531316:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995a00/0xc5f5d7a016e0a4e1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531340:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994600/0xc5f5d7a016e0a4e8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531347:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994600/0xc5f5d7a016e0a4e8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531354:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994600/0xc5f5d7a016e0a4e8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531557:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994600/0xc5f5d7a016e0a4e8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fe4 expref: 49 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531565:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270126.531567:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270126.531577:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994000/0xc5f5d7a016e0a4da lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fe4 expref: 49 pid: 48110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531589:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994600/0xc5f5d7a016e0a4e8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fe4 expref: 48 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.531627:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270126.531630:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270126.531632:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151994600, rc 0) 00000100:00100000:0.0:1788270126.531715:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:40445:x1875136253277440:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 770us (1048us total) trans 30064771370 rc 0/0 00000100:00100000:0.0:1788270126.531723:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 443 00010000:00010000:1.0:1788270126.532546:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270126.540618:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270126.541082:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253277568 00000100:00100000:1.0:1788270126.541102:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253277568 00002000:00100000:1.0:1788270126.541193:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (12582912->15728639) req@ffff98c27fb70a80 x1875136253277568/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270126.541208:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb70a80 with x1875136253277568 ext(12582912->15728639) 00002000:00010000:1.0:1788270126.541216:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb70a80 00000100:00100000:1.0:1788270126.541261:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788270126.541274:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253277568:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270126.572780:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253277568:12345-192.168.201.42@tcp:4:dd.0 Request processed in 31491us (32156us total) trans 30064771154 rc 0/0 00000100:00100000:1.0:1788270126.572797:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00002000:00100000:1.0:1788270126.572817:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (12582912->15728639) req@ffff98c27fb70a80 x1875136253277568/t30064771154(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/448 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270126.572828:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb70a80 with x1875136253277568 ext(12582912->15728639) 00002000:00010000:1.0:1788270126.572836:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27fb70a80 00000100:00100000:0.0:1788270126.589261:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.589324:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253277696 00000100:00100000:3.0:1788270126.589340:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253277696 00002000:00100000:3.0:1788270126.589411:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc8:0x0] (0->1048575) req@ffff98c1494a5880 x1875136253277696/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270126.589424:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1494a5880 with x1875136253277696 ext(0->1048575) 00002000:00010000:3.0:1788270126.589432:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1494a5880 00000100:00100000:3.0:1788270126.589478:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:3.0:1788270126.589490:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253277696:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:2.0:1788270126.608614:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253277696:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 19110us (19350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788270126.608634:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00002000:00100000:2.0:1788270126.608650:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc8:0x0] (0->1048575) req@ffff98c1494a5880 x1875136253277696/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/440 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270126.608661:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1494a5880 with x1875136253277696 ext(0->1048575) 00002000:00010000:2.0:1788270126.608669:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1494a5880 00000100:00100000:0.0:1788270126.632392:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270126.632520:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253277824 00000100:00100000:2.0:1788270126.632533:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253277824 00002000:00100000:2.0:1788270126.632594:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc8:0x0] (1048576->4194303) req@ffff98c1494a5f80 x1875136253277824/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270126.632616:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1494a5f80 with x1875136253277824 ext(1048576->4194303) 00002000:00010000:2.0:1788270126.632623:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1494a5f80 00000100:00100000:2.0:1788270126.632657:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788270126.632668:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253277824:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:2.0:1788270126.654853:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253277824:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 22169us (22460us total) trans 0 rc 3145728/3145728 00000100:00100000:2.0:1788270126.654872:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00002000:00100000:2.0:1788270126.654891:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc8:0x0] (1048576->4194303) req@ffff98c1494a5f80 x1875136253277824/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/440 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270126.654903:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1494a5f80 with x1875136253277824 ext(1048576->4194303) 00002000:00010000:2.0:1788270126.654911:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1494a5f80 00000100:00100000:3.0:1788270126.738212:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.738327:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.738378:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.738449:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253277952 00000100:00100000:0.0:1788270126.738464:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253277952 00002000:00100000:0.0:1788270126.738527:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (4194304->8388607) req@ffff98c147209880 x1875136253277952/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.738540:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c147209880 with x1875136253277952 ext(4194304->8388607) 00002000:00010000:0.0:1788270126.738546:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c147209880 00000100:00100000:0.0:1788270126.738586:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253278080 00000100:00100000:0.0:1788270126.738591:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253278080 00002000:00100000:0.0:1788270126.738607:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (8388608->12582911) req@ffff98c14720b800 x1875136253278080/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.738615:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720b800 with x1875136253278080 ext(8388608->12582911) 00002000:00010000:0.0:1788270126.738619:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720b800 00000100:00100000:0.0:1788270126.738625:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253278208 00000100:00100000:0.0:1788270126.738627:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253278208 00002000:00100000:0.0:1788270126.738638:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (12582912->15728639) req@ffff98c14720aa00 x1875136253278208/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.738646:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720aa00 with x1875136253278208 ext(12582912->15728639) 00002000:00010000:0.0:1788270126.738649:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720aa00 00000100:00100000:0.0:1788270126.738661:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:0.0:1788270126.738672:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2400:x1875136253277952:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270126.738914:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:1.0:1788270126.738926:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253278080:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270126.777419:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+24:2400:x1875136253277952:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 38729us (41577us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1788270126.777436:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00002000:00100000:0.0:1788270126.777454:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (4194304->8388607) req@ffff98c147209880 x1875136253277952/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/440 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.777465:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c147209880 with x1875136253277952 ext(4194304->8388607) 00002000:00010000:0.0:1788270126.777473:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c147209880 00000100:00100000:0.0:1788270126.777529:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788270126.777544:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253278208:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270126.790429:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270126.790461:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262674432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270126.790625:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270126.790740:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674432 00000100:00100000:2.0:1788270126.790750:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674432 00000100:00100000:2.0:1788270126.790822:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788270126.790833:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262674432:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788270126.791102:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788270126.791201:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 144891584 pending 12656640 free 3853242368 avail 3621720064 00000100:00100000:2.0:1788270126.791329:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262674432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 496us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270126.791336:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788270126.791428:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262674432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270126.812774:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253278080:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 73823us (74425us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1788270126.812797:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00002000:00100000:2.0:1788270126.813017:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc8:0x0] (8388608->12582911) req@ffff98c14720b800 x1875136253278080/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/440 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270126.813032:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720b800 with x1875136253278080 ext(8388608->12582911) 00002000:00010000:2.0:1788270126.813063:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720b800 00000100:00100000:0.0:1788270126.830750:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253278208:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 53196us (92355us total) trans 0 rc 3145728/3145728 00000100:00100000:0.0:1788270126.830772:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00002000:00100000:0.0:1788270126.830789:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc8:0x0] (12582912->15728639) req@ffff98c14720aa00 x1875136253278208/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/440 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270126.830801:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14720aa00 with x1875136253278208 ext(12582912->15728639) 00002000:00010000:0.0:1788270126.830810:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c14720aa00 00000100:00100000:1.0:1788270126.922552:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270126.922671:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253278464 00000100:00100000:3.0:1788270126.922684:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253278464 00000100:00100000:3.0:1788270126.922785:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:3.0:1788270126.922798:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:40445:x1875136253278464:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:3.0:1788270126.923224:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:40445:x1875136253278464:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 426us (687us total) trans 30064771371 rc 0/0 00000100:00100000:3.0:1788270126.923237:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:1.0:1788270126.961624:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.961743:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253278592 00000100:00100000:0.0:1788270126.961754:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253278592 00000100:00100000:0.0:1788270126.961844:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 444 00000100:00100000:0.0:1788270126.961854:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:40451:x1875136253278592:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270126.961882:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.961905:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995c00/0xc5f5d7a016e0a4ef lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101feb expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.961978:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.961992:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962002:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962011:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962016:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962023:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962175:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962182:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962187:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270126.962224:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00000004:00200000:0.0:1788270126.962228:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270126.962245:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962256:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962263:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962268:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962272:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962276:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151995e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270126.962279:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962286:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962296:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:0.0:1788270126.962298:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270126.962302:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962306:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a4f6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962316:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962320:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962324:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962327:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151995200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270126.962328:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962331:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962335:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff98c24a952b00) 00010000:00010000:0.0:1788270126.962336:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270126.962337:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962342:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a4fd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962362:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995c00/0xc5f5d7a016e0a4ef lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101feb expref: 51 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962371:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101feb expref: 50 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.962376:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.962377:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270126.962379:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151994800, rc 0) 00000100:00100000:0.0:1788270126.962509:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:40451:x1875136253278592:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 654us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270126.962516:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 444 00000100:00100000:2.0:1788270126.969771:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.969852:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253278848 00000100:00100000:0.0:1788270126.969865:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253278848 00000100:00100000:0.0:1788270126.969928:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 445 00000100:00100000:0.0:1788270126.969938:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:40451:x1875136253278848:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270126.969962:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.969985:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994e00/0xc5f5d7a016e0a50b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ff2 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.970159:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995400/0xc5f5d7a016e0a512 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.970176:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995400/0xc5f5d7a016e0a512 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.970188:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995400/0xc5f5d7a016e0a512 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270126.970199:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:0.0:1788270126.970326:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994e00/0xc5f5d7a016e0a50b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ff2 expref: 53 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.970348:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995400/0xc5f5d7a016e0a512 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ff2 expref: 52 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.970356:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.970358:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270126.970362:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151995400, rc 0) 00000100:00100000:0.0:1788270126.970457:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:40451:x1875136253278848:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 518us (697us total) trans 30064771372 rc 0/0 00000100:00100000:0.0:1788270126.970465:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 445 00000100:00100000:1.0:1788270126.973821:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270126.974102:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279104 00000100:00100000:0.0:1788270126.974131:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279104 00000100:00100000:0.0:1788270126.974205:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 446 00000100:00100000:0.0:1788270126.974218:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:40451:x1875136253279104:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:0.0:1788270126.974252:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270126.974256:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1788270126.974293:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0c00/0xc5f5d7a016e0a494 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101fc8 expref: 52 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974322:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995400/0xc5f5d7a016e0a512 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ff2 expref: 51 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974337:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151994800/0xc5f5d7a016e0a504 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101feb expref: 50 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974349:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.974354:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270126.974371:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995c00/0xc5f5d7a016e0a520 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656101ff9 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974420:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974434:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974445:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974462:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974469:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974476:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974482:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151995200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270126.974488:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974501:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974510:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.974513:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270126.974517:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974667:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995200/0xc5f5d7a016e0a527 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974695:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a52e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974706:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a52e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x21:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974715:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a52e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x21:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974903:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a52e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ff9 expref: 52 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974913:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.974915:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270126.974925:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995c00/0xc5f5d7a016e0a520 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ff9 expref: 52 pid: 48110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974940:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151995e00/0xc5f5d7a016e0a52e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101ff9 expref: 51 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270126.974974:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270126.974977:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270126.974979:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151995e00, rc 0) 00000100:00100000:0.0:1788270126.975168:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:40451:x1875136253279104:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 950us (1359us total) trans 30064771373 rc 0/0 00000100:00100000:0.0:1788270126.975179:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 446 00000100:00100000:1.0:1788270126.985197:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270126.985354:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279232 00000100:00100000:2.0:1788270126.985368:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279232 00002000:00100000:2.0:1788270126.985430:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc9:0x0] (12582912->15728639) req@ffff98c25ef77100 x1875136253279232/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/0 e 0 to 0 dl 1788270137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270126.985441:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef77100 with x1875136253279232 ext(12582912->15728639) 00002000:00010000:2.0:1788270126.985457:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c25ef77100 00000100:00100000:2.0:1788270126.985488:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:2.0:1788270126.985497:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253279232:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270127.021180:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253279232:12345-192.168.201.42@tcp:4:dd.0 Request processed in 35666us (35983us total) trans 30064771131 rc 0/0 00000100:00100000:0.0:1788270127.021199:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00002000:00100000:0.0:1788270127.021216:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xc9:0x0] (12582912->15728639) req@ffff98c25ef77100 x1875136253279232/t30064771131(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:542/0 lens 488/448 e 0 to 0 dl 1788270137 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270127.021228:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef77100 with x1875136253279232 ext(12582912->15728639) 00002000:00010000:0.0:1788270127.021236:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c25ef77100 00000100:00100000:1.0:1788270127.043541:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.043665:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279360 00000100:00100000:2.0:1788270127.043680:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279360 00002000:00100000:2.0:1788270127.043747:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (0->1048575) req@ffff98c25ef76300 x1875136253279360/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/0 e 0 to 0 dl 1788270138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270127.043767:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef76300 with x1875136253279360 ext(0->1048575) 00002000:00010000:2.0:1788270127.043773:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c25ef76300 00000100:00100000:2.0:1788270127.043816:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:2.0:1788270127.043828:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253279360:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270127.054495:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253279360:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 10652us (10953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788270127.054514:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00002000:00100000:1.0:1788270127.054538:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (0->1048575) req@ffff98c25ef76300 x1875136253279360/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/440 e 0 to 0 dl 1788270138 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270127.054547:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c25ef76300 with x1875136253279360 ext(0->1048575) 00002000:00010000:1.0:1788270127.054554:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c25ef76300 00000100:00100000:2.0:1788270127.072977:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270127.073198:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279488 00000100:00100000:3.0:1788270127.073211:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279488 00002000:00100000:3.0:1788270127.073283:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc9:0x0] (1048576->4194303) req@ffff98c1451c1180 x1875136253279488/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/0 e 0 to 0 dl 1788270138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270127.073297:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c1180 with x1875136253279488 ext(1048576->4194303) 00002000:00010000:3.0:1788270127.073304:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c1180 00000100:00100000:3.0:1788270127.073348:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788270127.073360:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253279488:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:0.0:1788270127.097382:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253279488:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 24008us (24405us total) trans 0 rc 3145728/3145728 00000100:00100000:0.0:1788270127.097398:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00002000:00100000:0.0:1788270127.097415:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc9:0x0] (1048576->4194303) req@ffff98c1451c1180 x1875136253279488/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/440 e 0 to 0 dl 1788270138 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270127.097428:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c1180 with x1875136253279488 ext(1048576->4194303) 00002000:00010000:0.0:1788270127.097436:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c1180 00000100:00100000:2.0:1788270127.148959:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.149099:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.149330:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270127.149383:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279616 00000100:00100000:0.0:1788270127.149398:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279616 00002000:00100000:0.0:1788270127.149533:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc9:0x0] (4194304->8388607) req@ffff98c1451c0e00 x1875136253279616/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/0 e 0 to 0 dl 1788270138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270127.149547:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c0e00 with x1875136253279616 ext(4194304->8388607) 00002000:00010000:0.0:1788270127.149554:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c0e00 00000100:00100000:0.0:1788270127.149631:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279744 00000100:00100000:0.0:1788270127.149636:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279744 00002000:00100000:0.0:1788270127.149653:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xc9:0x0] (8388608->12582911) req@ffff98c1451c2300 x1875136253279744/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/0 e 0 to 0 dl 1788270138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270127.149661:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c2300 with x1875136253279744 ext(8388608->12582911) 00002000:00010000:0.0:1788270127.149664:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c2300 00000100:00100000:1.0:1788270127.149834:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253279872 00000100:00100000:1.0:1788270127.149839:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253279872 00002000:00100000:1.0:1788270127.149863:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (12582912->15728639) req@ffff98c1451c1500 x1875136253279872/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/0 e 0 to 0 dl 1788270138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270127.149871:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c1500 with x1875136253279872 ext(12582912->15728639) 00002000:00010000:1.0:1788270127.149875:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c1500 00000100:00100000:1.0:1788270127.149890:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788270127.149899:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253279616:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270127.152605:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:1.0:1788270127.152630:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253279744:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:2.0:1788270127.191347:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253279616:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 41433us (42387us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1788270127.191364:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00002000:00100000:2.0:1788270127.191383:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (4194304->8388607) req@ffff98c1451c0e00 x1875136253279616/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/440 e 0 to 0 dl 1788270138 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270127.191395:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c0e00 with x1875136253279616 ext(4194304->8388607) 00002000:00010000:2.0:1788270127.191403:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c0e00 00000100:00100000:2.0:1788270127.191453:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:2.0:1788270127.191467:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253279872:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:1.0:1788270127.231296:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.231375:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253280128 00000100:00100000:2.0:1788270127.231389:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253280128 00000100:00100000:2.0:1788270127.231470:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:2.0:1788270127.231483:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:40451:x1875136253280128:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:2.0:1788270127.231773:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:40451:x1875136253280128:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 292us (492us total) trans 30064771374 rc 0/0 00000100:00100000:2.0:1788270127.231786:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:0.0:1788270127.244565:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253279744:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 91928us (95449us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1788270127.244583:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00002000:00100000:0.0:1788270127.244599:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc9:0x0] (8388608->12582911) req@ffff98c1451c2300 x1875136253279744/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/440 e 0 to 0 dl 1788270138 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270127.244611:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c2300 with x1875136253279744 ext(8388608->12582911) 00002000:00010000:0.0:1788270127.244617:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c2300 00000100:00100000:2.0:1788270127.252567:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253279872:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 61090us (103222us total) trans 0 rc 3145728/3145728 00000100:00100000:2.0:1788270127.252584:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00002000:00100000:2.0:1788270127.252600:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xc9:0x0] (12582912->15728639) req@ffff98c1451c1500 x1875136253279872/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:543/0 lens 488/440 e 0 to 0 dl 1788270138 ref 1 fl Complete:/600/0 rc 3145728/3145728 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270127.252612:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1451c1500 with x1875136253279872 ext(12582912->15728639) 00002000:00010000:2.0:1788270127.252620:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1451c1500 00000100:00100000:1.0:1788270127.301382:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262674560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270127.301508:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270127.302077:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674560 00000100:00100000:2.0:1788270127.302089:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674560 00000100:00100000:2.0:1788270127.302169:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788270127.302182:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262674560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270127.302228:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:2.0:1788270127.302346:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262674560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270127.302355:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788270127.303414:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270127.303986:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253280384 00000100:00100000:0.0:1788270127.303997:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253280384 00000100:00100000:0.0:1788270127.304121:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 447 00000100:00100000:0.0:1788270127.304132:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:40461:x1875136253280384:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270127.304165:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270127.304193:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102000 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270127.304320:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 4096 00010000:00010000:0.0:1788270127.304443:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a535 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102000 expref: 54 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.304462:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270127.304465:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270127.304472:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102000 expref: 54 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.304488:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151ef1c00, rc 0) 00000100:00100000:1.0:1788270127.304500:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262674560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270127.304545:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:40461:x1875136253280384:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 415us (1138us total) trans 30064771375 rc 301/301 00000100:00100000:0.0:1788270127.304552:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 447 00000100:00100000:0.0:1788270127.307493:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.307585:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253280512 00000100:00100000:2.0:1788270127.307598:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253280512 00000100:00100000:2.0:1788270127.307665:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 448 00000100:00100000:2.0:1788270127.307676:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:40461:x1875136253280512:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270127.307794:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307815:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307836:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307849:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307857:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307864:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307970:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307981:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.307989:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270127.308069:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308088:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308095:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308117:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308129:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308136:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1519bdc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270127.308142:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308151:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308166:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:2.0:1788270127.308169:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270127.308175:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308182:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a543 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308197:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308204:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308211:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.308216:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1519bde00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270127.308219:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309918:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309941:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff98c1429fd300) 00010000:00010000:2.0:1788270127.309943:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270127.309947:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309952:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a54a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309968:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309973:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309977:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309981:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1519bd200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270127.309983:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309986:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.309990:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:2.0:1788270127.309992:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270127.309993:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.310001:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a551 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270127.310133:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:40461:x1875136253280512:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 2454us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270127.310144:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 448 00000100:00100000:1.0:1788270127.312450:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270127.312564:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253280768 00000100:00100000:3.0:1788270127.312576:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253280768 00000100:00100000:3.0:1788270127.312628:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:3.0:1788270127.312636:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:40461:x1875136253280768:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270127.312936:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:40461:x1875136253280768:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 298us (493us total) trans 30064771376 rc 0/0 00000100:00100000:3.0:1788270127.312944:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:3.0:1788270127.373420:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270127.373690:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253281024 00000100:00100000:0.0:1788270127.373704:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253281024 00000100:00100000:0.0:1788270127.373782:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 449 00000100:00100000:0.0:1788270127.373795:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:40471:x1875136253281024:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270127.373827:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270127.373856:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102007 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.374001:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0c00/0xc5f5d7a016e0a55f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.374020:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0c00/0xc5f5d7a016e0a55f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.374515:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0c00/0xc5f5d7a016e0a55f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270127.374539:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 4096 00010000:00010000:0.0:1788270127.374667:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102007 expref: 57 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.374687:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0c00/0xc5f5d7a016e0a55f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102007 expref: 56 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.374697:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:0.0:1788270127.374700:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788270127.374704:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151ef0c00, rc 0) 00000100:00100000:0.0:1788270127.374784:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:40471:x1875136253281024:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 991us (2277us total) trans 30064771377 rc 0/0 00000100:00100000:0.0:1788270127.374792:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 449 00000100:00100000:1.0:1788270127.378930:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270127.381948:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253281152 00000100:00100000:0.0:1788270127.381973:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253281152 00000100:00100000:0.0:1788270127.382198:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 450 00000100:00100000:0.0:1788270127.382214:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:40471:x1875136253281152:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788270127.382326:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382347:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382361:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382373:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382381:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382389:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382491:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382499:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382505:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270127.382573:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382587:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382594:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382600:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382605:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151ef1c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270127.382609:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382616:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382629:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:0.0:1788270127.382632:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270127.382637:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382642:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1c00/0xc5f5d7a016e0a56d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382654:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382660:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382664:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382668:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151ef0600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270127.382670:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382674:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382680:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff98c24a952b00) 00010000:00010000:0.0:1788270127.382682:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270127.382684:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382689:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a574 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382701:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382707:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382712:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382717:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151ef1a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270127.382719:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382725:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382731:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:0.0:1788270127.382734:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270127.382737:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.382743:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a57b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270127.382850:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:40471:x1875136253281152:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 640us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270127.382859:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 450 00000100:00100000:1.0:1788270127.442764:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.442885:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253281280 00000100:00100000:2.0:1788270127.442909:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253281280 00000100:00100000:2.0:1788270127.442992:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 451 00000100:00100000:2.0:1788270127.443006:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:40477:x1875136253281280:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270127.443033:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270127.443117:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a582 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610200e expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443204:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443223:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443236:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443247:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443254:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443265:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443354:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bc800/0xc5f5d7a016e0a597 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443362:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bc800/0xc5f5d7a016e0a597 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443368:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bc800/0xc5f5d7a016e0a597 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270127.443416:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00000004:00200000:2.0:1788270127.443421:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270127.443441:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bc800/0xc5f5d7a016e0a597 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443454:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bc800/0xc5f5d7a016e0a597 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443464:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443472:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443478:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443486:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443496:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1519bde00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270127.443501:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443509:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443523:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:2.0:1788270127.443526:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270127.443532:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443539:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bde00/0xc5f5d7a016e0a589 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443556:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443562:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443568:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443573:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1519bdc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270127.443575:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443581:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443591:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff98c1429fd300) 00010000:00010000:2.0:1788270127.443593:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270127.443596:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443603:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bdc00/0xc5f5d7a016e0a590 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443636:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bd200/0xc5f5d7a016e0a582 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610200e expref: 58 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443651:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1519bc800/0xc5f5d7a016e0a597 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610200e expref: 57 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.443658:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:2.0:1788270127.443660:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270127.443663:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1519bc800, rc 0) 00000100:00100000:2.0:1788270127.443743:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:40477:x1875136253281280:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 740us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270127.443752:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 451 00000100:00100000:1.0:1788270127.450946:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270127.451691:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253281536 00000100:00100000:0.0:1788270127.451706:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253281536 00000100:00100000:0.0:1788270127.451833:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 452 00000100:00100000:0.0:1788270127.451856:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:40477:x1875136253281536:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270127.451882:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270127.451907:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a59e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102015 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.452082:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a5a5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.452107:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a5a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.452121:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a5a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270127.452135:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:0.0:1788270127.452275:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1a00/0xc5f5d7a016e0a59e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102015 expref: 60 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.452296:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a5a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102015 expref: 59 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270127.452305:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:0.0:1788270127.452308:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270127.452313:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151ef0600, rc 0) 00000100:00100000:0.0:1788270127.452390:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:40477:x1875136253281536:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 537us (1456us total) trans 30064771378 rc 0/0 00000100:00100000:0.0:1788270127.452397:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 452 00000100:00100000:1.0:1788270127.455795:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270127.455896:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270127.456191:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253281664 00000100:00100000:2.0:1788270127.456203:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253281664 00000100:00100000:2.0:1788270127.456283:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:2.0:1788270127.456295:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:2402:x1875136253281664:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270127.456313:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270127.456345:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0600/0xc5f5d7a016e0a5a5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102015 expref: 59 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270127.456374:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:2.0:1788270127.456380:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270127.456448:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:2402:x1875136253281664:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 155us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270127.456455:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788270127.457197:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253281920 00000100:00100000:0.0:1788270127.457205:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253281920 00000100:00100000:0.0:1788270127.457247:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:0.0:1788270127.457262:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:40477:x1875136253281920:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270127.458008:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:40477:x1875136253281920:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 751us (2109us total) trans 30064771379 rc 0/0 00000100:00100000:0.0:1788270127.458014:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00010000:00010000:0.0:1788270127.556484:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270128.584228:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270128.837644:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270128.837659:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270128.837688:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:2.0:1788270128.837701:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788270129.287237:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270129.287251:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270129.287396:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 9 count 6 00000040:00080000:3.0:1788270129.287404:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270129.354298:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262674688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270129.354399:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270129.354495:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674688 00000100:00100000:3.0:1788270129.354506:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674688 00000100:00100000:3.0:1788270129.354562:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788270129.354572:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262674688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270129.354617:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270129.354670:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262674688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.354678:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788270129.354746:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262674688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270129.605265:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270129.667388:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667546:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667577:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667607:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667622:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667639:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667697:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270129.667732:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282176 00000100:00100000:3.0:1788270129.667744:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282176 00000100:00100000:3.0:1788270129.667820:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282688 00000100:00100000:3.0:1788270129.667823:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282688 00000100:00100000:3.0:1788270129.667839:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282304 00000100:00100000:3.0:1788270129.667841:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282304 00000100:00100000:3.0:1788270129.667856:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282816 00000100:00100000:3.0:1788270129.667858:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282816 00000100:00100000:3.0:1788270129.667878:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 156 00000100:00100000:3.0:1788270129.667890:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:2400:x1875136253282176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270129.668153:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:2400:x1875136253282176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 265us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.668164:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 156 00000100:00100000:3.0:1788270129.668189:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 157 00000100:00100000:3.0:1788270129.668197:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253282688:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270129.668225:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253282688:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.668231:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 157 00000100:00100000:3.0:1788270129.668243:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:3.0:1788270129.668250:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253282304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270129.668276:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253282304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.668283:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:3.0:1788270129.668297:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:3.0:1788270129.668304:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253282816:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270129.668329:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253282816:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.668336:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:3.0:1788270129.668366:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282432 00000100:00100000:3.0:1788270129.668370:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282432 00000100:00100000:3.0:1788270129.668402:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282560 00000100:00100000:3.0:1788270129.668405:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282560 00000100:00100000:3.0:1788270129.668429:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:3.0:1788270129.668437:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253282432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270129.668465:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253282432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.668472:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:3.0:1788270129.668485:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:3.0:1788270129.668492:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253282560:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270129.668517:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253282560:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.668522:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00080000:3.0:1788270129.668542:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270129.668546:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270129.668549:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270129.668551:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270129.668785:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282048 00000100:00100000:0.0:1788270129.668790:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282048 00000100:00100000:0.0:1788270129.668834:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:0.0:1788270129.668842:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253282048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270129.668888:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253282048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 47us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270129.668895:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:0.0:1788270129.861350:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262675200:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.861454:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270129.861532:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262675712:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.861560:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270129.861616:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262676224:0@lo:400:kworker.0 00000004:00080000:1.0:1788270129.861628:0:45803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921568586971ns, next at 922568583002ns, rc = 0 00000100:00100000:0.0:1788270129.861653:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270129.861658:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262675072:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.861676:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788270129.861685:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262674816:0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.861700:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270129.861804:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262674944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270129.861889:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675200 00000100:00100000:3.0:1788270129.861899:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675200 00000100:00100000:3.0:1788270129.861963:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675712 00000100:00100000:3.0:1788270129.861967:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675712 00000100:00100000:3.0:1788270129.861990:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675072 00000100:00100000:3.0:1788270129.861993:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675072 00000100:00100000:3.0:1788270129.862015:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788270129.862026:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262675200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.864932:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270129.864977:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262675584:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.865079:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262675328:0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.865251:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270129.865268:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262676096:0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.865303:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270129.865367:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675584 00000100:00100000:1.0:1788270129.865375:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675584 00000100:00100000:0.0:1788270129.865402:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270129.865430:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262675840:0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.865433:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788270129.865449:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262675712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.865466:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270129.865488:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262676352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.865517:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262675712:12345-0@lo:400:kworker.0 Request processed in 70us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270129.865526:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270129.865531:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788270129.865556:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788270129.865565:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262675072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.865577:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262675712:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.865616:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674816 00000100:00100000:1.0:1788270129.865617:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262675072:12345-0@lo:400:kworker.0 Request processed in 54us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270129.865623:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674816 00000100:00100000:1.0:1788270129.865627:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788270129.865645:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788270129.865653:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262675584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.865663:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788270129.865673:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262674816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.865687:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262675584:12345-0@lo:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270129.865694:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788270129.865754:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270129.865784:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262675456:0@lo:400:kworker.0 00000100:00100000:3.0:1788270129.865793:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262675200:12345-0@lo:400:kworker.0 Request processed in 3766us (4337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.865803:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788270129.865818:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270129.865833:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676224 00000100:00100000:3.0:1788270129.865838:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676224 00000100:00100000:2.0:1788270129.865843:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788270129.865868:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676096 00000100:00100000:3.0:1788270129.865873:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676096 00000100:00100000:2.0:1788270129.865873:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270129.865890:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262676480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270129.865894:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675328 00000100:00100000:3.0:1788270129.865898:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675328 00000100:00100000:2.0:1788270129.865921:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270129.865922:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675840 00000100:00100000:3.0:1788270129.865928:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675840 00000100:00100000:3.0:1788270129.865944:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676352 00000100:00100000:3.0:1788270129.865947:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676352 00000100:00100000:3.0:1788270129.865964:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675968 00000100:00100000:3.0:1788270129.865967:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675968 00000100:00100000:3.0:1788270129.865988:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788270129.865990:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262675456 00000100:00100000:2.0:1788270129.865995:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262675456 00000100:00100000:3.0:1788270129.865998:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262676224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270129.866068:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788270129.866073:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262676224:12345-0@lo:400:kworker.0 Request processed in 77us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270129.866081:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262675456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270129.866086:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788270129.866104:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788270129.866112:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262676096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270129.866130:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262675456:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270129.866138:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788270129.866249:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262675072:0@lo:400:kworker.0 00000100:00100000:3.0:1788270129.866432:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262676096:12345-0@lo:400:kworker.0 Request processed in 321us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.866440:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788270129.866443:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262675456:0@lo:400:kworker.0 00000100:00080000:2.0:1788270129.866507:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270129.866512:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270129.866515:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270129.866518:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788270129.866583:0:45801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921573542651ns, next at 922573539191ns, rc = 0 00000100:00100000:2.0:1788270129.866610:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270129.866619:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262676608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270129.866648:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270129.866675:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262674944 00000100:00100000:2.0:1788270129.866679:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262674944 00000100:00100000:2.0:1788270129.866699:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676480 00000100:00100000:2.0:1788270129.866702:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676480 00000100:00100000:2.0:1788270129.866712:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676608 00000100:00100000:2.0:1788270129.866714:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676608 00000100:00100000:2.0:1788270129.866726:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788270129.866734:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262674944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270129.866763:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8642560 granted 228347584 pending 15826944 free 3790491648 avail 3558969344 00000100:00100000:2.0:1788270129.866803:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262674944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270129.866809:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788270129.866821:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788270129.866827:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262676480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270129.866837:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8642560 granted 228347584 pending 15826944 free 3790491648 avail 3558969344 00000100:00100000:2.0:1788270129.866864:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262676480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.866870:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788270129.866875:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788270129.866884:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262675328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270129.866892:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788270129.866900:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262676608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270129.866919:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 153329344 pending 15826944 free 3850096640 avail 3618574336 00000100:00100000:3.0:1788270129.866928:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262675328:12345-0@lo:400:kworker.0 Request processed in 47us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.866936:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788270129.866954:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788270129.866964:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262676608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.866972:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262675840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270129.866973:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788270129.867010:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262676608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270129.867022:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262675840:12345-0@lo:400:kworker.0 Request processed in 52us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.867030:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788270129.867033:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262674944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270129.867084:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262676480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270129.867086:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788270129.867099:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262676352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270129.867139:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788270129.867140:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262676352:12345-0@lo:400:kworker.0 Request processed in 42us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270129.867153:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788270129.867154:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262675968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270129.867471:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262675968:12345-0@lo:400:kworker.0 Request processed in 49us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270129.867479:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788270129.867489:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262675584:0@lo:400:kworker.0 00000100:00100000:1.0:1788270129.867506:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262676096:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.867564:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262674816:12345-0@lo:400:kworker.0 Request processed in 1891us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270129.867574:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788270129.867636:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262674816:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.867650:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262675328:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.867664:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262675840:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.867675:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262676352:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.867694:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262676224:0@lo:400:kworker.0 00000100:00100000:0.0:1788270129.867709:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262675200:0@lo:400:kworker.0 00000100:00100000:3.0:1788270129.867827:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788270130.182246:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270130.182356:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253282944 00000100:00100000:0.0:1788270130.182369:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253282944 00002000:00100000:0.0:1788270130.182439:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (42811392->46137343) req@ffff98c144382300 x1875136253282944/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:546/0 lens 488/0 e 0 to 0 dl 1788270141 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270130.182452:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144382300 with x1875136253282944 ext(42811392->46137343) 00002000:00010000:0.0:1788270130.182460:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c144382300 00000100:00100000:0.0:1788270130.182502:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:0.0:1788270130.182514:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2403:x1875136253282944:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270130.224197:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2403:x1875136253282944:12345-192.168.201.42@tcp:4:dd.0 Request processed in 41670us (41946us total) trans 30064771155 rc 0/0 00000100:00100000:0.0:1788270130.224216:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00002000:00100000:0.0:1788270130.224233:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc6:0x0] (42811392->46137343) req@ffff98c144382300 x1875136253282944/t30064771155(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:546/0 lens 488/448 e 0 to 0 dl 1788270141 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270130.224244:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144382300 with x1875136253282944 ext(42811392->46137343) 00002000:00010000:0.0:1788270130.224253:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c144382300 00000001:00080000:2.0:1788270130.225022:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771154 is committed 00000001:00080000:2.0:1788270130.225290:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771149 is committed 00000020:00080000:1.0:1788270130.373207:0:46509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 25769803852 batchid updated 00000020:00080000:3.0:1788270130.373297:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 25769803852 00000004:00080000:3.0:1788270130.373365:0:46534:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98c1437a8b40 with version 10 00000020:00080000:3.0:1788270130.373385:0:46534:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 25769803852 cancel update log [0x2000032e2:0x1:0x0].2: rc = 0 00000004:00080000:0.0:1788270130.373447:0:46515:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98c143a46480 version 10 rpc_version 10 00000020:00080000:3.0:1788270130.373456:0:46534:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 25769803852 cancel update log [0x2400032e1:0x1:0x0].2: rc = 0 00000020:00080000:3.0:1788270130.373466:0:46534:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 25769803852 00000020:00100000:0.0:1788270130.373524:0:46515:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788270130.373537:0:46515:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98c27a62e300 x1875136262676864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788270130.373563:0:46515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262676864:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788270130.373724:0:46515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270130.373760:0:46515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2752c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270130.373769:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676864 00000100:00100000:2.0:1788270130.373778:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676864 00000001:00080000:1.0:1788270130.373798:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771131 is committed 00000001:00080000:1.0:1788270130.373830:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771126 is committed 00000100:00100000:2.0:1788270130.373839:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788270130.373849:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:46515:x1875136262676864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788270130.373985:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46515:x1875136262676864:12345-0@lo:1000:osp_up0-1.0 Request processed in 136us (261us total) trans 30064771380 rc 0/0 00000100:00100000:2.0:1788270130.373992:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788270130.374110:0:46515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:46515:1875136262676864:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788270130.628989:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270130.752543:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270130.752592:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253283072 00000100:00100000:3.0:1788270130.752602:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253283072 00000100:00100000:3.0:1788270130.752666:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 453 00000100:00100000:3.0:1788270130.752676:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:40420:x1875136253283072:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788270130.752769:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:40420:x1875136253283072:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270130.752777:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 453 00000100:00100000:0.0:1788270130.753959:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270130.754020:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253283200 00000100:00100000:1.0:1788270130.754027:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253283200 00000100:00100000:1.0:1788270130.754159:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 454 00000100:00100000:1.0:1788270130.754169:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:40420:x1875136253283200:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788270130.754300:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:40420:x1875136253283200:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 130us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270130.754309:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 454 00000100:00100000:2.0:1788270130.760781:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270130.760867:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253283456 00000100:00100000:3.0:1788270130.760876:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253283456 00000100:00100000:3.0:1788270130.761138:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:3.0:1788270130.761151:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:40420:x1875136253283456:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270130.761386:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:40420:x1875136253283456:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 231us (607us total) trans 30064771381 rc 0/0 00000100:00100000:3.0:1788270130.761395:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000001:00080000:0.0:1788270130.766718:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771381 is committed 00000001:00080000:0.0:1788270130.766732:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771380 is committed 00000004:00080000:0.0:1788270130.766739:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000004:00080000:0.0:1788270130.766759:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000004:00080000:0.0:1788270130.766792:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000004:00080000:0.0:1788270130.766798:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000100:00100000:3.0:1788270130.766932:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262677120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788270130.766932:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262676992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788270130.767012:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788270130.767022:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767035:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270130.767086:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262676992 00000100:00100000:1.0:1788270130.767094:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262676992 00000100:00100000:1.0:1788270130.767158:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788270130.767159:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270130.767173:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262676992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788270130.767173:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262677120 00000100:00100000:0.0:1788270130.767178:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262677120 00000100:00100000:0.0:1788270130.767207:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788270130.767215:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262677120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788270130.767339:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb size from disk: 12582912 -> 15728640 00002000:00010000:0.0:1788270130.767339:0:47283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb size from disk: 12582912 -> 15728640 00002000:00010000:0.0:1788270130.767345:0:47283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb mtime from disk: 1788270126 -> 1788270126 00002000:00010000:1.0:1788270130.767346:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb mtime from disk: 1788270126 -> 1788270126 00002000:00010000:0.0:1788270130.767350:0:47283:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270130.767352:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788270130.767353:0:47283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb ctime from disk: 1788270126 -> 1788270126 00002000:00010000:1.0:1788270130.767357:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb ctime from disk: 1788270126 -> 1788270126 00002000:00010000:0.0:1788270130.767358:0:47283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc8:0x0] updating lvb blocks from disk: 24576 -> 30720 00002000:00010000:1.0:1788270130.767364:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xc9:0x0] updating lvb blocks from disk: 24576 -> 30720 00000100:00100000:0.0:1788270130.767406:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262677120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (250us total) trans 30064771156 rc 0/0 00000100:00100000:1.0:1788270130.767413:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262676992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (400us total) trans 30064771132 rc 0/0 00000100:00100000:0.0:1788270130.767414:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788270130.767425:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000004:00080000:3.0:1788270130.767454:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c14a49df80/2, rc 0, transno 30064771156 00000100:00100000:3.0:1788270130.767462:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262677120:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788270130.767545:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767552:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fb41800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270130.767557:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767566:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767582:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff98c1429fd600) 00010000:00010000:2.0:1788270130.767585:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270130.767590:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767597:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41800/0xc5f5d7a016e0a3d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270130.767603:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c144381180/2, rc 0, transno 30064771132 00000100:00100000:0.0:1788270130.767609:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262676992:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788270130.767618:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767627:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767634:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767644:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fb41400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270130.767647:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767653:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767662:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff98c1429fd900) 00010000:00010000:2.0:1788270130.767664:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270130.767667:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767674:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41400/0xc5f5d7a016e0a3de lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767687:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767694:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767700:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767705:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fb40200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270130.767708:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767714:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767725:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff98c1429fd300) 00010000:00010000:2.0:1788270130.767728:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270130.767731:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767737:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb40200/0xc5f5d7a016e0a41d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767749:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767755:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767761:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767766:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27c19b600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270130.767769:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767774:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767782:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff98c24a952b00) 00010000:00010000:2.0:1788270130.767784:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270130.767787:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767793:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27c19b600/0xc5f5d7a016e0a447 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767806:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767813:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767819:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767824:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fb41000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270130.767826:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767831:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767838:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff98c1429fd500) 00010000:00010000:2.0:1788270130.767841:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270130.767843:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767849:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41000/0xc5f5d7a016e0a471 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767860:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767866:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767873:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767879:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14fb41600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270130.767882:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767888:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767895:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff98c24a952800) 00010000:00010000:2.0:1788270130.767898:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788270130.767901:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270130.767907:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14fb41600/0xc5f5d7a016e0a48d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270130.879426:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270130.879654:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253283584 00000100:00100000:3.0:1788270130.879664:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253283584 00000100:00100000:3.0:1788270130.879724:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 455 00000100:00100000:3.0:1788270130.879734:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:40924:x1875136253283584:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:3.0:1788270130.879754:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270130.879777:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a5b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610201c expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270130.879845:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270130.879864:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270130.879875:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270130.879917:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270130.879921:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270130.879941:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270130.879964:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a5b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 7 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270130.879988:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 6 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270130.879997:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270130.880000:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270130.880003:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be000, rc 0) 00000100:00100000:3.0:1788270130.880618:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:40924:x1875136253283584:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 882us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270130.880627:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 455 00010000:00010000:0.0:1788270131.652304:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270131.908430:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262677248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270131.908503:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270131.908584:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262677248 00000100:00100000:1.0:1788270131.908602:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262677248 00000100:00100000:1.0:1788270131.908661:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788270131.908670:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262677248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270131.908698:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 137502400 pending 0 free 3850096640 avail 3618574336 00000100:00080000:2.0:1788270131.908761:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270131.910531:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262677248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1854us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270131.910544:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788270131.913486:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 30064771126 gen 2 00000004:00080000:0.0:1788270131.913501:0:3609:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1448f1180, transno 30064771126 00000100:00100000:0.0:1788270131.913590:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262677248:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788270132.302367:0:50648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 09:42:11 (1788270131) 00000100:00100000:1.0:1788270132.421237:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262677376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270132.421309:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270132.421495:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262677376 00000100:00100000:3.0:1788270132.421504:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262677376 00000100:00100000:3.0:1788270132.421557:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788270132.421567:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262677376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270132.421603:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:3.0:1788270132.421647:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262677376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270132.421719:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788270132.421795:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771380 gen 2 00000004:00080000:1.0:1788270132.421801:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771380 committed transno 30064771380 00000100:00100000:1.0:1788270132.421825:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262677376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270132.676456:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270133.369199:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270133.370325:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253283840 00000100:00100000:3.0:1788270133.370337:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253283840 00000100:00100000:3.0:1788270133.370475:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 456 00000100:00100000:3.0:1788270133.370488:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+34:41211:x1875136253283840:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270133.370512:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270133.370516:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270133.370545:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1410f0a00/0xc5f5d7a016e0a3ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656101f89 expref: 34 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.370565:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270133.370570:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270133.370583:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a5c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102023 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.370686:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.370696:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 5 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.370701:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.370726:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 5 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.370736:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 5 pid: 45776 timeout: 1025 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270133.370746:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262677504:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270133.370819:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2512449c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788270133.372235:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270133.374359:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262677504:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270133.374391:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270133.379747:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.379817:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253283968 00000100:00100000:0.0:1788270133.379828:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253283968 00010000:00010000:0.0:1788270133.379894:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 6 pid: 45776 timeout: 1025 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270133.379938:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:0.0:1788270133.379949:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253283968:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270133.379963:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270133.379970:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 6 pid: 45776 timeout: 1025 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.379984:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 6 pid: 45776 timeout: 1025 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.380152:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be000/0xc5f5d7a016e0a5ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610201c expref: 6 pid: 45776 timeout: 1025 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.380171:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270133.380176:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.380186:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.380195:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.380227:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270133.380286:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253283968:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 338us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270133.380294:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00080000:2.0:1788270133.380517:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788270133.381812:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.381825:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.381851:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.381859:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.381866:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270133.382236:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xc9:0x0], index 1: 0 00010000:00010000:3.0:1788270133.382376:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a5d6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.382386:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a5d6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.382394:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a5d6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.382428:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.382435:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383308:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383321:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383329:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270133.383333:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383342:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383357:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270133.383361:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270133.383366:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383372:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a5c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270133.383387:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142f30b7 reply state 0000000031e5a6be transno 30064771382 ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383399:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383404:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:3.0:1788270133.383406:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270133.383410:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270133.383451:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a5c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102023 expref: 36 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383466:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a5d6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102023 expref: 35 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.383479:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270133.383481:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270133.383484:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0be800, rc 0) 00000100:00100000:3.0:1788270133.383555:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:41211:x1875136253283840:12345-192.168.201.42@tcp:101:dd.0 Request processed in 13070us (14366us total) trans 30064771382 rc 0/0 00000100:00100000:3.0:1788270133.383564:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 456 00000100:00100000:1.0:1788270133.391592:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.391861:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253284096 00000100:00100000:2.0:1788270133.391874:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253284096 00000100:00080000:0.0:1788270133.392019:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270133.392147:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:2.0:1788270133.392161:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:41211:x1875136253284096:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270133.392178:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.392200:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d6629b9/0xc5f5d7a016e0a5e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610202a expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270133.392226:0:48230:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270133.392248:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=925s v=(0 0) 00010000:00010000:2.0:1788270133.392255:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270133.392265:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6629b9/0xc5f5d7a016e0a5e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610202a expref: 15 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.392283:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d6629b9/0xc5f5d7a016e0a5e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610202a expref: 15 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.392308:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1519bc400, rc 0) 00000100:00100000:2.0:1788270133.392369:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:41211:x1875136253284096:12345-192.168.201.42@tcp:101:dd.0 Request processed in 213us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270133.392377:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:2.0:1788270133.425881:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.426124:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253284352 00000100:00100000:0.0:1788270133.426134:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253284352 00000100:00100000:0.0:1788270133.426221:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:0.0:1788270133.426232:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+36:41211:x1875136253284352:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:0.0:1788270133.426479:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:41211:x1875136253284352:12345-192.168.201.42@tcp:35:dd.0 Request processed in 248us (604us total) trans 30064771383 rc 0/0 00000100:00100000:0.0:1788270133.426486:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:1.0:1788270133.438528:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.438666:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253284480 00000100:00100000:0.0:1788270133.438677:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253284480 00000100:00100000:0.0:1788270133.438789:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 457 00000100:00100000:0.0:1788270133.438800:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:41212:x1875136253284480:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270133.438824:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270133.438845:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1400/0xc5f5d7a016e0a5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102031 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.438910:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0e00/0xc5f5d7a016e0a5f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.438923:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0e00/0xc5f5d7a016e0a5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.438934:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0e00/0xc5f5d7a016e0a5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270133.438984:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270133.438988:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270133.439018:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0e00/0xc5f5d7a016e0a5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.439071:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1400/0xc5f5d7a016e0a5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102031 expref: 39 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.439089:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0e00/0xc5f5d7a016e0a5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102031 expref: 38 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.439098:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270133.439101:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270133.439104:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151ef0e00, rc 0) 00000100:00100000:0.0:1788270133.439164:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41212:x1875136253284480:12345-192.168.201.42@tcp:101:chown.0 Request processed in 366us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270133.439171:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 457 00000100:00100000:1.0:1788270133.441287:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270133.441675:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253284608 00000100:00100000:3.0:1788270133.441689:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253284608 00000100:00100000:3.0:1788270133.441761:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 458 00000100:00100000:3.0:1788270133.441771:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41212:x1875136253284608:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:3.0:1788270133.441795:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270133.441817:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a5f9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102038 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.441850:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a600 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.441860:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a600 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.441870:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a600 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.441984:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a5f9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102038 expref: 40 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.442011:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfc00/0xc5f5d7a016e0a600 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102038 expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.442025:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270133.442028:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788270133.442032:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfc00, rc 0) 00000100:00100000:3.0:1788270133.442120:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:41212:x1875136253284608:12345-192.168.201.42@tcp:101:chown.0 Request processed in 350us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270133.442128:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 458 00000100:00100000:3.0:1788270133.445119:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.446064:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253284864 00000100:00100000:0.0:1788270133.446075:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253284864 00000100:00100000:0.0:1788270133.446195:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 459 00000100:00100000:0.0:1788270133.446209:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:41212:x1875136253284864:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:0.0:1788270133.446264:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270133.446290:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be800/0xc5f5d7a016e0a5d6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102023 expref: 39 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.446309:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.446315:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270133.446341:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.446353:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.446363:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270133.446553:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].11, 88 off9088 00000004:00080000:0.0:1788270133.446563:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925153523637ns, next at 926153521280ns, rc = 0 00000004:00010000:0.0:1788270133.446607:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098d682e8 reply state 0000000035be6eaa transno 30064771384 ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.446617:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.446621:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.446623:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788270133.446624:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270133.446703:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41212:x1875136253284864:12345-192.168.201.42@tcp:36:chown.0 Request processed in 495us (1594us total) trans 30064771384 rc 0/0 00000100:00100000:0.0:1788270133.446709:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 459 00000100:00100000:1.0:1788270133.448561:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.448609:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253284992 00000100:00100000:0.0:1788270133.448615:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253284992 00000100:00100000:0.0:1788270133.448654:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 460 00000100:00100000:0.0:1788270133.448660:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41212:x1875136253284992:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270133.448673:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270133.448685:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1200/0xc5f5d7a016e0a60e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610203f expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.448718:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1200/0xc5f5d7a016e0a60e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610203f expref: 41 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.448727:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1200/0xc5f5d7a016e0a60e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610203f expref: 41 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.448739:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.448741:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270133.448743:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151ef1200, rc 0) 00000100:00100000:0.0:1788270133.449116:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41212:x1875136253284992:12345-192.168.201.42@tcp:101:chown.0 Request processed in 454us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270133.449123:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 460 00000100:00100000:1.0:1788270133.451939:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270133.452007:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253285120 00000100:00100000:3.0:1788270133.452018:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253285120 00000100:00100000:3.0:1788270133.452091:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:3.0:1788270133.452103:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2402:x1875136253285120:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:3.0:1788270133.452277:0:47281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788270133.452281:0:47281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788270133.452283:0:47281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270133.452286:0:47281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb ctime from disk: 0 -> 1788270133 00002000:00010000:3.0:1788270133.452288:0:47281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788270133.452342:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2402:x1875136253285120:12345-192.168.201.42@tcp:2:chown.0 Request processed in 242us (411us total) trans 30064771157 rc 0/0 00000100:00100000:3.0:1788270133.452349:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:2.0:1788270133.487435:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270133.487489:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253285376 00000100:00100000:3.0:1788270133.487500:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253285376 00000100:00100000:3.0:1788270133.487557:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 461 00000100:00100000:3.0:1788270133.487567:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41218:x1875136253285376:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:3.0:1788270133.487587:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270133.487606:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102046 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487676:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487690:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487701:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487713:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487720:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487727:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.487990:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a62a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.488028:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a62a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.488036:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a62a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270133.488156:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 2097152 00010000:00010000:2.0:1788270133.488304:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488313:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488321:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488328:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488335:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.488340:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488348:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488362:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.488365:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.488370:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488377:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf800/0xc5f5d7a016e0a61c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488390:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488397:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488403:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488409:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.488411:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488417:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488424:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:2.0:1788270133.488427:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.488430:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488436:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a623 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488474:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf200/0xc5f5d7a016e0a615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102046 expref: 44 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488487:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a62a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102046 expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.488495:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.488497:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270133.488500:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bf600, rc 0) 00000100:00100000:2.0:1788270133.488552:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:41218:x1875136253285376:12345-192.168.201.42@tcp:101:dd.500 Request processed in 986us (1127us total) trans 30064771385 rc 0/0 00000100:00100000:2.0:1788270133.488560:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 461 00000100:00100000:1.0:1788270133.492146:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.492335:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253285632 00000100:00100000:0.0:1788270133.492346:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253285632 00000100:00100000:0.0:1788270133.492409:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 462 00000100:00100000:0.0:1788270133.492420:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:41218:x1875136253285632:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270133.492444:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270133.492447:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1788270133.492475:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1200/0xc5f5d7a016e0a60e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610203f expref: 43 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492498:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a62a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102046 expref: 42 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492510:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.492516:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270133.492528:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1400/0xc5f5d7a016e0a638 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610204d expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492566:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492578:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492587:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492601:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492607:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492613:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492619:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151ef1e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270133.492622:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492629:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492637:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.492640:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270133.492643:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492650:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1e00/0xc5f5d7a016e0a63f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492669:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0200/0xc5f5d7a016e0a646 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492677:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0200/0xc5f5d7a016e0a646 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492683:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0200/0xc5f5d7a016e0a646 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492862:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0200/0xc5f5d7a016e0a646 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610204d expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492870:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.492872:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270133.492881:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef1400/0xc5f5d7a016e0a638 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610204d expref: 44 pid: 46770 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492893:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0200/0xc5f5d7a016e0a646 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610204d expref: 43 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.492916:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.492918:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788270133.492921:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c151ef0200, rc 0) 00000100:00100000:0.0:1788270133.492978:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:41218:x1875136253285632:12345-192.168.201.42@tcp:101:dd.500 Request processed in 560us (843us total) trans 30064771386 rc 0/0 00000100:00100000:0.0:1788270133.492986:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 462 00000100:00100000:1.0:1788270133.497450:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.497745:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253285760 00000100:00100000:2.0:1788270133.497756:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253285760 00002000:00100000:2.0:1788270133.497806:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->2097151) req@ffff98c275904700 x1875136253285760/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/0 e 0 to 0 dl 1788270144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270133.497818:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275904700 with x1875136253285760 ext(0->2097151) 00002000:00010000:2.0:1788270133.497825:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275904700 00000100:00100000:2.0:1788270133.497894:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:2.0:1788270133.497906:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253285760:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270133.523380:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253285760:12345-192.168.201.42@tcp:4:dd.0 Request processed in 25464us (25928us total) trans 30064771158 rc 0/0 00000100:00100000:2.0:1788270133.523396:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00002000:00100000:2.0:1788270133.523409:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->2097151) req@ffff98c275904700 x1875136253285760/t30064771158(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/448 e 0 to 0 dl 1788270144 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270133.523427:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275904700 with x1875136253285760 ext(0->2097151) 00002000:00010000:2.0:1788270133.523433:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275904700 00000100:00100000:0.0:1788270133.547167:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270133.547226:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253285888 00000100:00100000:1.0:1788270133.547236:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253285888 00002000:00100000:1.0:1788270133.547283:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->1048575) req@ffff98c27a62d180 x1875136253285888/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/0 e 0 to 0 dl 1788270144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270133.547901:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a62d180 with x1875136253285888 ext(0->1048575) 00002000:00010000:1.0:1788270133.547908:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a62d180 00000100:00100000:1.0:1788270133.547946:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788270133.547959:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253285888:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:1.0:1788270133.560201:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253285888:12345-192.168.201.42@tcp:3:dd.0 Request processed in 12237us (13034us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788270133.560211:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00002000:00100000:1.0:1788270133.560221:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->1048575) req@ffff98c27a62d180 x1875136253285888/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/440 e 0 to 0 dl 1788270144 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270133.560229:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a62d180 with x1875136253285888 ext(0->1048575) 00002000:00010000:1.0:1788270133.560234:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a62d180 00000100:00100000:3.0:1788270133.570904:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270133.570973:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253286016 00000100:00100000:1.0:1788270133.570984:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253286016 00002000:00100000:1.0:1788270133.571076:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc9:0x0] (1048576->2097151) req@ffff98c144381f80 x1875136253286016/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/0 e 0 to 0 dl 1788270144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270133.571088:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144381f80 with x1875136253286016 ext(1048576->2097151) 00002000:00010000:1.0:1788270133.571094:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c144381f80 00000100:00100000:1.0:1788270133.571128:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788270133.571139:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253286016:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:1.0:1788270133.579203:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253286016:12345-192.168.201.42@tcp:3:dd.0 Request processed in 8056us (8296us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788270133.579217:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00002000:00100000:1.0:1788270133.579230:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc9:0x0] (1048576->2097151) req@ffff98c144381f80 x1875136253286016/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/440 e 0 to 0 dl 1788270144 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270133.579240:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c144381f80 with x1875136253286016 ext(1048576->2097151) 00002000:00010000:1.0:1788270133.579247:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c144381f80 00000100:00100000:2.0:1788270133.605136:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270133.605543:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253286272 00000100:00100000:3.0:1788270133.605553:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253286272 00000100:00100000:3.0:1788270133.605614:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:3.0:1788270133.605624:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:41218:x1875136253286272:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:3.0:1788270133.605898:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41218:x1875136253286272:12345-192.168.201.42@tcp:35:dd.500 Request processed in 275us (771us total) trans 30064771387 rc 0/0 00000100:00100000:3.0:1788270133.605906:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:0.0:1788270133.666499:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.666595:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253286400 00000100:00100000:2.0:1788270133.666604:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253286400 00000100:00100000:2.0:1788270133.666654:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 463 00000100:00100000:2.0:1788270133.666664:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41228:x1875136253286400:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270133.666743:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666759:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666770:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666780:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666788:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666794:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666874:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666955:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.666964:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270133.667029:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667075:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667082:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667089:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667095:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.667099:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667106:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667117:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.667121:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.667125:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667131:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a64d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667146:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667153:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667158:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667163:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.667166:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667173:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667181:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:2.0:1788270133.667183:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.667186:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667191:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a654 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667198:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667201:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667205:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667208:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.667210:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667214:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667218:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.667219:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.667221:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.667224:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a65b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270133.667342:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41228:x1875136253286400:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 678us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270133.667350:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 463 00000100:00100000:0.0:1788270133.699262:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.699468:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253286656 00000100:00100000:2.0:1788270133.699477:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253286656 00000100:00100000:2.0:1788270133.699557:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 464 00000100:00100000:2.0:1788270133.699568:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41229:x1875136253286656:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270133.699587:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.699605:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102054 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699671:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699686:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699701:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699712:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699720:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699726:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699805:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699812:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699818:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699824:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699830:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.699835:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699842:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699853:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.699856:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.699861:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699868:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699883:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699889:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699895:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699900:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.699903:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699909:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699915:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:2.0:1788270133.699917:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.699920:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699925:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a670 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699949:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a662 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102054 expref: 45 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699958:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.699960:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270133.699964:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102054 expref: 45 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.699972:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f000, rc 0) 00000100:00100000:2.0:1788270133.700099:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41229:x1875136253286656:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 533us (845us total) trans 0 rc 301/301 00000100:00100000:2.0:1788270133.700107:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 464 00010000:00010000:0.0:1788270133.700957:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270133.704349:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270133.704408:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253286784 00000100:00100000:3.0:1788270133.704416:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253286784 00000100:00100000:3.0:1788270133.704464:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 465 00000100:00100000:3.0:1788270133.704472:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41229:x1875136253286784:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788270133.704529:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704541:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704550:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704557:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704561:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704565:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704618:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704627:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704630:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270133.704658:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 2097152 00000004:00200000:3.0:1788270133.704661:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270133.704670:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704678:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704682:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704687:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704702:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270133.704707:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704713:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704725:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270133.704728:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270133.704732:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704743:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704754:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704758:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704762:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704765:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bfa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270133.704766:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704770:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704774:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:3.0:1788270133.704775:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270133.704777:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704780:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a67e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704785:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704788:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704792:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704795:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0be200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270133.704797:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704800:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704803:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270133.704804:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270133.704806:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270133.704809:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0be200/0xc5f5d7a016e0a685 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270133.704867:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41229:x1875136253286784:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 395us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270133.704871:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 465 00000100:00100000:1.0:1788270133.733156:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.733372:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253287040 00000100:00100000:2.0:1788270133.733382:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253287040 00000100:00100000:2.0:1788270133.733528:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 466 00000100:00100000:2.0:1788270133.733539:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41235:x1875136253287040:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270133.733559:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.733562:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270133.733591:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0e00/0xc5f5d7a016e0a5f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102031 expref: 44 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733609:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.733614:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270133.733626:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a68c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610205b expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733746:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733763:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733773:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733784:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733792:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733799:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733856:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6a1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733865:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733872:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270133.733881:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 2097152 00010000:00010000:2.0:1788270133.733957:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733965:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733972:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.733978:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.733983:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734100:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734110:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.734113:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.734117:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734123:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734136:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734142:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734148:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734152:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.734155:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734161:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734172:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:2.0:1788270133.734174:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.734177:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734183:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a69a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734216:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a68c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610205b expref: 46 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734230:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6a1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610205b expref: 45 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.734238:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.734241:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270133.734243:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ee00, rc 0) 00000100:00100000:2.0:1788270133.734475:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:41235:x1875136253287040:12345-192.168.201.42@tcp:101:dd.0 Request processed in 936us (1328us total) trans 30064771388 rc 0/0 00000100:00100000:2.0:1788270133.734483:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 466 00000100:00100000:0.0:1788270133.736753:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.736849:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253287296 00000100:00100000:2.0:1788270133.736858:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253287296 00000100:00100000:2.0:1788270133.736954:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 467 00000100:00100000:2.0:1788270133.736965:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:41235:x1875136253287296:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:2.0:1788270133.737036:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270133.737082:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0200/0xc5f5d7a016e0a646 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610204d expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.737112:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6a1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610205b expref: 44 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.737122:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.737127:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270133.737315:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.737337:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.737346:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270133.737396:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771389 00000004:00010000:2.0:1788270133.737417:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff0f1e7 reply state 00000000e7af1656 transno 30064771390 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.737430:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.737436:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.737439:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270133.737441:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270133.737530:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:41235:x1875136253287296:12345-192.168.201.42@tcp:36:dd.0 Request processed in 567us (786us total) trans 30064771390 rc 0/0 00000100:00100000:2.0:1788270133.737538:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 467 00000020:00080000:2.0:1788270133.737543:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788270133.741220:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.741475:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253287424 00000100:00100000:2.0:1788270133.741486:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253287424 00000100:00100000:2.0:1788270133.741595:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 468 00000100:00100000:2.0:1788270133.741606:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:41235:x1875136253287424:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270133.741631:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.741653:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a6b6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102062 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.741711:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a6b6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102062 expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.741727:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a6b6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102062 expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.741746:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.741749:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270133.741754:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fc00, rc 0) 00000100:00100000:2.0:1788270133.741816:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:41235:x1875136253287424:12345-192.168.201.42@tcp:101:dd.0 Request processed in 211us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270133.741823:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 468 00000100:00100000:1.0:1788270133.743811:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.743869:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253287680 00000100:00100000:2.0:1788270133.743876:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253287680 00000100:00100000:2.0:1788270133.743915:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 469 00000100:00100000:2.0:1788270133.743922:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:41235:x1875136253287680:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270133.743937:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.743939:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270133.743959:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0a6b6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102062 expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.743978:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.743981:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270133.744005:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6bd lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102069 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744083:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6c4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744096:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6c4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744105:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6c4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744247:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6c4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102069 expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744253:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.744255:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788270133.744261:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6bd lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102069 expref: 49 pid: 45778 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744269:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6c4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102069 expref: 48 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.744284:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.744286:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788270133.744299:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f600, rc 0) 00000100:00100000:2.0:1788270133.744557:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:41235:x1875136253287680:12345-192.168.201.42@tcp:101:dd.0 Request processed in 633us (751us total) trans 30064771391 rc 0/0 00000100:00100000:2.0:1788270133.744564:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 469 00000100:00100000:3.0:1788270133.748380:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.748465:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253287936 00000100:00100000:2.0:1788270133.748475:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253287936 00000100:00100000:2.0:1788270133.748536:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 470 00000100:00100000:2.0:1788270133.748548:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:41235:x1875136253287936:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270133.748572:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.748576:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270133.748602:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6c4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102069 expref: 48 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.748623:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.748628:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270133.748640:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6cb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102070 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.748689:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a6d2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.748703:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a6d2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.748712:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a6d2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270133.748906:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].12, 88 off9176 00000004:00080000:2.0:1788270133.748914:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925455874291ns, next at 926153521280ns, rc = 0 00000001:00080000:3.0:1788270133.750862:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771392 is committed 00000004:00080000:3.0:1788270133.750882:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:3.0:1788270133.750913:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000100:00100000:1.0:1788270133.751024:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270133.751087:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262677632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788270133.751153:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270133.751228:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262677632 00000100:00100000:3.0:1788270133.751240:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262677632 00000100:00100000:3.0:1788270133.751330:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788270133.751342:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262677632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788270133.751514:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788270133.751519:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb mtime from disk: 0 -> 1788270133 00002000:00010000:3.0:1788270133.751522:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270133.751525:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb ctime from disk: 1788270133 -> 1788270133 00002000:00010000:3.0:1788270133.751527:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb blocks from disk: 0 -> 4096 00000100:00100000:3.0:1788270133.751607:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262677632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (453us total) trans 30064771159 rc 0/0 00000100:00100000:3.0:1788270133.751616:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788270133.751704:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788270133.751706:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c275907800/2, rc 0, transno 30064771159 00000100:00100000:0.0:1788270133.751723:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262677632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788270133.751810:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262677760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788270133.751853:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270133.751909:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262677760 00000100:00100000:3.0:1788270133.751915:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262677760 00000100:00100000:3.0:1788270133.751949:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788270133.751957:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262677760:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788270133.752009:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752022:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752030:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752037:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270133.752082:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752091:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752108:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f8300) 00010000:00010000:0.0:1788270133.752112:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270133.752117:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752128:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bee00/0xc5f5d7a016e0a5cf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752157:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752164:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752169:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752174:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c151ef0800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270133.752177:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752182:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752190:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.752193:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270133.752196:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752201:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c151ef0800/0xc5f5d7a016e0a607 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752212:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752217:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752223:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752228:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270133.752231:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752237:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752245:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270133.752247:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270133.752250:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270133.752256:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0a6af lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.752554:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a6d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102070 expref: 36 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.752564:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.752567:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788270133.752579:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6cb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102070 expref: 36 pid: 45776 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.752593:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a6d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102070 expref: 35 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.752621:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.752623:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788270133.752625:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f400, rc 0) 00000100:00100000:2.0:1788270133.752719:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:41235:x1875136253287936:12345-192.168.201.42@tcp:101:dd.0 Request processed in 4172us (4348us total) trans 30064771392 rc 0/0 00000100:00100000:2.0:1788270133.752728:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 470 00002000:00010000:3.0:1788270133.752855:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1788270133.753142:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb mtime from disk: 1788270133 -> 1788270133 00002000:00010000:3.0:1788270133.753146:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270133.753148:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb ctime from disk: 1788270133 -> 1788270133 00002000:00010000:3.0:1788270133.753151:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1788270133.753218:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3608:x1875136262677760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1260us (1363us total) trans 30064771160 rc 0/0 00000100:00100000:3.0:1788270133.753226:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000004:00080000:0.0:1788270133.753327:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c275906300/2, rc 0, transno 30064771160 00000100:00100000:0.0:1788270133.753335:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262677760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788270133.755245:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.755582:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253288064 00000100:00100000:0.0:1788270133.755594:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253288064 00002000:00010000:0.0:1788270133.755648:0:47287:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/201 (0->18446744073709551615) 00002000:00100000:0.0:1788270133.755655:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275904000 with x1875136253288064 ext(0->18446744073709551615) 00002000:00010000:0.0:1788270133.755669:0:47287:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275904000. 00000100:00100000:0.0:1788270133.755740:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788270133.755753:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253288064:12345-192.168.201.42@tcp:10:dd.0 00002000:00010000:0.0:1788270133.757714:0:47287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:0.0:1788270133.757726:0:47287:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb mtime from disk: 1788270133 -> 1788270133 00002000:00010000:0.0:1788270133.757729:0:47287:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788270133.757732:0:47287:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb ctime from disk: 1788270133 -> 1788270133 00002000:00010000:0.0:1788270133.757735:0:47287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xc9:0x0] updating lvb blocks from disk: 4096 -> 0 00000100:00100000:0.0:1788270133.757842:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253288064:12345-192.168.201.42@tcp:10:dd.0 Request processed in 2086us (2602us total) trans 30064771161 rc 0/0 00000100:00100000:0.0:1788270133.757854:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00002000:00010000:0.0:1788270133.757860:0:47287:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/201 (0->18446744073709551615) 00002000:00100000:0.0:1788270133.757864:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275904000 with x1875136253288064 ext(0->18446744073709551615) 00002000:00010000:0.0:1788270133.757872:0:47287:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275904000. 00000100:00100000:1.0:1788270133.832802:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.834162:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253288192 00000100:00100000:2.0:1788270133.834180:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253288192 00002000:00100000:2.0:1788270133.834251:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->4194303) req@ffff98c275905f80 x1875136253288192/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/0 e 0 to 0 dl 1788270144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270133.834264:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275905f80 with x1875136253288192 ext(0->4194303) 00002000:00010000:2.0:1788270133.834272:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275905f80 00000100:00100000:2.0:1788270133.834371:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:2.0:1788270133.834383:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253288192:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270133.842653:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270133.846634:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253288448 00000100:00100000:0.0:1788270133.846656:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253288448 00000100:00100000:0.0:1788270133.846736:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:0.0:1788270133.846749:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+35:41235:x1875136253288448:12345-192.168.201.42@tcp:35:dd.0 00000001:00080000:0.0:1788270133.848177:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771393 00000100:00100000:0.0:1788270133.848363:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:41235:x1875136253288448:12345-192.168.201.42@tcp:35:dd.0 Request processed in 1612us (5720us total) trans 30064771394 rc 0/0 00000100:00100000:0.0:1788270133.848374:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000020:00080000:0.0:1788270133.848380:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788270133.888094:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2400:x1875136253288192:12345-192.168.201.42@tcp:4:dd.0 Request processed in 53604us (55198us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1788270133.888110:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00002000:00100000:2.0:1788270133.888123:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->4194303) req@ffff98c275905f80 x1875136253288192/t30064771162(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/448 e 0 to 0 dl 1788270144 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270133.888135:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c275905f80 with x1875136253288192 ext(0->4194303) 00002000:00010000:2.0:1788270133.888142:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c275905f80 00000100:00100000:1.0:1788270133.923623:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.923830:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253288576 00000100:00100000:2.0:1788270133.923840:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253288576 00000100:00100000:2.0:1788270133.923934:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 471 00000100:00100000:2.0:1788270133.923944:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+37:41245:x1875136253288576:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270133.923965:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.923994:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102077 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.924070:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.924083:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.924094:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270133.924137:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270133.924140:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270133.924157:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.924178:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a6d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102077 expref: 39 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.924208:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102077 expref: 38 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.924216:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.924220:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270133.924223:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f600, rc 0) 00000100:00100000:2.0:1788270133.924277:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41245:x1875136253288576:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 335us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270133.924284:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 471 00000100:00100000:0.0:1788270133.928662:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.928734:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253288704 00000100:00100000:2.0:1788270133.928745:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253288704 00000100:00100000:2.0:1788270133.928797:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 472 00000100:00100000:2.0:1788270133.928806:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41245:x1875136253288704:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270133.928871:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.928886:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.928897:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.928911:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.928918:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.928929:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929005:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929014:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929020:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270133.929079:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929092:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929098:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929105:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929111:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.929115:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929122:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929133:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.929136:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.929140:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929147:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929161:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929166:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929172:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929178:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.929180:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929186:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929192:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429fe100) 00010000:00010000:2.0:1788270133.929194:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.929197:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929202:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a6ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929214:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929220:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929226:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929231:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.929234:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929239:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929245:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.929247:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.929249:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.929255:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6f5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270133.929307:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41245:x1875136253288704:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 502us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270133.929314:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 472 00000100:00100000:0.0:1788270133.975095:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.975279:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253288960 00000100:00100000:2.0:1788270133.975290:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253288960 00000100:00100000:2.0:1788270133.975349:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 473 00000100:00100000:2.0:1788270133.975360:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41251:x1875136253288960:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270133.975381:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.975402:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610207e expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975477:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975490:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975502:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975517:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975525:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975532:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975634:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a711 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975642:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a711 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975648:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a711 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270133.975656:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 5242880 00010000:00010000:2.0:1788270133.975810:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975823:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975829:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975837:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975843:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.975847:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975854:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975865:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270133.975868:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.975873:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.975879:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0a703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976436:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976444:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976450:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976456:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.976459:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976465:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976474:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429fe100) 00010000:00010000:2.0:1788270133.976476:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270133.976479:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976485:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0a70a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976527:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0a6fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610207e expref: 41 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976541:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a711 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610207e expref: 40 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.976555:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.976557:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270133.976559:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ee00, rc 0) 00000100:00100000:2.0:1788270133.976674:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41251:x1875136253288960:12345-192.168.201.42@tcp:101:dd.500 Request processed in 1315us (1635us total) trans 30064771395 rc 0/0 00000100:00100000:2.0:1788270133.976681:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 473 00000100:00100000:1.0:1788270133.978590:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270133.978665:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253289216 00000100:00100000:2.0:1788270133.978672:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253289216 00000100:00100000:2.0:1788270133.978728:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 474 00000100:00100000:2.0:1788270133.978738:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41251:x1875136253289216:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270133.978759:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270133.978762:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788270133.978780:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0a6d2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102070 expref: 40 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978794:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0a711 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610207e expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978801:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.978804:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270133.978813:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a71f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102085 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978839:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978846:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978851:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978860:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978864:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978872:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978875:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270133.978878:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978882:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978886:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.978887:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270133.978889:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978893:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0a726 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978904:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a72d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978909:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a72d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.978913:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a72d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.979200:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a72d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102085 expref: 41 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.979209:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.979212:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788270133.979222:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0a71f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102085 expref: 41 pid: 48110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.979234:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e200/0xc5f5d7a016e0a72d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102085 expref: 40 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270133.979254:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270133.979257:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788270133.979259:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418e200, rc 0) 00000100:00100000:2.0:1788270133.979341:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41251:x1875136253289216:12345-192.168.201.42@tcp:101:dd.500 Request processed in 605us (755us total) trans 30064771396 rc 0/0 00000100:00100000:2.0:1788270133.979346:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 474 00000100:00100000:0.0:1788270133.982428:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270133.988272:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253289344 00000100:00100000:1.0:1788270133.988288:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253289344 00002000:00100000:1.0:1788270133.988348:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc9:0x0] (4194304->5242879) req@ffff98c27a62e300 x1875136253289344/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/0 e 0 to 0 dl 1788270144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270133.988359:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a62e300 with x1875136253289344 ext(4194304->5242879) 00002000:00010000:1.0:1788270133.988365:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a62e300 00000100:00100000:1.0:1788270133.988392:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:1.0:1788270133.988401:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+21:2401:x1875136253289344:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270133.998135:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2401:x1875136253289344:12345-192.168.201.42@tcp:4:dd.0 Request processed in 9721us (15703us total) trans 30064771163 rc 0/0 00000100:00100000:2.0:1788270133.998149:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00002000:00100000:2.0:1788270133.998161:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc9:0x0] (4194304->5242879) req@ffff98c27a62e300 x1875136253289344/t30064771163(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:549/0 lens 488/448 e 0 to 0 dl 1788270144 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270133.998172:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a62e300 with x1875136253289344 ext(4194304->5242879) 00002000:00010000:2.0:1788270133.998179:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a62e300 00000100:00100000:0.0:1788270134.009248:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270134.009344:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253289472 00000100:00100000:1.0:1788270134.009360:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253289472 00002000:00100000:1.0:1788270134.009531:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->1048575) req@ffff98c1428fed80 x1875136253289472/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:550/0 lens 488/0 e 0 to 0 dl 1788270145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270134.009539:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fed80 with x1875136253289472 ext(0->1048575) 00002000:00010000:1.0:1788270134.009544:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1428fed80 00000100:00100000:1.0:1788270134.009576:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788270134.009583:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2400:x1875136253289472:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:2.0:1788270134.017642:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2400:x1875136253289472:12345-192.168.201.42@tcp:3:dd.0 Request processed in 8046us (8398us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788270134.017656:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00002000:00100000:2.0:1788270134.017669:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xc9:0x0] (0->1048575) req@ffff98c1428fed80 x1875136253289472/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:550/0 lens 488/440 e 0 to 0 dl 1788270145 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270134.017680:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fed80 with x1875136253289472 ext(0->1048575) 00002000:00010000:2.0:1788270134.017687:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1428fed80 00000100:00100000:0.0:1788270134.033209:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270134.033338:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253289600 00000100:00100000:1.0:1788270134.033350:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253289600 00002000:00100000:1.0:1788270134.033592:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc9:0x0] (1048576->5242879) req@ffff98c1428fdf80 x1875136253289600/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:550/0 lens 488/0 e 0 to 0 dl 1788270145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270134.033603:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fdf80 with x1875136253289600 ext(1048576->5242879) 00002000:00010000:1.0:1788270134.033609:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1428fdf80 00000100:00100000:1.0:1788270134.033707:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788270134.033718:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2400:x1875136253289600:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:0.0:1788270134.061136:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2400:x1875136253289600:12345-192.168.201.42@tcp:3:dd.0 Request processed in 27411us (27928us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1788270134.061147:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00002000:00100000:0.0:1788270134.061158:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xc9:0x0] (1048576->5242879) req@ffff98c1428fdf80 x1875136253289600/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:550/0 lens 488/440 e 0 to 0 dl 1788270145 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270134.061165:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428fdf80 with x1875136253289600 ext(1048576->5242879) 00002000:00010000:0.0:1788270134.061170:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1428fdf80 00000100:00100000:1.0:1788270134.100834:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270134.101147:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253289856 00000100:00100000:2.0:1788270134.101159:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253289856 00000100:00100000:2.0:1788270134.101220:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:2.0:1788270134.101231:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41251:x1875136253289856:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:2.0:1788270134.101558:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41251:x1875136253289856:12345-192.168.201.42@tcp:35:dd.500 Request processed in 327us (732us total) trans 30064771397 rc 0/0 00000100:00100000:2.0:1788270134.101566:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:1.0:1788270134.133173:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270134.133305:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253289984 00000100:00100000:0.0:1788270134.133317:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253289984 00000100:00100000:0.0:1788270134.133387:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 475 00000100:00100000:0.0:1788270134.133398:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41257:x1875136253289984:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788270134.133474:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133492:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133504:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133520:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133528:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133534:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133628:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133638:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133646:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270134.133690:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133704:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133711:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133718:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133724:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133729:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270134.133733:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133737:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133746:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270134.133748:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270134.133751:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133755:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133766:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133770:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133773:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133776:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270134.133778:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133781:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133784:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270134.133785:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270134.133787:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133791:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a73b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133802:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133807:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133812:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133817:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bbe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270134.133820:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133826:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133834:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270134.133836:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270134.133839:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.133843:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a742 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270134.134162:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41257:x1875136253289984:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 764us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270134.134170:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 475 00000100:00100000:0.0:1788270134.156392:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270134.156481:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253290240 00000100:00100000:3.0:1788270134.156491:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253290240 00000100:00100000:3.0:1788270134.156582:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 476 00000100:00100000:3.0:1788270134.156593:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41258:x1875136253290240:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270134.156622:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270134.156643:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610208c expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156718:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156731:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156742:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156757:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156764:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156771:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156844:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156851:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156858:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156864:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bf600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270134.156868:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156880:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156892:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270134.156895:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270134.156899:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156905:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bf600/0xc5f5d7a016e0a750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156917:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156923:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156929:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156933:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c27a0bea00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270134.156936:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156942:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156948:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f9300) 00010000:00010000:3.0:1788270134.156950:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270134.156953:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.156963:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bea00/0xc5f5d7a016e0a757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.157009:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610208c expref: 42 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.157020:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270134.157022:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270134.157025:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c27a0bfa00/0xc5f5d7a016e0a749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610208c expref: 42 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.157035:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bfa00, rc 0) 00000100:00100000:3.0:1788270134.157154:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41258:x1875136253290240:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 562us (772us total) trans 0 rc 301/301 00000100:00100000:3.0:1788270134.157161:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 476 00000100:00100000:1.0:1788270134.161239:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270134.161413:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253290368 00000100:00100000:2.0:1788270134.161424:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253290368 00000100:00100000:2.0:1788270134.161487:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 477 00000100:00100000:2.0:1788270134.161497:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41258:x1875136253290368:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788270134.161571:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161587:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161598:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161722:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161732:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161740:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161817:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161826:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161832:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270134.161870:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 5242880 00000004:00200000:2.0:1788270134.161875:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270134.161887:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161899:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161905:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161911:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161917:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270134.161922:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161929:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161941:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270134.161945:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270134.161949:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161955:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a75e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161968:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161974:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161989:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.161994:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5de00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270134.161997:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162002:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162008:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429fe100) 00010000:00010000:2.0:1788270134.162011:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270134.162013:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162019:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162032:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162074:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162081:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162085:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270134.162087:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162093:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162100:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270134.162102:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270134.162105:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.162110:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a76c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270134.162330:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41258:x1875136253290368:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 832us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.162338:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 477 00000100:00100000:2.0:1788270134.203028:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270134.203708:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253290496 00000100:00100000:0.0:1788270134.203721:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253290496 00000100:00100000:0.0:1788270134.203792:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 478 00000100:00100000:0.0:1788270134.203804:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41264:x1875136253290496:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270134.203825:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270134.203845:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102093 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.203913:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.203927:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.203938:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.203953:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.203960:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.203966:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204082:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204092:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204098:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270134.204139:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 5242880 00000004:00200000:0.0:1788270134.204144:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270134.204163:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204176:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204188:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204194:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204199:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204205:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204211:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270134.204216:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204223:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.204235:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270134.204238:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270134.204242:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205322:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0a77a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205352:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205358:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205472:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205479:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270134.205483:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205490:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205508:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270134.205511:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270134.205515:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205521:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0a781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205560:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0a773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 43 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205629:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 42 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.205637:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270134.205640:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270134.205642:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba800, rc 0) 00000100:00100000:0.0:1788270134.205710:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:41264:x1875136253290496:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1907us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270134.205718:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 478 00000100:00100000:0.0:1788270134.209611:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270134.209903:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253290752 00000100:00100000:3.0:1788270134.209914:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253290752 00000100:00100000:0.0:1788270134.210893:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 479 00000100:00100000:0.0:1788270134.210908:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:41264:x1875136253290752:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270134.210929:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270134.210951:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0a78f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610209a expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.211093:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a796 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.211109:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a796 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.211120:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a796 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270134.211131:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 5242880 00010000:00010000:0.0:1788270134.211254:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0a78f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610209a expref: 45 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.211272:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbe00/0xc5f5d7a016e0a796 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x22:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610209a expref: 44 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270134.211281:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:0.0:1788270134.211306:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788270134.211310:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bbe00, rc 0) 00000100:00100000:0.0:1788270134.211398:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41264:x1875136253290752:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 494us (1797us total) trans 30064771398 rc 0/0 00000100:00100000:0.0:1788270134.211405:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 479 00000100:00100000:1.0:1788270134.319247:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270134.319878:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291008 00000100:00100000:2.0:1788270134.319889:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291008 00000100:00100000:2.0:1788270134.320085:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 480 00000100:00100000:2.0:1788270134.320097:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41270:x1875136253291008:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270134.320125:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270134.320145:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020a1 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.320255:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.320269:0:48110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.320279:0:48110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.320337:0:48110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.320350:0:48110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 45 pid: 46770 timeout: 1026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270134.320364:0:48110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262677888:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270134.320694:0:48110:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143932240 going to sleep for 11 seconds 00000100:00100000:1.0:1788270134.324538:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270134.324782:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291136 00000100:00100000:3.0:1788270134.324792:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291136 00010000:00010000:3.0:1788270134.324835:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 46 pid: 46770 timeout: 1026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270134.324875:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:3.0:1788270134.324883:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:2401:x1875136253291136:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270134.324896:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270134.324902:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 46 pid: 46770 timeout: 1026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.324920:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 46 pid: 46770 timeout: 1026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.324943:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:3.0:1788270134.324948:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.324958:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.324965:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270134.324991:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270134.325067:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:2401:x1875136253291136:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 184us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270134.325074:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00010000:00010000:2.0:1788270134.325395:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0a788 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102093 expref: 45 pid: 46770 timeout: 1026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270134.325413:0:48110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:48110:1875136262677888:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270134.325485:0:48110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.325637:0:48110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.325644:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270134.325664:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x22:0x0]: returning size 5242880 00010000:00010000:2.0:1788270134.325797:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d400/0xc5f5d7a016e0a7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a1 expref: 46 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.325815:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5de00/0xc5f5d7a016e0a7ab lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a1 expref: 45 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270134.325822:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x22:0x0].0x0 (ffff98c1429f8400) 00010000:00010000:2.0:1788270134.325825:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788270134.325827:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26ab5de00, rc 0) 00000100:00100000:2.0:1788270134.325912:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:41270:x1875136253291008:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 5817us (6675us total) trans 30064771399 rc 0/0 00000100:00100000:2.0:1788270134.325920:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 480 00000100:00100000:0.0:1788270134.469845:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262678016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270134.469926:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270134.470438:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678016 00000100:00100000:2.0:1788270134.470448:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678016 00000100:00100000:2.0:1788270134.470507:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788270134.470517:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262678016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270134.470553:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270134.470613:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262678016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.470621:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788270134.470755:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262678016:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270134.726728:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270134.787551:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270134.787602:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270134.787644:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270134.787664:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291520 00000100:00100000:1.0:1788270134.787673:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270134.787674:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291520 00000100:00100000:1.0:1788270134.787698:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270134.787718:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270134.787730:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291648 00000100:00100000:2.0:1788270134.787733:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291648 00000100:00100000:1.0:1788270134.787739:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291776 00000100:00100000:1.0:1788270134.787741:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291776 00000100:00100000:2.0:1788270134.787753:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:2.0:1788270134.787761:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253291520:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270134.787765:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291392 00000100:00100000:1.0:1788270134.787767:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291392 00000100:00100000:1.0:1788270134.787783:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291904 00000100:00100000:1.0:1788270134.787785:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291904 00000100:00100000:1.0:1788270134.787798:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:1.0:1788270134.787803:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253291776:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270134.787827:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253291776:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.787828:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253291520:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.787834:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788270134.787835:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:2.0:1788270134.787850:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:1.0:1788270134.787850:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:2.0:1788270134.787856:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2402:x1875136253291648:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270134.787857:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253291392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270134.787877:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2402:x1875136253291648:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.787883:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:3.0:1788270134.787908:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253291264 00000100:00100000:3.0:1788270134.787912:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253291264 00000100:00100000:3.0:1788270134.787936:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:3.0:1788270134.787943:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253291264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270134.788033:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:0.0:1788270134.788070:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253291904:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270134.788145:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253291392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 287us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.788152:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00080000:1.0:1788270134.788171:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270134.788176:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270134.791834:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253291264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3879us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.791849:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:0.0:1788270134.792517:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253291904:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4472us (4793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270134.792528:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788270134.980728:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262678144:0@lo:400:kworker.0 00000100:00100000:3.0:1788270134.980812:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270134.980910:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270134.980917:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262678528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270134.980947:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270134.982939:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262678272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270134.983022:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270134.983071:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678528 00000100:00100000:3.0:1788270134.983079:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678528 00000100:00100000:1.0:1788270134.983089:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270134.983098:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262678400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270134.983124:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678272 00000100:00100000:3.0:1788270134.983127:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678272 00000100:00100000:1.0:1788270134.983131:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270134.983141:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678400 00000100:00100000:3.0:1788270134.983144:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678400 00000100:00100000:3.0:1788270134.983164:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788270134.983171:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788270134.983174:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25eb1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262678528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270134.983185:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262678272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270134.983202:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 246271680 pending 10764288 free 3787165696 avail 3555643392 00002000:00000024:3.0:1788270134.983207:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 137502400 pending 0 free 3850096640 avail 3618574336 00000100:00100000:1.0:1788270134.983316:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262678272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270134.983324:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25eb1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262678528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.983326:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788270134.983335:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788270134.983353:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788270134.983357:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678144 00000100:00100000:1.0:1788270134.983363:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3607:x1875136262678400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270134.983365:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678144 00002000:00000024:1.0:1788270134.983377:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5292032 granted 246271680 pending 10764288 free 3787165696 avail 3555643392 00000100:00100000:1.0:1788270134.983414:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3607:x1875136262678400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.983422:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788270134.983427:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262679040:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983448:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262678784:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983461:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270134.983475:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270134.983485:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262679552:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983496:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262679296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983508:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270134.983524:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678784 00000100:00100000:1.0:1788270134.983527:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678784 00000100:00100000:2.0:1788270134.983536:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788270134.983542:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262678656:0@lo:400:kworker.0 00000100:00100000:0.0:1788270134.983549:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788270134.983559:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679552 00000100:00100000:1.0:1788270134.983563:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679552 00000100:00100000:0.0:1788270134.983565:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262678144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983567:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270134.983588:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262679168:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983588:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788270134.983597:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262678784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788270134.983600:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270134.983607:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270134.983610:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270134.983629:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679040 00000100:00100000:0.0:1788270134.983629:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262678144:12345-0@lo:400:kworker.0 Request processed in 67us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.983630:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270134.983633:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679040 00000100:00100000:1.0:1788270134.983642:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262678784:12345-0@lo:400:kworker.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270134.983647:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788270134.983654:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262679680:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983654:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788270134.983672:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678656 00000100:00100000:1.0:1788270134.983675:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679168 00000100:00100000:3.0:1788270134.983677:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678656 00000100:00100000:1.0:1788270134.983681:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679168 00000100:00100000:2.0:1788270134.983682:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270134.983692:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262678912:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983705:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679680 00000100:00100000:1.0:1788270134.983709:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679680 00000100:00100000:2.0:1788270134.983712:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788270134.983718:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788270134.983722:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262679552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270134.983732:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270134.983734:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262679040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983735:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788270134.983747:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262679168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983766:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262679552:12345-0@lo:400:kworker.0 Request processed in 48us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.983772:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788270134.983773:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262679168:12345-0@lo:400:kworker.0 Request processed in 30us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.983779:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788270134.983785:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788270134.983791:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262679680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270134.983816:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262679424:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983818:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262679680:12345-0@lo:400:kworker.0 Request processed in 26us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.983826:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262678912 00000100:00100000:2.0:1788270134.983827:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788270134.983829:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262678912 00000100:00100000:2.0:1788270134.983846:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788270134.983853:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262678656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.983857:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788270134.983861:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270134.983866:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262678912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983882:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262678656:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.983888:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788270134.983891:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262678912:12345-0@lo:400:kworker.0 Request processed in 28us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.983896:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788270134.983920:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262678656:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983931:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262679168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983941:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262679680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.983955:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262679552:0@lo:400:kworker.0 00000100:00100000:0.0:1788270134.983988:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262678912:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.984070:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679424 00000100:00100000:2.0:1788270134.984071:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270134.984074:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679424 00000100:00100000:1.0:1788270134.984100:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679296 00000100:00100000:1.0:1788270134.984103:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679296 00000100:00100000:3.0:1788270134.984109:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262679040:12345-0@lo:400:kworker.0 Request processed in 380us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.984112:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262678400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270134.984122:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788270134.984126:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788270134.984130:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 30064771149 gen 2 00000100:00100000:1.0:1788270134.984132:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262679424:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1788270134.984135:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14ad94000, transno 30064771149 00000100:00100000:2.0:1788270134.984149:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262678272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270134.984170:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262679424:12345-0@lo:400:kworker.0 Request processed in 40us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270134.984173:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262678784:0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.984176:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788270134.984189:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788270134.984195:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262679296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270134.984233:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262679296:12345-0@lo:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270134.984239:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788270134.984269:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262679424:0@lo:400:kworker.0 00000100:00100000:3.0:1788270134.984417:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262679040:0@lo:400:kworker.0 00000100:00080000:3.0:1788270134.984427:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270134.984429:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270134.984430:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270134.984444:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262678528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270134.984451:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262678144:0@lo:400:kworker.0 00000100:00100000:2.0:1788270134.985027:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262679296:0@lo:400:kworker.0 00000100:00100000:1.0:1788270135.307278:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270135.307463:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270135.308293:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292032 00000100:00100000:3.0:1788270135.308305:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292032 00002000:00100000:3.0:1788270135.308375:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (29360128->31457279) req@ffff98c27c1d8380 x1875136253292032/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:551/0 lens 488/0 e 0 to 0 dl 1788270146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788270135.308386:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d8380 with x1875136253292032 ext(29360128->31457279) 00002000:00010000:3.0:1788270135.308392:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c1d8380 00000100:00080000:0.0:1788270135.308434:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270135.308471:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292160 00000100:00100000:3.0:1788270135.308475:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292160 00002000:00100000:3.0:1788270135.308494:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12582912->15728639) req@ffff98c27c1d9c00 x1875136253292160/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:551/0 lens 488/0 e 0 to 0 dl 1788270146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270135.308502:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d9c00 with x1875136253292160 ext(12582912->15728639) 00002000:00010000:3.0:1788270135.308505:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d9c00 00000100:00100000:3.0:1788270135.308525:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788270135.308535:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+23:2402:x1875136253292032:12345-192.168.201.42@tcp:4:dd.500 00000100:00100000:0.0:1788270135.308554:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:0.0:1788270135.308568:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253292160:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270135.366752:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+25:2402:x1875136253292032:12345-192.168.201.42@tcp:4:dd.500 Request processed in 58208us (59473us total) trans 30064771164 rc 0/0 00000100:00100000:2.0:1788270135.366765:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00002000:00100000:2.0:1788270135.366777:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (29360128->31457279) req@ffff98c27c1d8380 x1875136253292032/t30064771164(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:551/0 lens 488/448 e 0 to 0 dl 1788270146 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788270135.366785:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d8380 with x1875136253292032 ext(29360128->31457279) 00002000:00010000:2.0:1788270135.366790:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27c1d8380 00000001:00080000:2.0:1788270135.371102:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771164 is committed 00000001:00080000:2.0:1788270135.371128:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771160 is committed 00000100:00100000:0.0:1788270135.375193:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2402:x1875136253292160:12345-192.168.201.42@tcp:4:dd.0 Request processed in 66620us (67720us total) trans 30064771133 rc 0/0 00000100:00100000:0.0:1788270135.375206:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00002000:00100000:0.0:1788270135.375220:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (12582912->15728639) req@ffff98c27c1d9c00 x1875136253292160/t30064771133(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:551/0 lens 488/448 e 0 to 0 dl 1788270146 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270135.375228:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27c1d9c00 with x1875136253292160 ext(12582912->15728639) 00002000:00010000:0.0:1788270135.375234:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27c1d9c00 00010000:00010000:3.0:1788270135.748200:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788270136.007924:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771133 is committed 00000001:00080000:1.0:1788270136.007936:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771132 is committed 00010000:00010000:3.0:1788270136.773319:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270137.028201:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270137.028227:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262679808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270137.028296:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270137.028448:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679808 00000100:00100000:3.0:1788270137.028456:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679808 00000100:00100000:3.0:1788270137.028540:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788270137.028550:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262679808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270137.028577:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2121728 granted 142769856 pending 0 free 3846950912 avail 3615428608 00000100:00100000:3.0:1788270137.028625:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262679808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270137.028632:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788270137.028679:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262679808:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270137.028721:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270137.228230:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270137.228326:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292288 00000100:00100000:1.0:1788270137.228337:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292288 00000100:00100000:1.0:1788270137.228411:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 481 00000100:00100000:1.0:1788270137.228423:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:41706:x1875136253292288:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:1.0:1788270137.228443:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270137.228465:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0a7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020a8 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270137.228531:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270137.228546:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270137.228558:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270137.228603:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270137.228607:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270137.228628:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270137.228653:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0a7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 7 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270137.228671:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 6 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270137.228680:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270137.228683:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270137.228687:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169800, rc 0) 00000100:00100000:1.0:1788270137.228747:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:41706:x1875136253292288:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 327us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270137.228755:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 481 00000100:00080000:0.0:1788270137.228822:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270137.540916:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270137.540953:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262679936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270137.541027:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270137.541198:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262679936 00000100:00100000:3.0:1788270137.541206:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262679936 00000100:00100000:3.0:1788270137.541261:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788270137.541270:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262679936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270137.541304:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:3.0:1788270137.541362:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262679936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270137.541369:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788270137.541453:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262679936:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270137.796299:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270138.052435:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270138.052446:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270138.052475:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:2.0:1788270138.052488:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788270138.820225:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788270138.986756:0:50843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 09:42:18 (1788270138) 00000001:00080000:3.0:1788270139.090823:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771399 is committed 00000040:00080000:2.0:1788270139.524273:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270139.524282:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270139.524365:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 9 count 5 00000040:00080000:2.0:1788270139.524374:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270139.589836:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262680064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270139.589932:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270139.590062:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680064 00000100:00100000:3.0:1788270139.590070:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680064 00000100:00100000:3.0:1788270139.590123:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788270139.590133:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262680064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270139.590177:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270139.590237:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262680064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270139.590244:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788270139.590285:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262680064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270139.844652:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270139.909279:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909359:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909405:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909434:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909452:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909468:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909491:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.909516:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292928 00000100:00100000:2.0:1788270139.909525:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292928 00000100:00100000:0.0:1788270139.909554:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292800 00000100:00100000:0.0:1788270139.909561:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292800 00000100:00100000:2.0:1788270139.909594:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788270139.909607:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788270139.909609:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253292928:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270139.909621:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253292800:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270139.909681:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253292928:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270139.909689:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:1.0:1788270139.909811:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292672 00000100:00100000:1.0:1788270139.909815:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292672 00000100:00100000:1.0:1788270139.909840:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253293184 00000100:00100000:1.0:1788270139.909841:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253293184 00000100:00100000:1.0:1788270139.909849:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292544 00000100:00100000:1.0:1788270139.909850:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292544 00000100:00100000:1.0:1788270139.909858:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253293056 00000100:00100000:1.0:1788270139.909860:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253293056 00000100:00100000:1.0:1788270139.909869:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:1.0:1788270139.909874:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253292672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270139.910276:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253292416 00000100:00100000:3.0:1788270139.910281:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253292416 00000100:00100000:3.0:1788270139.910316:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:3.0:1788270139.910514:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253292416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270139.910957:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:2402:x1875136253292800:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1338us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270139.910968:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00080000:0.0:1788270139.911002:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270139.911007:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270139.911010:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270139.911013:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270139.911031:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270139.911137:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253293440 00000100:00100000:2.0:1788270139.911142:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253293440 00000100:00100000:2.0:1788270139.911292:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:2.0:1788270139.911302:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253293184:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270139.911345:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253293184:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270139.911352:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:2.0:1788270139.911368:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:2.0:1788270139.911375:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2402:x1875136253292544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270139.911420:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:2402:x1875136253292544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270139.911426:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:2.0:1788270139.911437:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:2.0:1788270139.911444:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253293056:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270139.911467:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253293056:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270139.911473:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:2.0:1788270139.911485:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 482 00000100:00100000:2.0:1788270139.911491:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+38:41993:x1875136253293440:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788270139.911501:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270139.911503:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270139.911531:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0a6e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102077 expref: 38 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270139.911550:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270139.911556:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270139.911569:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0a7c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020af expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270139.911665:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270139.911680:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270139.911688:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270139.911723:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270139.911737:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 5 pid: 45777 timeout: 1031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270139.911749:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262680192:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270139.911807:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143932300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270139.914053:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253292672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4148us (4664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270139.914067:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:3.0:1788270139.914724:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253292416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3699us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270139.914740:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:0.0:1788270139.915458:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262680192:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270139.915485:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270139.917257:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270139.917318:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253293568 00000100:00100000:3.0:1788270139.917327:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253293568 00010000:00010000:3.0:1788270139.917366:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 6 pid: 45777 timeout: 1031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270139.917511:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:1.0:1788270139.917522:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253293568:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270139.917537:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270139.917601:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 6 pid: 45777 timeout: 1031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.917615:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 6 pid: 45777 timeout: 1031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.917637:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a7c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020a8 expref: 6 pid: 45777 timeout: 1031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.917653:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270139.917659:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.917670:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.917679:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.917709:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270139.917749:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270139.917755:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253293568:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 234us (505us total) trans 0 rc 0/0 00010000:00010000:0.0:1788270139.917761:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270139.917766:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00010000:00010000:0.0:1788270139.917788:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.917797:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.917806:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270139.918640:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xca:0x0], index 0: 0 00010000:00010000:0.0:1788270139.918761:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a7dc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918774:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a7dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918782:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a7dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918816:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918823:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918829:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918835:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918840:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26ab5d200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270139.918844:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918852:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918862:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270139.918865:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270139.918869:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918875:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5d200/0xc5f5d7a016e0a7ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270139.918904:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ded4def9 reply state 000000005efd467c transno 30064771400 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918915:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918921:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270139.918924:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270139.918926:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270139.918961:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26ab5c200/0xc5f5d7a016e0a7c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020af expref: 40 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918976:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a7dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020af expref: 39 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.918984:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270139.918987:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270139.918989:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba200, rc 0) 00000100:00100000:0.0:1788270139.919072:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41993:x1875136253293440:12345-192.168.201.42@tcp:101:dd.0 Request processed in 7579us (8042us total) trans 30064771400 rc 0/0 00000100:00100000:0.0:1788270139.919080:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 482 00000100:00100000:2.0:1788270139.924134:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270139.924191:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253293696 00000100:00100000:3.0:1788270139.924202:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253293696 00000100:00100000:3.0:1788270139.924271:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:3.0:1788270139.924283:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+9:41993:x1875136253293696:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788270139.924300:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270139.924322:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6cd00ec/0xc5f5d7a016e0a7ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020b6 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788270139.924348:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788270139.924367:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=931s v=(0 0) 00010000:00010000:3.0:1788270139.924371:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270139.924380:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6cd00ec/0xc5f5d7a016e0a7ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020b6 expref: 10 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270139.924394:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6cd00ec/0xc5f5d7a016e0a7ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020b6 expref: 10 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270139.924406:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c27a0bea00, rc 0) 00000100:00100000:3.0:1788270139.924466:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:41993:x1875136253293696:12345-192.168.201.42@tcp:101:dd.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270139.924476:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:2.0:1788270139.957145:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270139.957436:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253293952 00000100:00100000:0.0:1788270139.957446:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253293952 00000100:00100000:0.0:1788270139.957584:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:0.0:1788270139.957593:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:41993:x1875136253293952:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:0.0:1788270139.957826:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41993:x1875136253293952:12345-192.168.201.42@tcp:35:dd.0 Request processed in 233us (693us total) trans 30064771401 rc 0/0 00000100:00100000:0.0:1788270139.957834:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:2.0:1788270139.979332:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270139.979403:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253294080 00000100:00100000:0.0:1788270139.979413:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253294080 00000100:00100000:0.0:1788270139.979478:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 483 00000100:00100000:0.0:1788270139.979488:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:41994:x1875136253294080:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270139.979521:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270139.979541:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a7f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020bd expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.979599:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a7f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.979613:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.979625:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270139.979664:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270139.979668:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270139.979685:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.979708:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a7f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020bd expref: 43 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.979725:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020bd expref: 42 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.979734:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270139.979737:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270139.979741:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba400, rc 0) 00000100:00100000:0.0:1788270139.979798:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:41994:x1875136253294080:12345-192.168.201.42@tcp:101:chown.0 Request processed in 311us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270139.979805:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 483 00000100:00100000:2.0:1788270139.982659:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270139.982727:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253294208 00000100:00100000:0.0:1788270139.982735:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253294208 00000100:00100000:0.0:1788270139.982783:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 484 00000100:00100000:0.0:1788270139.982793:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:41994:x1875136253294208:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788270139.982811:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270139.982829:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a7ff lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020c4 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.982865:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb800/0xc5f5d7a016e0a806 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.982891:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb800/0xc5f5d7a016e0a806 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.982903:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb800/0xc5f5d7a016e0a806 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.983006:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a7ff lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020c4 expref: 44 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.983024:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb800/0xc5f5d7a016e0a806 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020c4 expref: 43 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.983032:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270139.983035:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270139.983074:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb800, rc 0) 00000100:00100000:1.0:1788270139.983201:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:41994:x1875136253294208:12345-192.168.201.42@tcp:101:chown.0 Request processed in 407us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270139.983208:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 484 00000100:00100000:2.0:1788270139.985409:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270139.985925:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253294464 00000100:00100000:0.0:1788270139.985934:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253294464 00000100:00100000:0.0:1788270139.985999:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 485 00000100:00100000:0.0:1788270139.986009:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:41994:x1875136253294464:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:0.0:1788270139.986094:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270139.986131:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a7dc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020af expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.986151:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270139.986157:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270139.986184:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.986197:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.986207:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270139.986397:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].13, 88 off9168 00000004:00080000:0.0:1788270139.986407:0:45776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 931693366933ns, next at 932693364166ns, rc = 0 00000004:00010000:0.0:1788270139.986453:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d8292f6 reply state 0000000097f0b7f6 transno 30064771402 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.986465:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270139.986472:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270139.986475:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788270139.986478:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270139.986567:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41994:x1875136253294464:12345-192.168.201.42@tcp:36:chown.0 Request processed in 559us (1163us total) trans 30064771402 rc 0/0 00000100:00100000:0.0:1788270139.986574:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 485 00000100:00100000:2.0:1788270139.992824:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270139.993006:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253294592 00000100:00100000:1.0:1788270139.993016:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253294592 00000100:00100000:1.0:1788270139.993102:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 486 00000100:00100000:1.0:1788270139.993123:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:41994:x1875136253294592:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:1.0:1788270139.993148:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270139.993170:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a814 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020cb expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.993241:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a814 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020cb expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.993259:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a814 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020cb expref: 45 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270139.993289:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270139.993293:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270139.993297:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169800, rc 0) 00000100:00100000:1.0:1788270139.993358:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:41994:x1875136253294592:12345-192.168.201.42@tcp:101:chown.0 Request processed in 247us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270139.993366:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 486 00000100:00100000:2.0:1788270139.996233:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270139.996318:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253294720 00000100:00100000:3.0:1788270139.996328:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253294720 00000100:00100000:3.0:1788270139.996382:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:3.0:1788270139.996393:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253294720:12345-192.168.201.42@tcp:2:chown.0 00002000:00010000:3.0:1788270139.996566:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788270139.996571:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788270139.996573:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788270139.996575:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb ctime from disk: 0 -> 1788270140 00002000:00010000:3.0:1788270139.996577:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788270139.996634:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253294720:12345-192.168.201.42@tcp:2:chown.0 Request processed in 243us (409us total) trans 30064771134 rc 0/0 00000100:00100000:3.0:1788270139.996642:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:3.0:1788270140.032180:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.032373:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253294976 00000100:00100000:1.0:1788270140.032383:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253294976 00000100:00100000:1.0:1788270140.032446:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 487 00000100:00100000:1.0:1788270140.032456:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:42000:x1875136253294976:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270140.032477:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.032499:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020d2 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032587:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032602:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032615:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032626:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032633:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032640:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032757:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a830 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032766:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a830 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032774:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a830 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.032783:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 2097152 00010000:00010000:1.0:1788270140.032854:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032866:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032873:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032890:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.032895:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032902:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032914:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.032917:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.032922:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032928:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032942:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032948:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032954:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032959:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.032963:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032968:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032976:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:1.0:1788270140.032978:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.032981:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.032987:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.033029:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d2 expref: 48 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.033089:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a830 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d2 expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.033098:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.033101:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270140.033104:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168000, rc 0) 00000100:00100000:1.0:1788270140.033257:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:42000:x1875136253294976:12345-192.168.201.42@tcp:101:dd.500 Request processed in 801us (1087us total) trans 30064771403 rc 0/0 00000100:00100000:1.0:1788270140.033265:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 487 00000100:00100000:2.0:1788270140.040026:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.041826:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253295232 00000100:00100000:1.0:1788270140.041838:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253295232 00000100:00100000:1.0:1788270140.041917:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 488 00000100:00100000:1.0:1788270140.041929:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:42000:x1875136253295232:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270140.041953:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.041964:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1788270140.041991:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a814 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020cb expref: 47 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042012:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a830 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d2 expref: 46 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042024:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.042029:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270140.042062:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a83e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020d9 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042102:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042115:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042125:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042139:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042146:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042154:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042165:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.042169:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042177:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042184:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.042187:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270140.042191:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042197:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a845 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042217:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a84c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042224:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a84c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042232:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a84c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042361:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a84c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d9 expref: 48 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042370:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.042373:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270140.042381:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a83e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d9 expref: 48 pid: 48110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042394:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a84c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d9 expref: 47 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.042416:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.042419:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270140.042421:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169a00, rc 0) 00000100:00100000:1.0:1788270140.042488:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:42000:x1875136253295232:12345-192.168.201.42@tcp:101:dd.500 Request processed in 561us (2474us total) trans 30064771404 rc 0/0 00000100:00100000:1.0:1788270140.042496:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 488 00000100:00100000:2.0:1788270140.046653:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.046720:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253295360 00000100:00100000:0.0:1788270140.046730:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253295360 00002000:00100000:0.0:1788270140.046782:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xca:0x0] (0->2097151) req@ffff98c27fa49500 x1875136253295360/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270140.046794:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fa49500 with x1875136253295360 ext(0->2097151) 00002000:00010000:0.0:1788270140.046799:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fa49500 00000100:00100000:0.0:1788270140.046832:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:0.0:1788270140.046842:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253295360:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:0.0:1788270140.065210:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253295360:12345-192.168.201.42@tcp:4:dd.0 Request processed in 18359us (18556us total) trans 30064771135 rc 0/0 00000100:00100000:0.0:1788270140.065222:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00002000:00100000:0.0:1788270140.065235:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xca:0x0] (0->2097151) req@ffff98c27fa49500 x1875136253295360/t30064771135(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/448 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270140.065243:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fa49500 with x1875136253295360 ext(0->2097151) 00002000:00010000:0.0:1788270140.065250:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fa49500 00000100:00100000:2.0:1788270140.079236:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.079300:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253295488 00000100:00100000:0.0:1788270140.079311:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253295488 00002000:00100000:0.0:1788270140.079366:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xca:0x0] (0->1048575) req@ffff98c27fa48a80 x1875136253295488/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270140.079375:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fa48a80 with x1875136253295488 ext(0->1048575) 00002000:00010000:0.0:1788270140.079381:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fa48a80 00000100:00100000:0.0:1788270140.079409:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:0.0:1788270140.079418:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253295488:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:3.0:1788270140.091690:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253295488:12345-192.168.201.42@tcp:3:dd.0 Request processed in 12260us (12451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788270140.091706:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00002000:00100000:3.0:1788270140.091721:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xca:0x0] (0->1048575) req@ffff98c27fa48a80 x1875136253295488/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/440 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270140.091733:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fa48a80 with x1875136253295488 ext(0->1048575) 00002000:00010000:3.0:1788270140.091739:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c27fa48a80 00000100:00100000:0.0:1788270140.100215:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270140.100240:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262680448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270140.100240:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262680320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270140.100505:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262680704:0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.100565:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262680960:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101086:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.101126:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270140.101135:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262680576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270140.101159:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262680832:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101166:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270140.101193:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262681088:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.101194:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270140.101230:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.101235:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262681344:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101257:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262681600:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.101265:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.101288:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262681856:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101294:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.101317:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270140.101322:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262682112:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101351:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.101360:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680320 00000100:00100000:2.0:1788270140.101368:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680320 00000100:00100000:0.0:1788270140.101392:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680832 00000100:00100000:0.0:1788270140.101398:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680832 00000100:00100000:2.0:1788270140.101422:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680448 00000100:00100000:2.0:1788270140.101426:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680448 00000100:00100000:0.0:1788270140.101436:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681344 00000100:00100000:0.0:1788270140.101442:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681344 00000100:00100000:2.0:1788270140.101445:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680576 00000100:00100000:2.0:1788270140.101449:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680576 00000100:00100000:2.0:1788270140.101462:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788270140.101470:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262680320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270140.101500:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 241823424 pending 0 free 3779825664 avail 3548303360 00000100:00100000:0.0:1788270140.101531:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788270140.101540:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262680832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.101552:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262680320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270140.101560:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788270140.101578:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788270140.101586:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262680448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270140.101593:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262680832:12345-0@lo:400:kworker.0 Request processed in 52us (397us total) trans 0 rc 0/0 00002000:00000024:2.0:1788270140.101600:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 241823424 pending 0 free 3779825664 avail 3548303360 00000100:00100000:0.0:1788270140.101603:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788270140.101622:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788270140.101631:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262681344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.101636:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262680448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270140.101644:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788270140.101659:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788270140.101667:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262680576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270140.101673:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262681344:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00002000:00000024:2.0:1788270140.101678:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2121728 granted 151207616 pending 2121728 free 3846950912 avail 3615428608 00000100:00100000:0.0:1788270140.101683:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788270140.101716:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262680576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.101721:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771132 gen 2 00000100:00100000:2.0:1788270140.101725:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788270140.101729:0:3610:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c144381180, transno 30064771132 00000100:00080000:2.0:1788270140.101745:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270140.101746:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262680832:0@lo:400:kworker.0 00000100:00080000:2.0:1788270140.101751:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270140.101764:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262681344:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.101769:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681088 00000100:00100000:2.0:1788270140.101775:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681088 00000100:00100000:0.0:1788270140.101777:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771160 gen 2 00000004:00080000:0.0:1788270140.101782:0:3610:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c14a49df80, transno 30064771156 00000004:00080000:0.0:1788270140.101791:0:3610:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c275907800, transno 30064771159 00000004:00080000:0.0:1788270140.101795:0:3610:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c275906300, transno 30064771160 00000100:00100000:2.0:1788270140.101803:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681600 00000100:00100000:0.0:1788270140.101807:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262680448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270140.101808:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681600 00000100:00100000:2.0:1788270140.101825:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681856 00000100:00100000:2.0:1788270140.101829:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681856 00000100:00100000:0.0:1788270140.101846:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262682112 00000100:00100000:0.0:1788270140.101851:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262682112 00000100:00100000:2.0:1788270140.101853:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788270140.101864:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262681088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101893:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788270140.101901:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262681600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.101917:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262681088:12345-0@lo:400:kworker.0 Request processed in 55us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270140.101925:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788270140.101944:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788270140.101944:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262681600:12345-0@lo:400:kworker.0 Request processed in 42us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.101958:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788270140.101959:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262681856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.101978:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788270140.101988:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262682112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.102002:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262681856:12345-0@lo:400:kworker.0 Request processed in 47us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270140.102010:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788270140.102027:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262682112:12345-0@lo:400:kworker.0 Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00080000:2.0:1788270140.102028:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270140.102061:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788270140.102077:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262680576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270140.102098:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262681856:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.102099:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262681088:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.102118:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262681600:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.102131:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262682112:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.102146:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262680320:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788270140.102251:0:45802:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1788270140.102502:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270140.102536:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262681472:0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.102557:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270140.102575:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262681984:0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.102595:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270140.102599:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680960 00000100:00100000:0.0:1788270140.102605:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680960 00000100:00100000:1.0:1788270140.102625:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681984 00000100:00100000:1.0:1788270140.102630:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681984 00000100:00100000:0.0:1788270140.102635:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681472 00000100:00100000:0.0:1788270140.102640:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681472 00000100:00100000:1.0:1788270140.102665:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788270140.102671:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788270140.102675:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262681984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.102684:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262680960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.102716:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262681984:12345-0@lo:400:kworker.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.102724:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788270140.102728:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262680960:12345-0@lo:400:kworker.0 Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.102735:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788270140.102746:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270140.102752:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788270140.102760:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262681472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.102771:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262680960:0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.102785:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262681984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.102794:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262681472:12345-0@lo:400:kworker.0 Request processed in 34us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.102801:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788270140.102804:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262681472:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.103301:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.103338:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262681216:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.103366:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270140.103431:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262680704 00000100:00100000:1.0:1788270140.103436:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262680704 00000100:00100000:1.0:1788270140.103480:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788270140.103488:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262680704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270140.103523:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262680704:12345-0@lo:400:kworker.0 Request processed in 36us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.103530:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788270140.103594:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262681728:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.103619:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270140.103650:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262680704:0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.103666:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681728 00000100:00100000:0.0:1788270140.103672:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681728 00000100:00100000:3.0:1788270140.103756:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262681216 00000100:00100000:3.0:1788270140.103760:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262681216 00000100:00100000:0.0:1788270140.103775:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788270140.103784:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262681728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270140.103794:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788270140.103803:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262681216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270140.103826:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262681728:12345-0@lo:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.103834:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788270140.103923:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262681216:0@lo:400:kworker.0 00000100:00100000:2.0:1788270140.103934:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262681728:0@lo:400:kworker.0 00000100:00100000:3.0:1788270140.103972:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262681216:12345-0@lo:400:kworker.0 Request processed in 170us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270140.103980:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788270140.103992:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270140.108179:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.111542:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253295616 00000100:00100000:1.0:1788270140.111559:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253295616 00002000:00100000:1.0:1788270140.111619:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xca:0x0] (1048576->2097151) req@ffff98c1428ff800 x1875136253295616/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.111632:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428ff800 with x1875136253295616 ext(1048576->2097151) 00002000:00010000:1.0:1788270140.111638:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428ff800 00000100:00100000:1.0:1788270140.111676:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788270140.111686:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253295616:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:1.0:1788270140.119823:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253295616:12345-192.168.201.42@tcp:3:dd.0 Request processed in 8126us (11638us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788270140.119836:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00002000:00100000:1.0:1788270140.119849:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xca:0x0] (1048576->2097151) req@ffff98c1428ff800 x1875136253295616/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/440 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.119861:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1428ff800 with x1875136253295616 ext(1048576->2097151) 00002000:00010000:1.0:1788270140.119868:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1428ff800 00000100:00100000:2.0:1788270140.135119:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270140.135221:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253295872 00000100:00100000:3.0:1788270140.135231:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253295872 00000100:00100000:3.0:1788270140.135340:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:3.0:1788270140.135352:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:42000:x1875136253295872:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:3.0:1788270140.135617:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42000:x1875136253295872:12345-192.168.201.42@tcp:35:dd.500 Request processed in 269us (508us total) trans 30064771405 rc 0/0 00000100:00100000:3.0:1788270140.135623:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:0.0:1788270140.202809:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.203240:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253296000 00000100:00100000:1.0:1788270140.203259:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253296000 00000100:00100000:1.0:1788270140.203489:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 489 00000100:00100000:1.0:1788270140.203502:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42010:x1875136253296000:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270140.203612:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203634:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203649:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203662:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203669:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203676:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203773:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203782:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203789:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270140.203854:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203870:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203888:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203896:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203902:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.203908:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203916:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203931:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.203935:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.203940:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.203946:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204625:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204639:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204647:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204652:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.204656:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204663:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204672:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:1.0:1788270140.204675:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.204679:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204686:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a85a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204698:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204705:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204710:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204715:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.204718:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204728:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.204735:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.204737:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.204740:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.209483:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a861 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270140.209668:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42010:x1875136253296000:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 6161us (6862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.209680:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 489 00000100:00100000:2.0:1788270140.239561:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.239658:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253296256 00000100:00100000:1.0:1788270140.239667:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253296256 00000100:00100000:1.0:1788270140.239795:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 490 00000100:00100000:1.0:1788270140.239807:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42011:x1875136253296256:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270140.239838:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.239860:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020e0 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.239942:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.239967:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.239978:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.239990:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.239997:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240004:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240103:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240110:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240115:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240121:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240127:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.240130:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240137:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240149:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.240152:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.240157:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240164:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240177:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240183:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240189:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240194:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.240197:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240203:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240209:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:1.0:1788270140.240212:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.240215:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240220:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240244:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a868 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020e0 expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240260:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.240262:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788270140.240266:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020e0 expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.240275:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168000, rc 0) 00000100:00100000:1.0:1788270140.240333:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42011:x1875136253296256:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 529us (781us total) trans 0 rc 301/301 00000100:00100000:1.0:1788270140.240340:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 490 00000100:00100000:2.0:1788270140.242526:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.242589:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253296384 00000100:00100000:0.0:1788270140.242598:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253296384 00000100:00100000:0.0:1788270140.242646:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 491 00000100:00100000:0.0:1788270140.242656:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42011:x1875136253296384:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788270140.242714:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242729:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242740:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242762:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242770:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242777:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242842:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242851:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.242858:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270140.243397:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 2097152 00000004:00200000:0.0:1788270140.243403:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270140.243416:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243430:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243438:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243445:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243451:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270140.243455:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243463:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243477:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270140.243480:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270140.243485:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243491:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0a87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243504:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243510:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243515:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243520:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500baa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270140.243523:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243529:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243536:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270140.243538:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270140.243541:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243547:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a884 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243560:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243566:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243572:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243577:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270140.243580:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243585:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243592:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270140.243594:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270140.243597:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.243602:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a88b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270140.243675:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42011:x1875136253296384:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 1019us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.243684:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 491 00000100:00100000:2.0:1788270140.274698:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.274824:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253296640 00000100:00100000:1.0:1788270140.274834:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253296640 00000100:00100000:1.0:1788270140.275115:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 492 00000100:00100000:1.0:1788270140.275130:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42017:x1875136253296640:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270140.275162:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.275166:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788270140.275194:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a7f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020bd expref: 48 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275215:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.275220:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270140.275233:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a892 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020e7 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275358:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275374:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275382:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275391:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275398:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275404:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275455:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8a7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275463:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8a7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275470:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8a7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.275479:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 2097152 00010000:00010000:1.0:1788270140.275550:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275557:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275563:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275569:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.275573:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275580:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275588:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.275591:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.275595:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275600:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275608:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275614:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275619:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275623:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.275625:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275631:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275642:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:1.0:1788270140.275644:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.275647:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275652:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275682:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a892 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020e7 expref: 50 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275695:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8a7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020e7 expref: 49 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.275702:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.275704:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270140.275706:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169800, rc 0) 00000100:00100000:1.0:1788270140.276030:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:42017:x1875136253296640:12345-192.168.201.42@tcp:101:dd.0 Request processed in 902us (1342us total) trans 30064771406 rc 0/0 00000100:00100000:1.0:1788270140.276073:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 492 00000100:00100000:2.0:1788270140.278555:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.278736:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253296896 00000100:00100000:1.0:1788270140.278745:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253296896 00000100:00100000:1.0:1788270140.278793:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 493 00000100:00100000:1.0:1788270140.278802:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:42017:x1875136253296896:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:1.0:1788270140.278851:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788270140.278888:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a84c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020d9 expref: 49 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.278916:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8a7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020e7 expref: 48 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.278926:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.278930:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270140.279114:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.279126:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.279135:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788270140.279174:0:46770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771407 00000004:00010000:1.0:1788270140.279192:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5c8fe93 reply state 00000000c4573e7e transno 30064771408 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.279204:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.279210:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.279223:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788270140.279226:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788270140.279303:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:42017:x1875136253296896:12345-192.168.201.42@tcp:36:dd.0 Request processed in 501us (754us total) trans 30064771408 rc 0/0 00000100:00100000:1.0:1788270140.279310:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 493 00000020:00080000:1.0:1788270140.279314:0:46770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788270140.281029:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.281255:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253297024 00000100:00100000:0.0:1788270140.281265:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253297024 00000100:00100000:0.0:1788270140.281324:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 494 00000100:00100000:0.0:1788270140.281334:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:42017:x1875136253297024:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788270140.281352:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270140.281370:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a8bc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020ee expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.281419:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a8bc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020ee expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.281435:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a8bc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020ee expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.281453:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270140.281456:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788270140.281460:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500baa00, rc 0) 00000100:00100000:0.0:1788270140.281503:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:42017:x1875136253297024:12345-192.168.201.42@tcp:101:dd.0 Request processed in 171us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.281508:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 494 00000100:00100000:0.0:1788270140.284158:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.284199:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253297280 00000100:00100000:1.0:1788270140.284209:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253297280 00000100:00100000:1.0:1788270140.284271:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 495 00000100:00100000:1.0:1788270140.284282:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:42017:x1875136253297280:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270140.284301:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.284304:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788270140.284328:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a8bc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020ee expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284345:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.284350:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270140.284362:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a8c3 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020f5 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284406:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ca lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284418:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ca lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284437:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ca lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284558:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020f5 expref: 53 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284566:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.284569:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270140.284576:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a8c3 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020f5 expref: 53 pid: 48110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284604:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020f5 expref: 52 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.284623:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.284626:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270140.284628:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169c00, rc 0) 00000100:00100000:1.0:1788270140.284674:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:42017:x1875136253297280:12345-192.168.201.42@tcp:101:dd.0 Request processed in 395us (525us total) trans 30064771409 rc 0/0 00000100:00100000:1.0:1788270140.284682:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 495 00000100:00100000:2.0:1788270140.291287:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.291412:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253297536 00000100:00100000:1.0:1788270140.291422:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253297536 00000100:00100000:1.0:1788270140.291489:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 496 00000100:00100000:1.0:1788270140.291499:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:42017:x1875136253297536:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:1.0:1788270140.291521:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.291523:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788270140.291548:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ca lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020f5 expref: 52 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.291564:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.291568:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270140.291588:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a8d1 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561020fc expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.291631:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8d8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.291646:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.291655:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788270140.291865:0:45778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].14, 88 off9256 00000004:00080000:1.0:1788270140.291886:0:45778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 931998846275ns, next at 932693364166ns, rc = 0 00000001:00080000:2.0:1788270140.293870:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771410 is committed 00000004:00080000:2.0:1788270140.293894:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000004:00080000:2.0:1788270140.293957:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00010000:00010000:0.0:1788270140.294060:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294073:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294081:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294089:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270140.294094:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294103:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294121:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270140.294124:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270140.294128:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294134:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a7d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294157:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294164:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294169:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294174:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270140.294177:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294182:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294189:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270140.294192:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270140.294195:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294201:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a80d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294211:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294218:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294223:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294228:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270140.294231:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294237:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294245:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270140.294247:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270140.294250:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.294255:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a8b5 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270140.294441:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262682240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788270140.294501:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270140.294544:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262682240 00000100:00100000:1.0:1788270140.294552:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262682240 00000100:00100000:1.0:1788270140.294703:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788270140.294713:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262682240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788270140.294837:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788270140.294840:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb mtime from disk: 0 -> 1788270140 00002000:00010000:1.0:1788270140.294842:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270140.294844:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb ctime from disk: 1788270140 -> 1788270140 00002000:00010000:1.0:1788270140.294846:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:3.0:1788270140.295017:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8d8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020fc expref: 40 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270140.295027:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:3.0:1788270140.295030:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788270140.295059:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a8d1 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020fc expref: 40 pid: 45778 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270140.295075:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8d8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020fc expref: 39 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270140.295114:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:3.0:1788270140.295116:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788270140.295118:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169800, rc 0) 00000100:00100000:3.0:1788270140.295234:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:42017:x1875136253297536:12345-192.168.201.42@tcp:101:dd.0 Request processed in 3736us (3956us total) trans 30064771410 rc 0/0 00000100:00100000:3.0:1788270140.295242:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 496 00000100:00100000:1.0:1788270140.295369:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262682240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 658us (867us total) trans 30064771136 rc 0/0 00000100:00100000:1.0:1788270140.295376:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000004:00080000:0.0:1788270140.295697:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1440c0e00/2, rc 0, transno 30064771136 00000100:00100000:0.0:1788270140.295711:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262682240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788270140.295818:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270140.295829:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262682368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788270140.295859:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270140.296036:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262682368 00000100:00100000:1.0:1788270140.296064:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262682368 00000100:00100000:1.0:1788270140.296095:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788270140.296102:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262682368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788270140.296181:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1788270140.296185:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb mtime from disk: 1788270140 -> 1788270140 00002000:00010000:1.0:1788270140.296187:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270140.296189:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb ctime from disk: 1788270140 -> 1788270140 00002000:00010000:1.0:1788270140.296191:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1788270140.296236:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262682368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (376us total) trans 30064771137 rc 0/0 00000100:00100000:1.0:1788270140.296243:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000004:00080000:2.0:1788270140.296262:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1440c0a80/2, rc 0, transno 30064771137 00000100:00100000:2.0:1788270140.296269:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262682368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788270140.298316:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.298445:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253297664 00000100:00100000:0.0:1788270140.298453:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253297664 00002000:00010000:0.0:1788270140.298484:0:47287:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/202 (0->18446744073709551615) 00002000:00100000:0.0:1788270140.298488:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262ce00 with x1875136253297664 ext(0->18446744073709551615) 00002000:00010000:0.0:1788270140.298498:0:47287:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262ce00. 00000100:00100000:0.0:1788270140.298528:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:0.0:1788270140.298537:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253297664:12345-192.168.201.42@tcp:10:dd.0 00002000:00010000:0.0:1788270140.300767:0:47287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:0.0:1788270140.300776:0:47287:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb mtime from disk: 1788270140 -> 1788270140 00002000:00010000:0.0:1788270140.300779:0:47287:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788270140.300781:0:47287:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb ctime from disk: 1788270140 -> 1788270140 00002000:00010000:0.0:1788270140.300784:0:47287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xca:0x0] updating lvb blocks from disk: 4096 -> 0 00000100:00100000:0.0:1788270140.300859:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253297664:12345-192.168.201.42@tcp:10:dd.0 Request processed in 2319us (2547us total) trans 30064771138 rc 0/0 00000100:00100000:0.0:1788270140.300869:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00002000:00010000:0.0:1788270140.301402:0:47287:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/202 (0->18446744073709551615) 00002000:00100000:0.0:1788270140.301407:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262ce00 with x1875136253297664 ext(0->18446744073709551615) 00002000:00010000:0.0:1788270140.301414:0:47287:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262ce00. 00000100:00100000:2.0:1788270140.369396:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.370807:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253297792 00000100:00100000:0.0:1788270140.370822:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253297792 00002000:00100000:0.0:1788270140.370888:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xca:0x0] (0->4194303) req@ffff98c14262fb80 x1875136253297792/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270140.370900:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262fb80 with x1875136253297792 ext(0->4194303) 00002000:00010000:0.0:1788270140.370907:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262fb80 00000100:00100000:0.0:1788270140.370943:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:0.0:1788270140.370953:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253297792:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:2.0:1788270140.391094:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.391190:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253298048 00000100:00100000:0.0:1788270140.391201:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253298048 00000100:00100000:1.0:1788270140.391509:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:1.0:1788270140.391524:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+39:42017:x1875136253298048:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:1.0:1788270140.391896:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:42017:x1875136253298048:12345-192.168.201.42@tcp:35:dd.0 Request processed in 368us (801us total) trans 30064771411 rc 0/0 00000100:00100000:1.0:1788270140.391905:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:0.0:1788270140.428517:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2402:x1875136253297792:12345-192.168.201.42@tcp:4:dd.0 Request processed in 57556us (59123us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1788270140.428528:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00002000:00100000:0.0:1788270140.428539:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xca:0x0] (0->4194303) req@ffff98c14262fb80 x1875136253297792/t30064771139(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/448 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270140.428546:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262fb80 with x1875136253297792 ext(0->4194303) 00002000:00010000:0.0:1788270140.428551:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262fb80 00000100:00100000:1.0:1788270140.437956:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.438265:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253298176 00000100:00100000:0.0:1788270140.438274:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253298176 00000100:00100000:0.0:1788270140.438335:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 497 00000100:00100000:0.0:1788270140.438346:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+40:42027:x1875136253298176:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270140.438370:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270140.438391:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a8df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102103 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.438451:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a8e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.438466:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.438477:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270140.438522:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270140.438526:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270140.438545:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.438569:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a8df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102103 expref: 42 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.438586:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102103 expref: 41 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.438595:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270140.438598:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270140.438602:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb400, rc 0) 00000100:00100000:0.0:1788270140.438665:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:42027:x1875136253298176:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 320us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.438672:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 497 00000100:00100000:2.0:1788270140.440571:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.440624:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253298304 00000100:00100000:1.0:1788270140.440632:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253298304 00000100:00100000:1.0:1788270140.440679:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 498 00000100:00100000:1.0:1788270140.440688:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:42027:x1875136253298304:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270140.440741:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440755:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440765:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440779:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440787:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440795:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440862:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440883:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440891:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270140.440933:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440945:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440952:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440959:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440964:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.440969:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440976:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.440988:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.440992:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.440997:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441003:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a8ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441016:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441023:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441029:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441034:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.441074:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441083:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441104:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1434d7100) 00010000:00010000:1.0:1788270140.441106:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.441110:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441116:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a8f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441131:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441138:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441143:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441210:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.441213:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441219:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441228:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.441230:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.441234:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.441239:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a8fb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270140.441312:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:42027:x1875136253298304:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 625us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.441320:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 498 00000100:00100000:3.0:1788270140.501956:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.502283:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253298560 00000100:00100000:1.0:1788270140.502297:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253298560 00000100:00100000:1.0:1788270140.502388:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 499 00000100:00100000:1.0:1788270140.502396:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+41:42033:x1875136253298560:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270140.502413:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.502437:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610210a expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502508:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502523:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502535:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502550:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502556:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502563:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502681:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a917 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502690:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a917 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502697:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a917 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.502708:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 5242880 00010000:00010000:1.0:1788270140.502775:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502787:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502794:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502800:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.502805:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502812:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502825:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.502828:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.502833:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502851:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0a909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502863:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502970:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502978:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502982:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.502986:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502991:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.502997:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1434d7100) 00010000:00010000:1.0:1788270140.503000:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.503002:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.503007:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a910 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.503084:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610210a expref: 44 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.503098:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a917 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610210a expref: 43 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.503104:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.503106:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270140.503109:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168600, rc 0) 00000100:00100000:1.0:1788270140.503185:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:42033:x1875136253298560:12345-192.168.201.42@tcp:101:dd.500 Request processed in 788us (1243us total) trans 30064771412 rc 0/0 00000100:00100000:1.0:1788270140.503191:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 499 00000100:00100000:2.0:1788270140.509651:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.509701:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253298816 00000100:00100000:1.0:1788270140.509711:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253298816 00000100:00100000:1.0:1788270140.509771:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 500 00000100:00100000:1.0:1788270140.509781:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:42033:x1875136253298816:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270140.509805:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.509809:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1788270140.509914:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a8d8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561020fc expref: 43 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.509943:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a917 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610210a expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.509954:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.509959:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788270140.509971:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a925 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102111 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510012:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510025:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510035:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510860:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510876:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510884:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510895:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.510899:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510907:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510917:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.510921:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270140.510925:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510931:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a92c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510958:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a933 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510967:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a933 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.510974:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a933 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.511161:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a933 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102111 expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.511170:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.511172:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270140.511183:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a925 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102111 expref: 44 pid: 46770 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.511197:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168000/0xc5f5d7a016e0a933 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102111 expref: 43 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.511221:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.511223:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788270140.511225:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168000, rc 0) 00000100:00100000:1.0:1788270140.511299:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:42033:x1875136253298816:12345-192.168.201.42@tcp:101:dd.500 Request processed in 1519us (1657us total) trans 30064771413 rc 0/0 00000100:00100000:1.0:1788270140.511308:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 500 00000100:00100000:3.0:1788270140.517239:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270140.517345:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253298944 00000100:00100000:0.0:1788270140.517356:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253298944 00002000:00100000:0.0:1788270140.517403:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xca:0x0] (4194304->5242879) req@ffff98c1440c1f80 x1875136253298944/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270140.517415:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c1f80 with x1875136253298944 ext(4194304->5242879) 00002000:00010000:0.0:1788270140.517421:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1440c1f80 00000100:00100000:0.0:1788270140.517458:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:0.0:1788270140.517468:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253298944:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270140.531587:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253298944:12345-192.168.201.42@tcp:4:dd.0 Request processed in 14108us (14346us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1788270140.531601:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00002000:00100000:1.0:1788270140.531614:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xca:0x0] (4194304->5242879) req@ffff98c1440c1f80 x1875136253298944/t30064771140(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/448 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.531624:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1440c1f80 with x1875136253298944 ext(4194304->5242879) 00002000:00010000:1.0:1788270140.531630:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1440c1f80 00000100:00100000:2.0:1788270140.545929:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.546094:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253299072 00000100:00100000:1.0:1788270140.546105:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253299072 00002000:00100000:1.0:1788270140.546155:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xca:0x0] (0->1048575) req@ffff98c14262e680 x1875136253299072/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.546167:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262e680 with x1875136253299072 ext(0->1048575) 00002000:00010000:1.0:1788270140.546172:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262e680 00000100:00100000:1.0:1788270140.546195:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788270140.546204:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253299072:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:1.0:1788270140.555968:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253299072:12345-192.168.201.42@tcp:3:dd.0 Request processed in 9755us (10037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788270140.555980:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00002000:00100000:1.0:1788270140.555994:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xca:0x0] (0->1048575) req@ffff98c14262e680 x1875136253299072/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/440 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.556004:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262e680 with x1875136253299072 ext(0->1048575) 00002000:00010000:1.0:1788270140.556011:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262e680 00000100:00100000:2.0:1788270140.568953:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.569173:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253299200 00000100:00100000:1.0:1788270140.569183:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253299200 00002000:00100000:1.0:1788270140.569289:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xca:0x0] (1048576->5242879) req@ffff98c14262f800 x1875136253299200/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/0 e 0 to 0 dl 1788270151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.569300:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262f800 with x1875136253299200 ext(1048576->5242879) 00002000:00010000:1.0:1788270140.569307:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262f800 00000100:00100000:1.0:1788270140.569380:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:1.0:1788270140.569391:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2403:x1875136253299200:12345-192.168.201.42@tcp:3:dd.0 00000100:00100000:1.0:1788270140.603716:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2403:x1875136253299200:12345-192.168.201.42@tcp:3:dd.0 Request processed in 34318us (34766us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1788270140.603727:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00002000:00100000:1.0:1788270140.603737:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xca:0x0] (1048576->5242879) req@ffff98c14262f800 x1875136253299200/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:556/0 lens 488/440 e 0 to 0 dl 1788270151 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270140.603745:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262f800 with x1875136253299200 ext(1048576->5242879) 00002000:00010000:1.0:1788270140.603750:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262f800 00000100:00100000:2.0:1788270140.656862:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270140.657392:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253299456 00000100:00100000:3.0:1788270140.657403:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253299456 00000100:00100000:2.0:1788270140.657643:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:2.0:1788270140.657655:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:42033:x1875136253299456:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:2.0:1788270140.658034:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42033:x1875136253299456:12345-192.168.201.42@tcp:35:dd.500 Request processed in 379us (1181us total) trans 30064771414 rc 0/0 00000100:00100000:2.0:1788270140.658060:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:0.0:1788270140.710215:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.710348:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253299584 00000100:00100000:1.0:1788270140.710420:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253299584 00000100:00100000:1.0:1788270140.710514:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 501 00000100:00100000:1.0:1788270140.710525:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42039:x1875136253299584:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270140.710598:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710615:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710626:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710639:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710645:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710652:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710721:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710730:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710736:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788270140.710851:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710932:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710940:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710947:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710953:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710959:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.710963:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710970:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710981:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.710984:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.710989:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.710995:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a93a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711009:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711014:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711020:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711026:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.711028:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711034:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711085:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1434d7100) 00010000:00010000:1.0:1788270140.711087:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.711090:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711095:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711112:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711118:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711124:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711128:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.711131:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711141:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711149:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.711151:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.711155:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.711160:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a948 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270140.711245:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42039:x1875136253299584:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 721us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.711253:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 501 00000100:00100000:3.0:1788270140.734224:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.734668:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253299840 00000100:00100000:1.0:1788270140.734679:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253299840 00000100:00100000:1.0:1788270140.734793:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 502 00000100:00100000:1.0:1788270140.734806:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42040:x1875136253299840:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270140.734829:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.734850:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a94f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102118 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.734946:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.734960:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.734972:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.734987:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.734996:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735003:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735114:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735122:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735129:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735136:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.735140:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735148:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735160:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.735163:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.735167:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735174:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735187:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735192:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735198:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735203:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.735205:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735210:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735218:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1434d7100) 00010000:00010000:1.0:1788270140.735221:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.735224:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735230:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a95d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735265:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a94f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102118 expref: 45 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735275:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.735277:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788270140.735281:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a94f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102118 expref: 45 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.735290:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168600, rc 0) 00000100:00100000:1.0:1788270140.735358:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42040:x1875136253299840:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 555us (1144us total) trans 0 rc 301/301 00000100:00100000:1.0:1788270140.735365:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 502 00000100:00100000:2.0:1788270140.737565:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.737649:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253299968 00000100:00100000:1.0:1788270140.737658:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253299968 00000100:00100000:1.0:1788270140.737764:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 503 00000100:00100000:1.0:1788270140.737775:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42040:x1875136253299968:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788270140.737843:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737860:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737887:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737903:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737911:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737918:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737986:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.737996:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.738002:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.738070:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 5242880 00000004:00200000:1.0:1788270140.738075:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270140.740112:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740142:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740151:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740157:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740163:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740169:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.740173:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740180:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740196:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.740200:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.740204:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740211:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740229:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740235:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740241:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740246:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.740249:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740255:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740262:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1434d7a00) 00010000:00010000:1.0:1788270140.740265:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.740268:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740273:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a96b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740291:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740298:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740304:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740309:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.740311:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740317:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740325:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.740327:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.740330:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.740335:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a972 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270140.740429:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42040:x1875136253299968:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 2651us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.740438:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 503 00000100:00100000:3.0:1788270140.780249:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.780362:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253300096 00000100:00100000:1.0:1788270140.780372:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253300096 00000100:00100000:1.0:1788270140.780439:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 504 00000100:00100000:1.0:1788270140.780451:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42046:x1875136253300096:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270140.780471:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.780492:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610211f expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780557:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780571:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780582:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780595:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780602:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780608:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780683:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780692:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780699:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.780743:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 5242880 00000004:00200000:1.0:1788270140.780748:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270140.780767:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780780:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780789:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780794:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780801:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780807:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780812:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.780816:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780824:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780836:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270140.780838:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.780842:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780848:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0a980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780862:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780884:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780890:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780895:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270140.780898:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780904:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780910:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff98c1434d7a00) 00010000:00010000:1.0:1788270140.780913:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270140.780915:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780920:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0a987 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780950:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 46 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780961:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 45 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.780967:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.780969:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270140.780972:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168600, rc 0) 00000100:00100000:1.0:1788270140.781083:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:42046:x1875136253300096:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 588us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270140.781091:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 504 00000100:00100000:3.0:1788270140.783464:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.783549:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253300352 00000100:00100000:1.0:1788270140.783558:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253300352 00000100:00100000:1.0:1788270140.783668:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 505 00000100:00100000:1.0:1788270140.783678:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:42046:x1875136253300352:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270140.783698:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.783717:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102126 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.783818:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a99c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.783832:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a99c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.783844:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a99c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.783855:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 5242880 00010000:00010000:1.0:1788270140.783980:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102126 expref: 48 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.784000:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169e00/0xc5f5d7a016e0a99c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102126 expref: 47 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.784010:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.784013:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788270140.784017:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169e00, rc 0) 00000100:00100000:1.0:1788270140.784255:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:42046:x1875136253300352:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 578us (800us total) trans 30064771415 rc 0/0 00000100:00100000:1.0:1788270140.784262:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 505 00000100:00100000:2.0:1788270140.856314:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.856722:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253300608 00000100:00100000:1.0:1788270140.856733:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253300608 00000100:00100000:1.0:1788270140.856840:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 506 00000100:00100000:1.0:1788270140.856851:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:42052:x1875136253300608:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270140.856886:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270140.856906:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a9aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610212d expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.857009:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.857023:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 48 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.857031:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.857106:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 48 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.857125:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 48 pid: 45776 timeout: 1032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270140.857140:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262682496:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270140.857229:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244900 going to sleep for 11 seconds 00000100:00100000:3.0:1788270140.859572:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270140.859678:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262682496:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270140.859700:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270140.859776:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253300736 00000100:00100000:0.0:1788270140.859783:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253300736 00010000:00010000:0.0:1788270140.859817:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 49 pid: 45776 timeout: 1032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270140.859853:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:0.0:1788270140.859870:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:2401:x1875136253300736:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270140.859885:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270140.859892:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 49 pid: 45776 timeout: 1032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.859904:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 49 pid: 45776 timeout: 1032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.859928:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0a98e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610211f expref: 49 pid: 45776 timeout: 1032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.859940:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:0.0:1788270140.859943:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.859950:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.859954:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270140.861982:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270140.862312:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253300736:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 2444us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270140.862323:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00010000:00010000:1.0:1788270140.862606:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.862617:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270140.862637:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 5242880 00010000:00010000:1.0:1788270140.862774:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0a9aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610212d expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.862809:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169c00/0xc5f5d7a016e0a9b1 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610212d expref: 48 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270140.862819:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff98c1429f2200) 00010000:00010000:1.0:1788270140.862823:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788270140.862826:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169c00, rc 0) 00000100:00100000:1.0:1788270140.862878:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42052:x1875136253300608:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 6028us (6573us total) trans 30064771416 rc 0/0 00000100:00100000:1.0:1788270140.862885:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 506 00010000:00010000:1.0:1788270140.868194:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270141.892189:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270142.148669:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262682624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270142.148738:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270142.148979:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262682624 00000100:00100000:3.0:1788270142.148988:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262682624 00000100:00100000:3.0:1788270142.149079:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788270142.149089:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262682624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270142.149116:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2121728 granted 168083136 pending 7413760 free 3841708032 avail 3610185728 00000100:00080000:2.0:1788270142.149291:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270142.149459:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262682624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 371us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270142.149467:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788270142.149527:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262682624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270142.660377:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262682752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270142.660435:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270142.660531:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262682752 00000100:00100000:2.0:1788270142.660538:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262682752 00000100:00100000:2.0:1788270142.660599:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788270142.660609:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262682752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270142.660640:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:2.0:1788270142.660916:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262682752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 308us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270142.660940:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788270142.661121:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262682752:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270142.917699:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270143.485982:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270143.486143:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253300864 00000100:00100000:0.0:1788270143.486153:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253300864 00000100:00080000:2.0:1788270143.486342:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270143.486348:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 507 00000100:00100000:1.0:1788270143.486360:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:42488:x1875136253300864:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:1.0:1788270143.486381:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270143.486402:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0a9bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102134 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270143.486464:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270143.486479:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270143.486503:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270143.486557:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270143.486561:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270143.486581:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270143.486607:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0a9bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 7 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270143.486625:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 6 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270143.486635:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270143.486637:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270143.486642:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168e00, rc 0) 00000100:00100000:1.0:1788270143.486702:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:42488:x1875136253300864:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 344us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270143.486710:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 507 00010000:00010000:1.0:1788270143.940745:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270144.708268:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270144.708299:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262682880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270144.708392:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270144.708504:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262682880 00000100:00100000:3.0:1788270144.708514:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262682880 00000100:00100000:3.0:1788270144.708578:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788270144.708590:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262682880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270144.708632:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270144.708685:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262682880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270144.708693:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788270144.708782:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262682880:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270144.968203:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270145.029104:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.029164:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.029196:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253300992 00000100:00100000:3.0:1788270145.029209:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253300992 00000100:00100000:3.0:1788270145.029384:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00100000:3.0:1788270145.029397:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253300992:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270145.029524:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253300992:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 129us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.029533:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00100000:3.0:1788270145.029591:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.029693:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.029715:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.029735:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270145.029862:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301120 00000100:00100000:1.0:1788270145.029868:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301120 00000100:00100000:1.0:1788270145.029917:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301248 00000100:00100000:1.0:1788270145.029920:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301248 00000100:00100000:1.0:1788270145.029940:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301632 00000100:00100000:1.0:1788270145.029943:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301632 00000100:00100000:1.0:1788270145.029960:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 185 00000100:00100000:1.0:1788270145.029968:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253301120:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270145.030022:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253301120:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 55us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.030029:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 185 00000100:00100000:1.0:1788270145.030059:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:1.0:1788270145.030066:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253301248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270145.030093:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253301248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.030099:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:1.0:1788270145.030112:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 187 00000100:00100000:1.0:1788270145.030118:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253301632:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270145.030140:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2402:x1875136253301632:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.030146:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 187 00000100:00080000:1.0:1788270145.030168:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270145.030173:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270145.030560:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270145.030734:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301760 00000100:00100000:1.0:1788270145.030739:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301760 00000100:00100000:1.0:1788270145.030772:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:1.0:1788270145.030779:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253301760:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270145.030830:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253301760:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.030837:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00080000:1.0:1788270145.030853:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270145.031089:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301376 00000100:00100000:3.0:1788270145.031093:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301376 00000100:00100000:3.0:1788270145.031134:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301504 00000100:00100000:3.0:1788270145.031137:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301504 00000100:00100000:3.0:1788270145.031163:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:3.0:1788270145.031170:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2402:x1875136253301376:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270145.031205:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2402:x1875136253301376:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.031212:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:3.0:1788270145.031226:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:3.0:1788270145.031232:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253301504:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270145.031256:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253301504:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.031262:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00080000:1.0:1788270145.031712:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270145.031716:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788270145.134611:0:51038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 09:42:24 (1788270144) 00000100:00100000:0.0:1788270145.220293:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270145.220447:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262683008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270145.220537:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270145.221218:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683008 00000100:00100000:3.0:1788270145.221230:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683008 00000100:00100000:3.0:1788270145.221354:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788270145.221366:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262683008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270145.221406:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 241823424 pending 0 free 3779825664 avail 3548303360 00000100:00100000:3.0:1788270145.221466:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262683008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.221473:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788270145.221511:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262683520:0@lo:400:kworker.0 00000100:00080000:0.0:1788270145.221700:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270145.221732:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262683136:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.221776:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270145.221931:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262683648:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.221959:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270145.221981:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262684160:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.222007:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270145.222031:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788270145.222036:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262683264:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.222086:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270145.222104:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262683776:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.222123:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270145.222124:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270145.222317:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683136 00000100:00100000:3.0:1788270145.222323:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683136 00000100:00100000:3.0:1788270145.222360:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788270145.222369:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262683136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.222952:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262684288:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.222988:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270145.223058:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683648 00000100:00100000:0.0:1788270145.223064:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683648 00000100:00100000:0.0:1788270145.223110:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683264 00000100:00100000:0.0:1788270145.223113:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683264 00000100:00100000:0.0:1788270145.223130:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683776 00000100:00100000:3.0:1788270145.223244:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262683136:12345-0@lo:400:kworker.0 Request processed in 876us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.223517:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788270145.223567:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788270145.223578:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262683648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.223622:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262683648:12345-0@lo:400:kworker.0 Request processed in 47us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.223629:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788270145.223644:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788270145.223650:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262683264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.223682:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3607:x1875136262683264:12345-0@lo:400:kworker.0 Request processed in 33us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.223688:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788270145.223872:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683776 00000100:00100000:0.0:1788270145.223976:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788270145.223985:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262683776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.224022:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262683776:12345-0@lo:400:kworker.0 Request processed in 39us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270145.224028:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788270145.224032:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262684032:0@lo:400:kworker.0 00000100:00080000:0.0:1788270145.224117:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270145.224122:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270145.224156:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270145.224268:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262684672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270145.224269:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262684544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270145.224296:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270145.224318:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262684160 00000100:00100000:2.0:1788270145.224324:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262684160 00000100:00100000:2.0:1788270145.224364:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262684288 00000100:00100000:2.0:1788270145.224368:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262684288 00000100:00100000:2.0:1788270145.224388:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262684032 00000100:00100000:2.0:1788270145.224391:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262684032 00000100:00100000:0.0:1788270145.224393:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788270145.224400:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262684160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270145.224404:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788270145.224410:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262684288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.224437:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262684160:12345-0@lo:400:kworker.0 Request processed in 38us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270145.224440:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262684288:12345-0@lo:400:kworker.0 Request processed in 31us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270145.224444:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788270145.224447:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788270145.224458:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788270145.224464:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262684032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270145.224505:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683520 00000100:00100000:1.0:1788270145.224509:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683520 00000100:00080000:0.0:1788270145.224541:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270145.224545:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270145.224557:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262683392:0@lo:400:kworker.0 00000100:00100000:1.0:1788270145.225001:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788270145.225014:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262683520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.225891:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262683264:0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.226239:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262683776:0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.226254:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262684288:0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.226267:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262683136:0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.226279:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262683648:0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.226291:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262684160:0@lo:400:kworker.0 00000100:00100000:3.0:1788270145.226424:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262684672 00000100:00100000:3.0:1788270145.226432:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262684672 00000100:00100000:3.0:1788270145.226479:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788270145.226487:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262684672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270145.226513:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3170304 granted 241823424 pending 0 free 3779825664 avail 3548303360 00000100:00100000:3.0:1788270145.226580:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262684672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.226587:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788270145.226650:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262684672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270145.226774:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262684032:12345-0@lo:400:kworker.0 Request processed in 2307us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270145.226783:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788270145.227595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270145.227607:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262683520:12345-0@lo:400:kworker.0 Request processed in 2597us (5481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.227618:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788270145.227683:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262683904:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.227713:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270145.227867:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262684416:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.227891:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270145.227996:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683392 00000100:00100000:2.0:1788270145.228003:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683392 00000100:00100000:2.0:1788270145.228054:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262683904 00000100:00100000:2.0:1788270145.228058:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262683904 00000100:00100000:2.0:1788270145.228079:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788270145.228087:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262683392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270145.228196:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262683392:12345-0@lo:400:kworker.0 Request processed in 48us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270145.228203:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788270145.228218:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788270145.228224:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262683904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270145.228255:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262683904:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270145.228262:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788270145.228849:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262684416 00000100:00100000:1.0:1788270145.228856:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262684416 00000100:00080000:3.0:1788270145.228948:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270145.229005:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262683008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270145.229055:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262683392:0@lo:400:kworker.0 00000100:00100000:0.0:1788270145.229073:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262683904:0@lo:400:kworker.0 00000100:00100000:2.0:1788270145.229258:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788270145.229268:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262684416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270145.229372:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270145.229422:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262684416:12345-0@lo:400:kworker.0 Request processed in 156us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.229424:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262683520:0@lo:400:kworker.0 00000100:00100000:2.0:1788270145.229429:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788270145.229438:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262684032:0@lo:400:kworker.0 00000100:00100000:2.0:1788270145.229457:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262684416:0@lo:400:kworker.0 00000100:00100000:1.0:1788270145.229462:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262684544 00000100:00100000:1.0:1788270145.229464:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262684544 00000100:00100000:1.0:1788270145.229498:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788270145.229506:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262684544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270145.229650:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2121728 granted 168083136 pending 7413760 free 3841708032 avail 3610185728 00000100:00100000:1.0:1788270145.229815:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262684544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 309us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.229823:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788270145.229883:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262684544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270145.539689:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270145.541831:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253301888 00000100:00100000:0.0:1788270145.541854:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253301888 00002000:00100000:0.0:1788270145.543121:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc8:0x0] (29360128->31457279) req@ffff98c14262c380 x1875136253301888/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:561/0 lens 488/0 e 0 to 0 dl 1788270156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788270145.543139:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262c380 with x1875136253301888 ext(29360128->31457279) 00002000:00010000:0.0:1788270145.543149:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262c380 00000100:00100000:0.0:1788270145.543292:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:3.0:1788270145.543293:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270145.543328:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253301888:12345-192.168.201.42@tcp:4:dd.500 00000100:00100000:1.0:1788270145.550274:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253302016 00000100:00100000:1.0:1788270145.550297:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253302016 00002000:00100000:1.0:1788270145.550363:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc7:0x0] (12582912->15728639) req@ffff98c276264380 x1875136253302016/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:561/0 lens 488/0 e 0 to 0 dl 1788270156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270145.550376:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276264380 with x1875136253302016 ext(12582912->15728639) 00002000:00010000:1.0:1788270145.550382:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c276264380 00000100:00100000:1.0:1788270145.550414:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:1.0:1788270145.550425:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253302016:12345-192.168.201.42@tcp:4:dd.0 00000100:00100000:1.0:1788270145.589484:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253301888:12345-192.168.201.42@tcp:4:dd.500 Request processed in 46158us (49805us total) trans 30064771141 rc 0/0 00000100:00100000:1.0:1788270145.589507:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00002000:00100000:1.0:1788270145.589526:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xc8:0x0] (29360128->31457279) req@ffff98c14262c380 x1875136253301888/t30064771141(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:561/0 lens 488/448 e 0 to 0 dl 1788270156 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788270145.589540:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14262c380 with x1875136253301888 ext(29360128->31457279) 00002000:00010000:1.0:1788270145.589550:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c14262c380 00000100:00100000:1.0:1788270145.590191:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253302016:12345-192.168.201.42@tcp:4:dd.0 Request processed in 39764us (46911us total) trans 30064771165 rc 0/0 00000100:00100000:1.0:1788270145.590200:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00002000:00100000:1.0:1788270145.590207:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xc7:0x0] (12582912->15728639) req@ffff98c276264380 x1875136253302016/t30064771165(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:561/0 lens 488/448 e 0 to 0 dl 1788270156 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270145.590215:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c276264380 with x1875136253302016 ext(12582912->15728639) 00002000:00010000:1.0:1788270145.590220:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c276264380 00000001:00080000:1.0:1788270145.591207:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771141 is committed 00000001:00080000:1.0:1788270145.591231:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771137 is committed 00000100:00100000:2.0:1788270145.936386:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270145.936708:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253302272 00000100:00100000:0.0:1788270145.936723:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253302272 00000100:00100000:0.0:1788270145.936823:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 508 00000100:00100000:0.0:1788270145.936835:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42747:x1875136253302272:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270145.936860:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270145.936888:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a9cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610213b expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.936983:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937001:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937017:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937034:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937081:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937088:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937208:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a9e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937217:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937224:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270145.937235:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788270145.937431:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937439:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937446:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937451:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500baa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270145.937456:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937463:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937481:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:0.0:1788270145.937483:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270145.937489:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937495:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0a9d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937511:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937518:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937523:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937528:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270145.937531:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937536:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937544:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429f2300) 00010000:00010000:0.0:1788270145.937546:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270145.937548:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937554:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0a9db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937857:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0a9cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610213b expref: 51 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937874:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610213b expref: 50 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270145.937882:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:0.0:1788270145.937884:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270145.937887:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb600, rc 0) 00000100:00100000:0.0:1788270145.937980:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:42747:x1875136253302272:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1607us total) trans 30064771417 rc 0/0 00000100:00100000:0.0:1788270145.937988:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 508 00000100:00100000:3.0:1788270145.942692:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.942744:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270145.942878:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253302528 00000100:00100000:2.0:1788270145.942893:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253302528 00000100:00100000:2.0:1788270145.942973:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788270145.942985:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2402:x1875136253302528:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270145.943006:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270145.943084:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0a9e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610213b expref: 50 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270145.943109:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270145.943115:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270145.943184:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:2402:x1875136253302528:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 201us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270145.943192:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788270145.943424:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253302400 00000100:00100000:1.0:1788270145.943430:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253302400 00000100:00100000:1.0:1788270145.943471:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 509 00000100:00100000:1.0:1788270145.943479:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:42747:x1875136253302400:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270145.943559:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:42747:x1875136253302400:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 81us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270145.943566:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 509 00000001:00080000:2.0:1788270145.947645:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771417 is committed 00000100:00100000:1.0:1788270145.950210:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270145.950916:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253302656 00000100:00100000:3.0:1788270145.950931:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253302656 00000100:00100000:3.0:1788270145.951307:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 510 00000100:00100000:3.0:1788270145.951321:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:42747:x1875136253302656:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270145.951489:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:42747:x1875136253302656:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 171us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270145.951498:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 510 00010000:00010000:3.0:1788270145.993473:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270146.022560:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.022730:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253302912 00000100:00100000:3.0:1788270146.022743:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253302912 00000100:00100000:3.0:1788270146.022844:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 511 00000100:00100000:3.0:1788270146.022857:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:42761:x1875136253302912:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270146.022887:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.022892:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270146.022929:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0a8e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102103 expref: 42 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.022953:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.022958:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270146.022991:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0a9f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102142 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.023186:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.023203:0:46770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.023212:0:46770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.023254:0:46770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 5 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.023269:0:46770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 5 pid: 48110 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.023287:0:46770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262684800:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270146.023403:0:46770:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788270146.025308:0:46770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:46770:1875136262684800:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270146.025345:0:46770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270146.025947:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.026151:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253303040 00000100:00100000:1.0:1788270146.026161:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253303040 00010000:00010000:1.0:1788270146.026210:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 6 pid: 48110 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270146.026248:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:1.0:1788270146.026259:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2400:x1875136253303040:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270146.026276:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270146.026284:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 6 pid: 48110 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.026299:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 6 pid: 48110 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.026327:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0a9c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102134 expref: 6 pid: 48110 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.026346:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270146.026352:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.026361:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.026369:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.026404:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270146.026474:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253303040:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 216us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.026483:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00010000:00010000:3.0:1788270146.026546:0:46770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.026554:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.026583:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.026595:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.026604:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270146.027285:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xca:0x0], index 1: 0 00010000:00010000:3.0:1788270146.027489:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027500:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027508:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027547:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027554:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027560:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027568:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027575:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.027579:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027587:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027601:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.027604:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.027608:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027615:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0a9f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270146.027630:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016ec9bdd reply state 0000000022e35df7 transno 30064771418 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027749:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027758:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:3.0:1788270146.027760:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270146.027763:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788270146.027872:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0a9f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027890:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 43 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.027898:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:3.0:1788270146.027901:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270146.027903:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543e00, rc 0) 00000100:00100000:3.0:1788270146.027969:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42761:x1875136253302912:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5114us (5426us total) trans 30064771418 rc 0/0 00000100:00100000:3.0:1788270146.027977:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 511 00000100:00100000:0.0:1788270146.032170:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.032363:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253303168 00000100:00100000:2.0:1788270146.032376:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253303168 00000100:00100000:2.0:1788270146.032463:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:2.0:1788270146.032476:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2402:x1875136253303168:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270146.032501:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.032528:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102149 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270146.032561:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270146.032588:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=937s v=(0 0) 00010000:00010000:2.0:1788270146.032593:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.032605:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 16 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.032638:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 16 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.032655:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f800, rc 0) 00000100:00100000:2.0:1788270146.032735:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2402:x1875136253303168:12345-192.168.201.42@tcp:101:bash.0 Request processed in 261us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.032743:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:1.0:1788270146.036347:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.036704:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253303296 00000100:00100000:3.0:1788270146.036718:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253303296 00000100:00100000:3.0:1788270146.036827:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:3.0:1788270146.036840:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:42761:x1875136253303296:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270146.036922:0:47283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.036949:0:47283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102150 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.036995:0:47283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 17 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.037007:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270146.037012:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270146.037018:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 17 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.037100:0:47283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 17 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.037115:0:47283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 17 pid: 47281 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.037134:0:47283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:47283:1875136262684928:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270146.037236:0:47283:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270146.040795:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.040912:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253303424 00000100:00100000:3.0:1788270146.040922:0:47283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:47283:1875136262684928:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270146.040927:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253303424 00010000:00010000:3.0:1788270146.040974:0:47283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 18 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.040984:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 18 pid: 47281 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.041002:0:47283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543a00, rc 0) 00000100:00100000:2.0:1788270146.041099:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:2.0:1788270146.041116:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253303424:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270146.041134:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270146.041161:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 18 pid: 47281 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.041178:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 18 pid: 47281 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.041222:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0aa13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102149 expref: 18 pid: 47281 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.041240:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.041245:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.041254:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 17 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.041265:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 17 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.041300:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:42761:x1875136253303296:12345-192.168.201.42@tcp:101:bash.0 Request processed in 4274us (4781us total) trans 0 rc 0/0 00010000:00010000:2.0:1788270146.041310:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 17 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.041315:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:2.0:1788270146.041342:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262685056:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270146.041426:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216840 going to sleep for 11 seconds 00000100:00100000:2.0:1788270146.044636:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.044704:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253303680 00000100:00100000:1.0:1788270146.044713:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253303680 00000100:00100000:1.0:1788270146.044766:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:1.0:1788270146.044788:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:42761:x1875136253303680:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:1.0:1788270146.045078:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:42761:x1875136253303680:12345-192.168.201.42@tcp:35:bash.0 Request processed in 302us (449us total) trans 30064771419 rc 0/0 00000100:00100000:1.0:1788270146.045085:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:3.0:1788270146.046664:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262685056:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270146.046689:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270146.046742:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253303424:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 5631us (5970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270146.046752:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:2.0:1788270146.064609:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270146.064709:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253303808 00000100:00100000:0.0:1788270146.064728:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253303808 00000100:00100000:0.0:1788270146.064823:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 512 00000100:00100000:0.0:1788270146.064837:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:42764:x1875136253303808:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270146.064871:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270146.064903:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0aa21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102157 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.065002:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0aa28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.065019:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0aa28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.065035:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0aa28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270146.065146:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270146.065151:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270146.065226:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0aa28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.065261:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0aa21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102157 expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.065283:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0aa28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102157 expref: 46 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.065293:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270146.065297:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270146.065301:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500baa00, rc 0) 00000100:00100000:1.0:1788270146.065671:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:42764:x1875136253303808:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 578us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.065684:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 512 00000100:00100000:1.0:1788270146.201662:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.201854:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253304064 00000100:00100000:3.0:1788270146.201871:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253304064 00000100:00100000:3.0:1788270146.201957:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 513 00000100:00100000:3.0:1788270146.201967:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:42787:x1875136253304064:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270146.201991:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.202011:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610215e expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.202132:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa36 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.202143:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.202152:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270146.202163:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 5 00010000:00010000:3.0:1788270146.202249:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610215e expref: 49 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.202262:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa36 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610215e expref: 48 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.202268:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:3.0:1788270146.202270:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270146.202273:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543800, rc 0) 00000100:00100000:3.0:1788270146.202321:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42787:x1875136253304064:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 357us (668us total) trans 30064771420 rc 0/0 00000100:00100000:3.0:1788270146.202332:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 513 00000100:00100000:2.0:1788270146.204450:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.204542:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253304320 00000100:00100000:3.0:1788270146.204551:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253304320 00000100:00100000:3.0:1788270146.204945:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 514 00000100:00100000:3.0:1788270146.204955:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:42787:x1875136253304320:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270146.204979:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.204999:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa44 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102165 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.205113:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aa4b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.205126:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aa4b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.205142:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aa4b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270146.205153:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 5 00010000:00010000:3.0:1788270146.205244:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa44 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102165 expref: 51 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.205263:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aa4b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102165 expref: 50 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.205272:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:3.0:1788270146.205275:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788270146.205278:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543c00, rc 0) 00000100:00100000:3.0:1788270146.205521:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:42787:x1875136253304320:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 565us (1078us total) trans 30064771421 rc 0/0 00000100:00100000:3.0:1788270146.205529:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 514 00000100:00100000:1.0:1788270146.205669:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.205934:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253304448 00000100:00100000:3.0:1788270146.205939:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253304448 00000100:00100000:3.0:1788270146.205983:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788270146.205992:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2400:x1875136253304448:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270146.206004:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270146.206019:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa36 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610215e expref: 50 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.206031:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:3.0:1788270146.206034:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270146.206097:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:2400:x1875136253304448:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 106us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270146.206104:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788270146.210437:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.210517:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253304576 00000100:00100000:3.0:1788270146.210528:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253304576 00000100:00100000:3.0:1788270146.210582:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 150 00000100:00100000:3.0:1788270146.210593:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2403:x1875136253304576:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:3.0:1788270146.210638:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.210660:0:47284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 16 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.210669:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270146.210674:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270146.210678:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.210715:0:47284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 16 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.210730:0:47284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 16 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.210747:0:47284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262685184:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270146.210848:0:47284:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270146.213941:0:47284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:47284:1875136262685184:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270146.213974:0:47284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270146.215562:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270146.215650:0:47289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253304704 00000100:00100000:0.0:1788270146.215658:0:47289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253304704 00002000:00100000:0.0:1788270146.215705:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xca:0x0] (0->4) req@ffff98c27d7f0700 x1875136253304704/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:562/0 lens 496/0 e 0 to 0 dl 1788270157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270146.215715:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f0700 with x1875136253304704 ext(0->4) 00010000:00010000:0.0:1788270146.215725:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 17 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.215738:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 17 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270146.215750:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c27d7f0700 00000100:00100000:0.0:1788270146.215972:0:47289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788270146.215983:0:47289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2401:x1875136253304704:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:0.0:1788270146.217516:0:47289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253304704:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 1528us (1953us total) trans 30064771166 rc 0/0 00000100:00100000:0.0:1788270146.217529:0:47289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00002000:00100000:0.0:1788270146.217539:0:47289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xca:0x0] (0->4) req@ffff98c27d7f0700 x1875136253304704/t30064771166(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:562/0 lens 496/448 e 0 to 0 dl 1788270157 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270146.217549:0:47289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27d7f0700 with x1875136253304704 ext(0->4) 00010000:00010000:0.0:1788270146.217558:0:47289:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 19 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.217575:0:47289:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 19 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270146.217582:0:47289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98c27d7f0700 00000100:00100000:0.0:1788270146.221650:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.221926:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253304832 00000100:00100000:1.0:1788270146.221937:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253304832 00010000:00010000:1.0:1788270146.221977:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 19 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270146.222241:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:1.0:1788270146.222252:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2400:x1875136253304832:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270146.222269:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788270146.222287:0:48804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1788270146.222291:0:48804:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb mtime from disk: 0 -> 1788270146 00002000:00010000:1.0:1788270146.222293:0:48804:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb atime from disk: 0 -> 1788270146 00002000:00010000:1.0:1788270146.222294:0:48804:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb ctime from disk: 0 -> 1788270146 00002000:00010000:1.0:1788270146.222296:0:48804:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788270146.222303:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 19 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.222316:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 19 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.222337:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e7fe314/0xc5f5d7a016e0aa1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102150 expref: 19 pid: 47283 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.222353:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270146.222357:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270146.222364:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.222374:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.222409:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270146.222476:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2400:x1875136253304832:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 225us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.222484:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00010000:00010000:3.0:1788270146.222733:0:47284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222744:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222783:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222792:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222800:0:47284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222809:0:47284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270146.222814:0:47284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222823:0:47284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222843:0:47284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.222850:0:47284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c4e8781/0xc5f5d7a016e0aa59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.222925:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2403:x1875136253304576:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 12333us (12497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270146.222934:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 150 00000100:00100000:0.0:1788270146.225982:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.226159:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253305088 00000100:00100000:3.0:1788270146.226169:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253305088 00000100:00100000:3.0:1788270146.226216:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:3.0:1788270146.226226:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:42787:x1875136253305088:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788270146.226289:0:45779:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x26:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aa4b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102165 expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270146.226605:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771422 00000001:00080000:3.0:1788270146.226640:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771423 00000001:00080000:3.0:1788270146.230993:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771424 00010000:00010000:3.0:1788270146.231080:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.231101:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 53 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.231109:0:45779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.231151:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 53 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.231166:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 53 pid: 46770 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.231181:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262685312:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270146.231276:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270146.233270:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262685312:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270146.233296:0:45779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270146.234175:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.234266:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253305216 00000100:00100000:3.0:1788270146.234274:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253305216 00010000:00010000:3.0:1788270146.234310:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 54 pid: 46770 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.234346:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:3.0:1788270146.234357:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:2401:x1875136253305216:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270146.234371:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270146.234378:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 54 pid: 46770 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.234390:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 54 pid: 46770 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.234416:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa05 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102142 expref: 54 pid: 46770 timeout: 1037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.234443:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:3.0:1788270146.234448:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.234458:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.234465:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.234497:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270146.234533:0:45779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.234545:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:2401:x1875136253305216:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 189us (427us total) trans 0 rc 0/0 00010000:00010000:2.0:1788270146.234545:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.234563:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000001:00080000:2.0:1788270146.234665:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771425 00000001:00080000:2.0:1788270146.234790:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771426 00000100:00100000:2.0:1788270146.234878:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262685440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788270146.234915:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270146.234940:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216540 going to sleep for 11 seconds 00000100:00100000:1.0:1788270146.235094:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262685440 00000100:00100000:1.0:1788270146.235106:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262685440 00000100:00100000:0.0:1788270146.235252:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788270146.235261:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262685440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788270146.235323:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262685440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270146.235331:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788270146.236616:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262685440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788270146.236718:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771427 00000100:00100000:2.0:1788270146.236763:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262685568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788270146.236855:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270146.236878:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14343b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788270146.236947:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262685568 00000100:00100000:3.0:1788270146.236955:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262685568 00000100:00100000:3.0:1788270146.236997:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788270146.237006:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262685568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270146.237149:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262685568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (291us total) trans 30064771167 rc 0/0 00000100:00100000:3.0:1788270146.237156:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788270146.237193:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262685568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788270146.237226:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771428 00010000:00010000:2.0:1788270146.237254:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.237264:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.237271:0:45779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.237279:0:45779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270146.237282:0:45779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.237287:0:45779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.237298:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:2.0:1788270146.237300:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788270146.237303:0:45779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.237307:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aa60 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270146.237431:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x27:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788270146.237477:0:45779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].13, 64 off9240 00000004:00080000:2.0:1788270146.237484:0:45779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 937944444657ns, next at 938944443284ns, rc = 0 00000001:00080000:2.0:1788270146.237488:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771429 00010000:00010000:2.0:1788270146.237503:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7400) 00010000:00010000:2.0:1788270146.237505:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270146.237509:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aa4b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102165 expref: 57 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270146.237582:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:42787:x1875136253305088:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 11358us (11611us total) trans 30064771430 rc 0/0 00000100:00100000:2.0:1788270146.237591:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000020:00080000:2.0:1788270146.237594:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788270146.239354:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.239472:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253305344 00000100:00100000:1.0:1788270146.239480:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253305344 00000100:00100000:1.0:1788270146.239532:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 515 00000100:00100000:1.0:1788270146.239543:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:42787:x1875136253305344:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270146.239563:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270146.239585:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169600/0xc5f5d7a016e0aa67 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610216c expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.239636:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169600/0xc5f5d7a016e0aa67 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610216c expref: 57 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.239648:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169600/0xc5f5d7a016e0aa67 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610216c expref: 57 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.239663:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:1.0:1788270146.239665:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270146.239667:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169600, rc 0) 00000100:00100000:1.0:1788270146.239754:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:42787:x1875136253305344:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 213us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.239762:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 515 00000100:00100000:0.0:1788270146.241991:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.242069:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253305600 00000100:00100000:2.0:1788270146.242078:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253305600 00000100:00100000:3.0:1788270146.242229:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:3.0:1788270146.242241:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:42787:x1875136253305600:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270146.242458:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:42787:x1875136253305600:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 220us (474us total) trans 30064771431 rc 0/0 00000100:00100000:3.0:1788270146.242466:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00000040:00080000:1.0:1788270146.244217:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270146.244223:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270146.244239:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:1.0:1788270146.244244:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788270146.300331:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.300435:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253305728 00000100:00100000:3.0:1788270146.300445:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253305728 00000100:00100000:3.0:1788270146.300532:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 516 00000100:00100000:3.0:1788270146.300543:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:42797:x1875136253305728:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788270146.300614:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300632:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300645:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300656:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300663:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300670:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300740:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300749:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.300761:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270146.301239:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301255:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301262:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301269:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301277:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301283:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.301288:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301296:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301310:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.301313:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.301318:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301325:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301343:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301350:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301356:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301362:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.301365:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301372:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301380:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:3.0:1788270146.301382:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.301385:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301392:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301402:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301408:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301414:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301420:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.301423:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301430:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301438:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:3.0:1788270146.301440:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.301443:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.301449:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa7c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.301585:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:42797:x1875136253305728:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 1042us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270146.301595:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 516 00000100:00100000:2.0:1788270146.364656:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.364727:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253305984 00000100:00100000:3.0:1788270146.364736:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253305984 00000100:00100000:3.0:1788270146.364824:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 517 00000100:00100000:3.0:1788270146.364834:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:42804:x1875136253305984:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:3.0:1788270146.364853:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.364871:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102173 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.364943:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.364961:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.364974:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.364982:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.364987:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.364991:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365123:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365131:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365139:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270146.365150:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 5 00010000:00010000:3.0:1788270146.365222:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365228:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365232:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365236:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365240:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.365242:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365247:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365255:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.365258:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.365262:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365267:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aa8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365281:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365286:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365291:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365296:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.365300:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365310:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365315:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:3.0:1788270146.365317:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.365400:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365405:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aa91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365517:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aa83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 61 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365530:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 60 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.365536:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:3.0:1788270146.365537:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270146.365539:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241542600, rc 0) 00000100:00100000:3.0:1788270146.365589:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:42804:x1875136253305984:12345-192.168.201.42@tcp:101:cat.0 Request processed in 757us (943us total) trans 30064771432 rc 0/0 00000100:00100000:3.0:1788270146.365594:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 517 00000100:00100000:0.0:1788270146.367615:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.367727:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253306240 00000100:00100000:2.0:1788270146.367744:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253306240 00000100:00100000:2.0:1788270146.367840:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788270146.367850:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:42804:x1875136253306240:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:2.0:1788270146.368082:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:42804:x1875136253306240:12345-192.168.201.42@tcp:35:cat.0 Request processed in 233us (473us total) trans 30064771433 rc 0/0 00000100:00100000:2.0:1788270146.368091:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:0.0:1788270146.409178:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.409329:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253306496 00000100:00100000:1.0:1788270146.409342:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253306496 00000100:00100000:1.0:1788270146.409412:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 518 00000100:00100000:1.0:1788270146.409424:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:42810:x1875136253306496:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270146.409450:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270146.409470:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aaa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610217a expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.409584:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.409599:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 62 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.409609:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.409645:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 62 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.409658:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 62 pid: 46770 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270146.409671:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262685696:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270146.409746:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244840 going to sleep for 11 seconds 00000100:00100000:0.0:1788270146.415319:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.415665:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253306624 00000100:00100000:3.0:1788270146.415675:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253306624 00010000:00010000:3.0:1788270146.415715:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 63 pid: 46770 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.415763:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:3.0:1788270146.415786:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:2400:x1875136253306624:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270146.415808:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270146.415817:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 63 pid: 46770 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.415831:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 63 pid: 46770 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.415855:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:3.0:1788270146.415860:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.415871:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.415878:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.415897:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270146.415953:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:2400:x1875136253306624:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 170us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270146.415961:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00010000:00010000:1.0:1788270146.416700:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aa98 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102173 expref: 62 pid: 46770 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270146.416720:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262685696:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270146.416739:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.416748:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.416757:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270146.416988:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 5 00010000:00010000:1.0:1788270146.417215:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aaa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 63 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.417233:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 62 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.417242:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:1.0:1788270146.417245:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788270146.417248:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168800, rc 0) 00000100:00100000:1.0:1788270146.417451:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:42810:x1875136253306496:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 8028us (8282us total) trans 30064771434 rc 0/0 00000100:00100000:1.0:1788270146.417459:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 518 00000100:00100000:0.0:1788270146.435473:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.435565:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253306752 00000100:00100000:3.0:1788270146.435577:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253306752 00000100:00100000:3.0:1788270146.435685:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 519 00000100:00100000:3.0:1788270146.435697:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:42811:x1875136253306752:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:3.0:1788270146.435721:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.435741:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0aabb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102181 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435833:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435848:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435859:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435872:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435879:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435886:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435955:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435965:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 63 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.435974:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.436007:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 63 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.436021:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 63 pid: 45777 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.436035:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262685824:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270146.436159:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c1436fc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270146.439677:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262685824:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270146.439711:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270146.440388:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.444268:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253307008 00000100:00100000:3.0:1788270146.444284:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253307008 00000100:00100000:3.0:1788270146.444913:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:3.0:1788270146.444925:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:33917:x1875136253307008:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788270146.447060:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:33917:x1875136253307008:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 2117us (6653us total) trans 30064771435 rc 0/0 00000100:00100000:3.0:1788270146.447075:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:3.0:1788270146.452375:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.452538:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253307136 00000100:00100000:1.0:1788270146.452549:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253307136 00010000:00010000:1.0:1788270146.452587:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 65 pid: 45777 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270146.452631:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:1.0:1788270146.452647:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:2400:x1875136253307136:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270146.452661:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270146.452667:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 65 pid: 45777 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.452686:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 65 pid: 45777 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.452707:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaad lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610217a expref: 65 pid: 45777 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.452724:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:1.0:1788270146.452729:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.452738:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.452744:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.452786:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270146.452855:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:2400:x1875136253307136:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 216us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.452863:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00010000:00010000:3.0:1788270146.453105:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453114:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270146.453176:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 5 00000004:00200000:3.0:1788270146.453183:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270146.453208:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453228:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453246:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453256:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453262:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453269:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453275:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.453283:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453290:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453299:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.453301:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.453305:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453312:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0aac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453335:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453342:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453349:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453354:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.453365:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453374:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453382:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:3.0:1788270146.453384:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.453391:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453397:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0aac9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453428:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0aabb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102181 expref: 64 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453443:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102181 expref: 63 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.453450:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:3.0:1788270146.453452:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270146.453454:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543200, rc 0) 00000100:00100000:3.0:1788270146.453487:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:42811:x1875136253306752:12345-192.168.201.42@tcp:101:rm.0 Request processed in 17793us (18024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270146.453498:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 519 00000100:00100000:0.0:1788270146.456411:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.456536:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253307392 00000100:00100000:3.0:1788270146.456546:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253307392 00000100:00100000:3.0:1788270146.456608:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 520 00000100:00100000:3.0:1788270146.456619:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:42811:x1875136253307392:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:3.0:1788270146.456673:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788270146.456701:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0aad0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102181 expref: 63 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.456724:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169600/0xc5f5d7a016e0aa67 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610216c expref: 62 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.456735:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1434d7f00) 00010000:00010000:3.0:1788270146.456751:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0aa28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102157 expref: 61 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457207:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.457211:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270146.457232:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457246:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457264:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457383:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457393:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457400:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457479:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457489:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457496:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457662:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457670:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457678:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457685:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457691:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457697:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457728:0:46770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788270146.457745:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457752:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457758:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.457856:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270146.457862:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.457887:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270146.457944:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543800 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270146.457950:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.457958:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.457968:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7500) 00010000:00010000:1.0:1788270146.457970:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270146.457974:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.457980:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0aaec lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.457992:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270146.457994:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270146.457996:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270146.458028:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458036:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458246:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff98c1429f7500) 00010000:00010000:3.0:1788270146.458248:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788270146.458252:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458258:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aae5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458278:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458285:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458291:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458297:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458302:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270146.458304:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458310:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458327:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270146.458330:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270146.458333:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458339:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0aad7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788270146.458349:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecf8d115 reply state 0000000035f52edf transno 30064771436 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458360:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.458366:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:3.0:1788270146.458369:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270146.458371:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270146.458567:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:42811:x1875136253307392:12345-192.168.201.42@tcp:36:rm.0 Request processed in 1947us (2160us total) trans 30064771436 rc 0/0 00000100:00100000:2.0:1788270146.458575:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 520 00000100:00100000:0.0:1788270146.498628:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.498721:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253307520 00000100:00100000:1.0:1788270146.498732:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253307520 00000100:00100000:1.0:1788270146.498804:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 521 00000100:00100000:1.0:1788270146.498815:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:42817:x1875136253307520:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788270146.498839:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270146.498859:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102188 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.498919:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aafa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.498943:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aafa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.498957:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aafa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270146.498999:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270146.499004:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270146.499024:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aafa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.499089:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168800/0xc5f5d7a016e0aaf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102188 expref: 64 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.499108:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aafa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102188 expref: 63 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.499117:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270146.499121:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270146.499124:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169400, rc 0) 00000100:00100000:1.0:1788270146.499175:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:42817:x1875136253307520:12345-192.168.201.42@tcp:101:bash.0 Request processed in 361us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.499182:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 521 00000100:00100000:3.0:1788270146.502483:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.502673:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253307776 00000100:00100000:2.0:1788270146.502681:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253307776 00000100:00100000:2.0:1788270146.502735:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 522 00000100:00100000:2.0:1788270146.502744:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:42817:x1875136253307776:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270146.502762:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.502776:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270146.502799:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0aafa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102188 expref: 63 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502816:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270146.502821:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270146.502832:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610218f expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502919:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502931:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502940:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502952:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502959:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.502965:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270146.503305:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcb:0x0], index 0: 0 00010000:00010000:2.0:1788270146.503597:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e0ab16 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503606:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e0ab16 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503613:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e0ab16 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503646:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503653:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503660:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503666:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503671:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270146.503676:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503682:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503692:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270146.503694:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270146.503698:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503705:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270146.503717:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071edb64f reply state 000000001fcef3fe transno 30064771437 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503727:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.503734:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270146.503737:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270146.503740:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788270146.504017:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610218f expref: 65 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.504111:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e0ab16 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610218f expref: 64 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.504121:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270146.504124:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270146.504128:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9ea00, rc 0) 00000100:00100000:2.0:1788270146.504236:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:42817:x1875136253307776:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1491us (1760us total) trans 30064771437 rc 0/0 00000100:00100000:2.0:1788270146.504245:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 522 00000100:00100000:1.0:1788270146.506738:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.506837:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253307904 00000100:00100000:2.0:1788270146.506847:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253307904 00000100:00100000:2.0:1788270146.506954:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 151 00000100:00100000:2.0:1788270146.506964:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253307904:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270146.506981:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.507000:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102196 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270146.507023:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788270146.507059:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=938s v=(0 0) 00010000:00010000:2.0:1788270146.507064:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.507073:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 11 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.507095:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 11 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.507119:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f800, rc 0) 00000100:00100000:2.0:1788270146.507180:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253307904:12345-192.168.201.42@tcp:101:bash.0 Request processed in 217us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.507187:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 151 00000100:00100000:0.0:1788270146.519160:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.519248:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253308032 00000100:00100000:3.0:1788270146.519259:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253308032 00000100:00100000:3.0:1788270146.519322:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:3.0:1788270146.519332:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:42817:x1875136253308032:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788270146.519349:0:48230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270146.519367:0:48230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610219d expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.519397:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 12 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.519406:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270146.519410:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270146.519415:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 12 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.519456:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 12 pid: 48231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.519470:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 12 pid: 48231 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.519485:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:48230:1875136262685952:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270146.519570:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b4f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788270146.521729:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.521754:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:48230:1875136262685952:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270146.521806:0:48230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 12 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270146.521835:0:48230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543000, rc 0) 00000100:00100000:2.0:1788270146.521861:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253308160 00000100:00100000:2.0:1788270146.521869:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253308160 00000100:00100000:3.0:1788270146.521895:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:42817:x1875136253308032:12345-192.168.201.42@tcp:101:bash.0 Request processed in 2562us (2743us total) trans 0 rc 0/0 00010000:00010000:2.0:1788270146.521903:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 13 pid: 48231 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270146.521907:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:2.0:1788270146.522150:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:2.0:1788270146.522161:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253308160:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270146.522173:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270146.522195:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 12 pid: 48231 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.522208:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 12 pid: 48231 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.522230:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6ec4f7/0xc5f5d7a016e0ab24 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102196 expref: 12 pid: 48231 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.522249:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.522253:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.522261:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 11 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.522271:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 11 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.522303:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 11 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270146.522317:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:45762:1875136262686080:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270146.522365:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:2.0:1788270146.524203:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:45762:1875136262686080:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270146.524225:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270146.524266:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253308160:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 2107us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.524275:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:3.0:1788270146.524564:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270146.524643:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253308416 00000100:00100000:0.0:1788270146.524651:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253308416 00000100:00100000:0.0:1788270146.524696:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:0.0:1788270146.524706:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:42817:x1875136253308416:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788270146.524980:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:42817:x1875136253308416:12345-192.168.201.42@tcp:35:bash.0 Request processed in 275us (417us total) trans 30064771438 rc 0/0 00000100:00100000:0.0:1788270146.524987:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:0.0:1788270146.545319:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.545438:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253308544 00000100:00100000:2.0:1788270146.545448:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253308544 00000100:00100000:2.0:1788270146.545547:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 523 00000100:00100000:2.0:1788270146.545559:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:42820:x1875136253308544:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270146.545585:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.545607:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0ab32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021a4 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.545677:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.545692:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.545704:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270146.545746:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270146.545751:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270146.545783:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.545808:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0ab32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021a4 expref: 68 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.545827:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021a4 expref: 67 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.545837:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270146.545840:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270146.545844:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f200, rc 0) 00000100:00100000:2.0:1788270146.545903:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:42820:x1875136253308544:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 346us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.545911:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 523 00000040:00080000:3.0:1788270146.695076:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270146.695086:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270146.695109:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 9 count 5 00000040:00080000:3.0:1788270146.695117:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270146.745268:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.745431:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253308800 00000100:00100000:2.0:1788270146.745442:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253308800 00000100:00100000:2.0:1788270146.745500:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 524 00000100:00100000:2.0:1788270146.745511:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:42850:x1875136253308800:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270146.745532:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.745552:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0ab40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021ab expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.745655:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab47 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.745669:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.745679:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270146.745690:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 13 00010000:00010000:2.0:1788270146.745805:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f800/0xc5f5d7a016e0ab40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ab expref: 70 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.745825:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab47 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ab expref: 69 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.745833:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270146.745836:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270146.745840:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9f600, rc 0) 00000100:00100000:2.0:1788270146.746019:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:42850:x1875136253308800:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 509us (759us total) trans 30064771439 rc 0/0 00000100:00100000:2.0:1788270146.746027:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 524 00000100:00100000:3.0:1788270146.747967:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270146.748372:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.748479:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253309056 00000100:00100000:2.0:1788270146.748488:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253309056 00000100:00100000:2.0:1788270146.748543:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 525 00000100:00100000:2.0:1788270146.748553:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:42850:x1875136253309056:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270146.748573:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.748592:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab55 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021b2 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.748678:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab5c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.748692:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.748702:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270146.748713:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 13 00010000:00010000:2.0:1788270146.748810:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab55 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021b2 expref: 72 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.748829:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021b2 expref: 71 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.748838:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270146.748841:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270146.748844:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:1.0:1788270146.748962:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253309184 00000100:00100000:1.0:1788270146.748967:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253309184 00000100:00100000:1.0:1788270146.749006:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:1.0:1788270146.749013:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:2401:x1875136253309184:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270146.749022:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270146.749068:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f600/0xc5f5d7a016e0ab47 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ab expref: 72 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.749081:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:1.0:1788270146.749084:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270146.749128:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:2401:x1875136253309184:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 115us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.749137:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788270146.749476:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:42850:x1875136253309056:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 923us (1515us total) trans 30064771440 rc 0/0 00000100:00100000:2.0:1788270146.749484:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 525 00000100:00100000:3.0:1788270146.751452:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.752002:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253309312 00000100:00100000:2.0:1788270146.752011:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253309312 00000100:00100000:2.0:1788270146.752093:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788270146.752103:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:42850:x1875136253309312:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:2.0:1788270146.752117:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270146.752138:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab5c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021b2 expref: 70 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.752155:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270146.752160:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270146.752206:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:42850:x1875136253309312:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 104us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.752213:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788270146.753791:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270146.753919:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253309568 00000100:00100000:0.0:1788270146.753927:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253309568 00000100:00100000:0.0:1788270146.753974:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788270146.753984:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:42850:x1875136253309568:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270146.754332:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:42850:x1875136253309568:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 349us (545us total) trans 30064771441 rc 0/0 00000100:00100000:0.0:1788270146.754340:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788270146.759856:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.759930:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253309824 00000100:00100000:1.0:1788270146.759939:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253309824 00000100:00100000:1.0:1788270146.759988:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788270146.759998:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:42850:x1875136253309824:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788270146.760226:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:42850:x1875136253309824:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 229us (379us total) trans 30064771442 rc 0/0 00000100:00100000:1.0:1788270146.760234:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:3.0:1788270146.829033:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.829232:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253310080 00000100:00100000:2.0:1788270146.829243:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253310080 00000100:00100000:2.0:1788270146.829303:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 526 00000100:00100000:2.0:1788270146.829314:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:42857:x1875136253310080:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:2.0:1788270146.829372:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270146.829402:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9ea00/0xc5f5d7a016e0ab16 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610218f expref: 71 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829424:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270146.829440:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9f200/0xc5f5d7a016e0ab39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021a4 expref: 70 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829450:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270146.829454:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270146.829474:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829488:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829497:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829508:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829515:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829522:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829598:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829607:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829613:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270146.829851:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].15, 64 off9320 00000004:00080000:2.0:1788270146.829864:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 938536823444ns, next at 939536820789ns, rc = 0 00010000:00010000:2.0:1788270146.829907:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829916:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829924:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829931:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829937:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829943:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829970:0:46770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788270146.829986:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829993:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.829999:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830004:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270146.830009:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830016:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830025:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fea00) 00010000:00010000:2.0:1788270146.830028:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788270146.830032:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830088:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab78 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830105:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830112:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830118:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830124:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830129:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270146.830131:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830137:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830146:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270146.830148:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270146.830150:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830156:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270146.830165:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004402302a reply state 000000009715f8ad transno 30064771443 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830177:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.830183:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270146.830185:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270146.830188:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270146.830268:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:42857:x1875136253310080:12345-192.168.201.42@tcp:36:rm.0 Request processed in 955us (1243us total) trans 30064771443 rc 0/0 00000100:00100000:2.0:1788270146.830276:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 526 00010000:00010000:1.0:1788270146.830416:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270146.830423:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.830431:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ee00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270146.830434:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.830440:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.830450:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff98c1429fea00) 00010000:00010000:1.0:1788270146.830453:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270146.830455:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.830461:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ab7f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.830474:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270146.830475:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270146.830477:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270146.870366:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.870463:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253310208 00000100:00100000:2.0:1788270146.870474:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253310208 00000100:00100000:2.0:1788270146.870533:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 527 00000100:00100000:2.0:1788270146.870544:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:42863:x1875136253310208:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270146.870571:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.870591:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021b9 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.870658:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.870672:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.870683:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270146.870725:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270146.870729:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270146.870750:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.870783:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ab86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021b9 expref: 73 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.870804:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021b9 expref: 72 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.870812:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270146.870815:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270146.870818:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f800, rc 0) 00000100:00100000:2.0:1788270146.871521:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:42863:x1875136253310208:12345-192.168.201.42@tcp:101:bash.0 Request processed in 976us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.871530:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 527 00000100:00100000:3.0:1788270146.874698:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.878107:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253310464 00000100:00100000:2.0:1788270146.878122:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253310464 00000100:00100000:0.0:1788270146.878230:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 528 00000100:00100000:0.0:1788270146.878243:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:42863:x1875136253310464:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270146.878325:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270146.878329:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788270146.878356:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ab8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021b9 expref: 72 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.878377:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270146.878382:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270146.878396:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ab94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021c0 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.883472:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.883499:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.883513:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.883525:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.883534:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.883545:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270146.883928:0:45778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xcb:0x0], index 1: 0 00010000:00010000:0.0:1788270146.884522:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0aba9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884533:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0aba9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884542:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0aba9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884575:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884582:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884590:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884596:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270146.884600:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884607:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884619:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270146.884622:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270146.884627:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884633:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0ab9b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270146.884645:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8ee3d1f reply state 000000002689cb3e transno 30064771444 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884656:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884663:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:0.0:1788270146.884665:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270146.884668:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270146.884701:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ab94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c0 expref: 74 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884715:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0aba9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c0 expref: 73 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.884723:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788270146.884725:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270146.884727:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb400, rc 0) 00000100:00100000:0.0:1788270146.884819:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:42863:x1875136253310464:12345-192.168.201.42@tcp:101:bash.0 Request processed in 6578us (10129us total) trans 30064771444 rc 0/0 00000100:00100000:0.0:1788270146.884828:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 528 00000100:00100000:3.0:1788270146.887672:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270146.887808:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253310592 00000100:00100000:1.0:1788270146.887818:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253310592 00000100:00100000:1.0:1788270146.887888:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:1.0:1788270146.887898:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2402:x1875136253310592:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788270146.887916:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270146.887938:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021c7 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270146.887966:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788270146.887988:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=938s v=(0 0) 00010000:00010000:1.0:1788270146.887992:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270146.888002:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 18 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.888021:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 18 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270146.888035:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169200, rc 0) 00000100:00100000:1.0:1788270146.888124:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2402:x1875136253310592:12345-192.168.201.42@tcp:101:bash.0 Request processed in 226us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270146.888131:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:3.0:1788270146.893496:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.893593:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253310720 00000100:00100000:2.0:1788270146.893605:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253310720 00000100:00100000:2.0:1788270146.893668:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:2.0:1788270146.893680:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:42863:x1875136253310720:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270146.893699:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270146.893718:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021ce expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.893750:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.893785:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.893789:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.893794:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 19 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.893828:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.893948:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270146.893963:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262686208:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270146.894113:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:2.0:1788270146.898604:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262686208:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270146.898647:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 19 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.898669:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270146.906292:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:42863:x1875136253310720:12345-192.168.201.42@tcp:101:bash.0 Request processed in 12600us (12793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.906363:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:3.0:1788270146.922168:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.924973:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253310848 00000100:00100000:2.0:1788270146.924986:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253310848 00010000:00010000:2.0:1788270146.925031:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270146.925116:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:2.0:1788270146.925124:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+19:2401:x1875136253310848:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270146.925135:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270146.925154:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.925166:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.925187:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b73b24c5/0xc5f5d7a016e0abb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c7 expref: 19 pid: 47284 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.925203:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.925208:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270146.925216:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 18 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.925225:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 18 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270146.925990:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 18 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270146.926004:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262686336:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270146.926125:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270146.930065:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270146.930157:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262686336:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270146.930179:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270146.930231:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253310848:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 5105us (8072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270146.930243:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:0.0:1788270146.930359:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253311104 00000100:00100000:0.0:1788270146.930365:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253311104 00000100:00100000:0.0:1788270146.930401:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788270146.930407:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:42863:x1875136253311104:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788270146.930633:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+75:42863:x1875136253311104:12345-192.168.201.42@tcp:35:bash.0 Request processed in 225us (596us total) trans 30064771445 rc 0/0 00000100:00100000:0.0:1788270146.930637:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:1.0:1788270146.959523:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270146.959602:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253311232 00000100:00100000:0.0:1788270146.959613:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253311232 00000100:00100000:0.0:1788270146.959681:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 529 00000100:00100000:0.0:1788270146.959692:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+75:42866:x1875136253311232:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270146.959718:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270146.959739:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021d5 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.959815:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0abcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.959830:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0abcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.959851:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0abcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270146.959899:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270146.959903:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270146.959924:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0abcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.959949:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021d5 expref: 77 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.959967:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0abcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021d5 expref: 76 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270146.959977:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270146.959979:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270146.959983:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb000, rc 0) 00000100:00100000:0.0:1788270146.960070:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+76:42866:x1875136253311232:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 351us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270146.960078:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 529 00010000:00010000:3.0:1788270147.012857:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270147.134473:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270147.134678:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253311488 00000100:00100000:2.0:1788270147.134688:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253311488 00000100:00100000:2.0:1788270147.134784:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 530 00000100:00100000:2.0:1788270147.134796:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+76:42888:x1875136253311488:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270147.134820:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270147.134855:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0abd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021dc expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270147.134976:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0abda lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270147.134992:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0abda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270147.135004:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0abda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270147.135016:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 20 00010000:00010000:2.0:1788270147.135155:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0abd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021dc expref: 79 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270147.135177:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0abda lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021dc expref: 78 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270147.135187:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:2.0:1788270147.135189:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270147.135193:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f000, rc 0) 00000100:00100000:2.0:1788270147.135257:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:42888:x1875136253311488:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 463us (795us total) trans 30064771446 rc 0/0 00000100:00100000:2.0:1788270147.135264:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 530 00000100:00080000:3.0:1788270147.135869:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270147.139618:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270147.139727:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270147.139819:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253311872 00000100:00100000:0.0:1788270147.139829:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253311872 00000100:00100000:0.0:1788270147.139902:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 531 00000100:00100000:0.0:1788270147.139914:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:42888:x1875136253311872:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270147.139937:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270147.139961:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abe8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021e3 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.140119:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0abef lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.140134:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0abef lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.140146:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0abef lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270147.140514:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 20 00010000:00010000:0.0:1788270147.140620:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abe8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021e3 expref: 81 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.140645:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0abef lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021e3 expref: 80 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.140655:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788270147.140658:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788270147.140661:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba400, rc 0) 00000100:00100000:0.0:1788270147.140724:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:42888:x1875136253311872:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 812us (997us total) trans 30064771447 rc 0/0 00000100:00100000:0.0:1788270147.140732:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 531 00000100:00100000:1.0:1788270147.142831:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253311616 00000100:00100000:1.0:1788270147.142980:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253311616 00000100:00100000:1.0:1788270147.143172:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788270147.143184:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:2402:x1875136253311616:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270147.143198:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270147.143220:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0abda lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021dc expref: 80 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.143240:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:1.0:1788270147.143245:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270147.143306:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:2402:x1875136253311616:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 126us (3699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270147.143315:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788270147.180212:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270147.180468:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253312000 00000100:00100000:1.0:1788270147.180479:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253312000 00000100:00100000:1.0:1788270147.180552:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788270147.180563:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:42888:x1875136253312000:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:1.0:1788270147.180579:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270147.180605:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0abef lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021e3 expref: 79 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.180627:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:1.0:1788270147.180632:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270147.180701:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:42888:x1875136253312000:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 140us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270147.180710:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788270147.183504:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270147.183590:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253312256 00000100:00100000:1.0:1788270147.183599:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253312256 00000100:00100000:1.0:1788270147.183664:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:1.0:1788270147.183674:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:42888:x1875136253312256:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788270147.184117:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:42888:x1875136253312256:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 444us (620us total) trans 30064771448 rc 0/0 00000100:00100000:1.0:1788270147.184126:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788270147.189273:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270147.189360:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253312512 00000100:00100000:2.0:1788270147.189371:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253312512 00000100:00100000:2.0:1788270147.189442:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788270147.189454:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:42888:x1875136253312512:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788270147.189711:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:42888:x1875136253312512:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 259us (448us total) trans 30064771449 rc 0/0 00000100:00100000:2.0:1788270147.189719:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:3.0:1788270147.228380:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270147.228477:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253312768 00000100:00100000:0.0:1788270147.228486:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253312768 00000100:00100000:0.0:1788270147.228578:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 532 00000100:00100000:0.0:1788270147.228587:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:42889:x1875136253312768:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:0.0:1788270147.228638:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788270147.228663:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0aba9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021c0 expref: 80 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228683:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2300) 00010000:00010000:0.0:1788270147.228700:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0abcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021d5 expref: 79 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228708:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270147.228710:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270147.228727:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228740:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228747:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228769:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228779:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228789:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228871:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228878:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.228886:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270147.229357:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].14, 64 off9304 00010000:00010000:0.0:1788270147.229407:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229416:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229423:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229431:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229438:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229445:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229569:0:46770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270147.229590:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229596:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229603:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229609:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270147.229613:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229620:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229630:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270147.229633:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788270147.229637:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229647:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0ac0b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229663:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229669:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229674:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229680:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229685:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270147.229689:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229695:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229702:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270147.229704:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270147.229707:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229713:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0abfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270147.229722:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054107d59 reply state 00000000d09321b5 transno 30064771450 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229734:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270147.229740:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:0.0:1788270147.229743:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270147.229745:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270147.229825:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:42889:x1875136253312768:12345-192.168.201.42@tcp:36:rm.0 Request processed in 1237us (1453us total) trans 30064771450 rc 0/0 00000100:00100000:0.0:1788270147.229833:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 532 00010000:00010000:1.0:1788270147.230410:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270147.230418:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.230425:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270147.230429:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.230435:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.230446:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:1.0:1788270147.230448:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270147.230451:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.230456:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ac12 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270147.230469:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270147.230471:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270147.230472:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270147.269899:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270147.269926:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262686464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270147.270008:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270147.270605:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262686464 00000100:00100000:1.0:1788270147.270614:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262686464 00000100:00100000:1.0:1788270147.270679:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788270147.270690:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262686464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270147.270721:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 166985408 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270147.270797:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262686464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270147.270806:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788270147.270931:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262686464:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788270147.271351:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270147.780577:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262686592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270147.780655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270147.781328:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262686592 00000100:00100000:3.0:1788270147.781338:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262686592 00000100:00100000:3.0:1788270147.781487:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788270147.781498:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262686592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270147.781532:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:3.0:1788270147.781592:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262686592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270147.781600:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788270147.781671:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262686592:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270148.036828:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270148.293162:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270148.293170:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270148.293184:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:1.0:1788270148.293190:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788270149.061383:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270149.764250:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270149.764259:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270149.764348:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 9 count 4 00000040:00080000:2.0:1788270149.764356:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270149.829257:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262686720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270149.829330:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270149.829796:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262686720 00000100:00100000:3.0:1788270149.829805:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262686720 00000100:00100000:3.0:1788270149.829868:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788270149.829877:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262686720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270149.829911:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270149.829962:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262686720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270149.829969:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788270149.830008:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262686720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270150.084888:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270150.146268:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.146304:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.146343:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.146375:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.146397:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270150.146412:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313408 00000100:00100000:3.0:1788270150.146413:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270150.146422:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313408 00000100:00100000:3.0:1788270150.146427:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.146446:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.146464:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313152 00000100:00100000:3.0:1788270150.146467:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313152 00000100:00100000:1.0:1788270150.146473:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313280 00000100:00100000:1.0:1788270150.146475:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313280 00000100:00100000:3.0:1788270150.146488:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313664 00000100:00100000:3.0:1788270150.146491:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313664 00000100:00100000:1.0:1788270150.146494:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:3.0:1788270150.146502:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313792 00000100:00100000:1.0:1788270150.146503:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2403:x1875136253313408:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270150.146504:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313792 00000100:00100000:3.0:1788270150.146515:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313024 00000100:00100000:3.0:1788270150.146518:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313024 00000100:00100000:3.0:1788270150.146525:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313536 00000100:00100000:3.0:1788270150.146528:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313536 00000100:00100000:3.0:1788270150.146541:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:3.0:1788270150.146547:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253313152:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270150.146581:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2403:x1875136253313408:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270150.146587:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:1.0:1788270150.146604:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:1.0:1788270150.146610:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253313280:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270150.146620:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:2.0:1788270150.146628:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253313664:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270150.146682:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253312896 00000100:00100000:0.0:1788270150.146687:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253312896 00000100:00100000:0.0:1788270150.146727:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:0.0:1788270150.146734:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253312896:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270150.147757:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253313152:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1206us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.147766:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:3.0:1788270150.147791:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 197 00000100:00100000:3.0:1788270150.147801:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:2403:x1875136253313024:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270150.150836:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253313280:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4214us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270150.150850:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:0.0:1788270150.150884:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253312896:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4149us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.150893:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00080000:1.0:1788270150.150895:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270150.150900:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270150.150903:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270150.150905:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270150.150933:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:0.0:1788270150.150944:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253313536:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270150.150982:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253313536:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (4534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.150988:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:0.0:1788270150.151005:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 533 00000100:00100000:0.0:1788270150.151012:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:43316:x1875136253313792:12345-192.168.201.42@tcp:101:lctl.0 00010000:00010000:0.0:1788270150.151025:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270150.151060:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0ac19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021ea expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270150.151118:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0ac20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270150.151131:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270150.151142:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270150.151183:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270150.151187:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270150.151209:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270150.151232:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0ac19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ea expref: 83 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270150.151249:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0ac20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ea expref: 82 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270150.151256:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270150.151259:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270150.151262:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb200, rc 0) 00000100:00100000:0.0:1788270150.151300:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+82:43316:x1875136253313792:12345-192.168.201.42@tcp:101:lctl.0 Request processed in 288us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.151307:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 533 00000100:00100000:2.0:1788270150.153130:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253313664:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 6495us (6746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270150.153141:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:3.0:1788270150.156344:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:2403:x1875136253313024:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 8535us (9918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.156359:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 197 00000100:00100000:1.0:1788270150.218870:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270150.220642:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253313920 00000100:00100000:0.0:1788270150.220657:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253313920 00000100:00100000:1.0:1788270150.221883:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 534 00000100:00100000:1.0:1788270150.221893:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:42747:x1875136253313920:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788270150.222028:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:42747:x1875136253313920:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 136us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270150.222034:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 534 00000100:00100000:1.0:1788270150.226720:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270150.226784:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253314048 00000100:00100000:0.0:1788270150.226793:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253314048 00000100:00100000:0.0:1788270150.226852:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 535 00000100:00100000:0.0:1788270150.226862:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:42747:x1875136253314048:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788270150.226961:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:42747:x1875136253314048:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.226970:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 535 00000100:00100000:3.0:1788270150.234392:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270150.234605:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253314304 00000100:00100000:1.0:1788270150.234615:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253314304 00000100:00100000:1.0:1788270150.234671:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:1.0:1788270150.234680:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:42747:x1875136253314304:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788270150.234946:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+82:42747:x1875136253314304:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 266us (563us total) trans 30064771451 rc 0/0 00000100:00100000:1.0:1788270150.234955:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:1.0:1788270150.339490:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270150.339896:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253314432 00000100:00100000:3.0:1788270150.339906:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253314432 00000100:00100000:3.0:1788270150.339965:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 536 00000100:00100000:3.0:1788270150.339976:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:43334:x1875136253314432:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:3.0:1788270150.339995:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270150.340014:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ac27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021f1 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270150.340138:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270150.340152:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270150.340165:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270150.340205:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788270150.340209:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270150.340228:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270150.340250:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ac27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 7 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270150.340267:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 6 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270150.340275:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270150.340278:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270150.340281:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241542c00, rc 0) 00000100:00100000:3.0:1788270150.340334:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:43334:x1875136253314432:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 360us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.340343:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 536 00000100:00100000:1.0:1788270150.340832:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262686848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270150.340871:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270150.340904:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262686848 00000100:00100000:2.0:1788270150.340910:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262686848 00000100:00080000:1.0:1788270150.340940:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270150.340957:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788270150.340965:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262686848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270150.340989:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 258698944 pending 3198976 free 3776675840 avail 3545153536 00000100:00100000:2.0:1788270150.341027:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262686848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270150.341184:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262686848:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788270150.341731:0:45801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 942048689823ns, next at 943048687466ns, rc = 0 00000100:00100000:0.0:1788270150.341755:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262686976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270150.341791:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270150.341828:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262686976 00000100:00100000:0.0:1788270150.341833:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262686976 00000100:00100000:0.0:1788270150.341864:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788270150.341871:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262686976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270150.341891:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 166985408 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270150.341927:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262686976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.341934:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788270150.341960:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771137 gen 2 00000004:00080000:0.0:1788270150.341964:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1440c0e00, transno 30064771136 00000004:00080000:0.0:1788270150.341972:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1440c0a80, transno 30064771137 00000100:00100000:0.0:1788270150.341981:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262686976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270150.342001:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262687488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342025:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342058:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262687104:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342058:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262688000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342081:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342084:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270150.342099:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788270150.342105:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262687616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342105:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262687360:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342126:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342143:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262688128:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342155:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262687872:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342164:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342183:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788270150.342189:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262687232:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342210:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342225:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262687744:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342242:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270150.342255:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262688256:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342275:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270150.342285:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687360 00000100:00100000:0.0:1788270150.342289:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687360 00000100:00100000:3.0:1788270150.342297:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687616 00000100:00100000:3.0:1788270150.342300:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687616 00000100:00100000:0.0:1788270150.342313:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687744 00000100:00100000:0.0:1788270150.342315:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687744 00000100:00100000:3.0:1788270150.342321:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687232 00000100:00100000:3.0:1788270150.342323:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687232 00000100:00100000:0.0:1788270150.342331:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788270150.342335:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788270150.342337:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262687360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342340:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262687616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342368:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262687616:12345-0@lo:400:kworker.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.342368:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262687360:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.342374:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788270150.342375:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788270150.342386:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788270150.342386:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788270150.342393:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262687232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342393:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262687744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342417:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262687232:12345-0@lo:400:kworker.0 Request processed in 25us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.342417:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262687744:12345-0@lo:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.342423:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788270150.342423:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788270150.342440:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687488 00000100:00100000:0.0:1788270150.342444:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687488 00000100:00100000:3.0:1788270150.342450:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262687232:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342459:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262687744:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342464:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688000 00000100:00100000:0.0:1788270150.342466:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688000 00000100:00100000:3.0:1788270150.342468:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262687616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342477:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688128 00000100:00100000:0.0:1788270150.342480:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688128 00000100:00100000:3.0:1788270150.342489:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270150.342491:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688256 00000100:00100000:3.0:1788270150.342502:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262688384:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342507:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688256 00000100:00100000:0.0:1788270150.342522:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687872 00000100:00100000:0.0:1788270150.342525:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687872 00000100:00100000:3.0:1788270150.342536:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270150.342537:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788270150.342542:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262687488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342556:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262687360:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342570:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262687488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342570:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262687488:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.342576:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788270150.342585:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688384 00000100:00100000:0.0:1788270150.342588:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688384 00000100:00100000:3.0:1788270150.342592:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788270150.342597:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262688000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270150.342602:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788270150.342607:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262688128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.342630:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262688000:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.342630:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262688128:12345-0@lo:400:kworker.0 Request processed in 23us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270150.342636:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000004:00080000:1.0:1788270150.342783:0:45803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 942049742696ns, next at 943049741209ns, rc = 0 00000100:00080000:1.0:1788270150.342808:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270150.342812:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270150.342815:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270150.342817:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270150.342824:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270150.342832:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262688512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270150.342857:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270150.342884:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688512 00000100:00100000:1.0:1788270150.342889:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688512 00000100:00100000:1.0:1788270150.342911:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788270150.342918:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262688512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270150.342929:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 258698944 pending 3198976 free 3776675840 avail 3545153536 00000100:00100000:1.0:1788270150.342961:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262688512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270150.342968:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788270150.342996:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262688512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270150.343379:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788270150.343407:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262687104 00000100:00100000:2.0:1788270150.343411:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262687104 00000100:00100000:2.0:1788270150.343436:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788270150.343443:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262687104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270150.343479:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262687104:12345-0@lo:400:kworker.0 Request processed in 37us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270150.343486:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788270150.345369:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788270150.345405:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788270150.345418:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262688256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345483:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262688256:12345-0@lo:400:kworker.0 Request processed in 72us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.345490:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788270150.345504:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788270150.345510:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262687872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345539:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262687872:12345-0@lo:400:kworker.0 Request processed in 29us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.345545:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788270150.345558:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788270150.345565:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262688384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345593:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262688384:12345-0@lo:400:kworker.0 Request processed in 29us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270150.345599:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788270150.345671:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262687872:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345683:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262688384:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345694:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262688000:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345798:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262688256:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.345811:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262687104:0@lo:400:kworker.0 00000100:00100000:3.0:1788270150.346184:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262688128:0@lo:400:kworker.0 00010000:00010000:1.0:1788270151.108602:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788270151.367890:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771167 is committed 00000001:00080000:0.0:1788270151.367904:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771166 is committed 00000001:02000400:1.0:1788270151.972792:0:51233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 09:42:31 (1788270151) 00010000:00010000:0.0:1788270152.133059:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270152.172974:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.173604:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253314688 00000100:00100000:2.0:1788270152.173615:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253314688 00000100:00100000:2.0:1788270152.173698:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 537 00000100:00100000:2.0:1788270152.173709:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+82:43531:x1875136253314688:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.173733:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.173754:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ac35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021f8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173827:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173845:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173856:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173873:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173881:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173887:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173989:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ac4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.173999:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ac4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174006:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ac4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270152.174015:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788270152.174119:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174127:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174293:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174301:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174308:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.174313:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174322:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174335:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:2.0:1788270152.174339:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.174343:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174349:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0ac3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174364:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174483:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174491:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174496:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.174499:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174510:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174518:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.174521:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.174524:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.174530:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ac43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788270152.174781:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788270152.174997:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ac35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f8 expref: 85 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.175015:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ac4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f8 expref: 84 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.175023:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270152.175026:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.175028:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fe00, rc 0) 00000100:00100000:2.0:1788270152.175738:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+84:43531:x1875136253314688:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2027us (2770us total) trans 30064771452 rc 0/0 00000100:00100000:2.0:1788270152.175747:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 537 00000001:00080000:0.0:1788270152.177633:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771452 is committed 00010000:00010000:2.0:1788270152.177641:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270152.177647:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00010000:00010000:2.0:1788270152.177655:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270152.177676:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000004:00080000:0.0:1788270152.177710:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000004:00080000:0.0:1788270152.177729:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000020:00080000:0.0:1788270152.177739:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c14343b000 refcount 2 committed 0 result 0 batchid 25769803848 00000020:00080000:0.0:1788270152.177744:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c250d4e000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c14343bd80 00000020:00080000:0.0:1788270152.177747:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c250d4e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c26bebbe00 00000100:00100000:1.0:1788270152.177807:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262688768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788270152.177868:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270152.177926:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270152.177933:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262688640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788270152.177956:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270152.177988:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688768 00000100:00100000:1.0:1788270152.177995:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688768 00000100:00100000:1.0:1788270152.178065:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688640 00000100:00100000:1.0:1788270152.178069:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688640 00000100:00100000:1.0:1788270152.178091:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788270152.178100:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262688768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788270152.178124:0:47281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:203 count 1 00000100:00100000:0.0:1788270152.178264:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788270152.178274:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262688640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788270152.178293:0:48231:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:202 count 1 00000020:00080000:3.0:1788270152.178308:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803848 committed batchid 25769803847 00002000:00010000:0.0:1788270152.178325:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xca:0x0] initial LVB size: 5, mtime: 0x6a96d642, atime: 0x6a96d642, ctime: 0x6a96d642, blocks: 0x8 00010000:00010000:0.0:1788270152.178334:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178350:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=943s v=(0 0) 00010000:00010000:0.0:1788270152.178355:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270152.178361:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788270152.178363:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803847 00010000:00010000:0.0:1788270152.178380:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178388:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178396:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178411:0:48231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788270152.178452:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262688896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788270152.178490:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270152.178530:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262688896 00000100:00100000:3.0:1788270152.178534:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262688896 00000100:00100000:0.0:1788270152.178542:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262688640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 268us (582us total) trans 30064771168 rc 0/0 00000100:00100000:0.0:1788270152.178550:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1788270152.178571:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270152.178576:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788270152.178579:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178602:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270152.178607:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 13 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178611:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.178621:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xcb:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1788270152.178626:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bae00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270152.178627:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270152.178632:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.178634:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.178651:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.178683:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 13 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.178697:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 13 pid: 48231 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.178708:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262689024:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270152.178763:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c247fa9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.178790:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771167 gen 2 00000004:00080000:1.0:1788270152.178795:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771167 committed transno 30064771167 00000100:00100000:1.0:1788270152.178816:0:3610:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c248219c00 x1875136262688640/t30064771168(30064771168) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788270168 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788270152.178826:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c248219c00/2, rc 0, transno 30064771168 00000100:00100000:1.0:1788270152.178831:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262688640:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788270152.179309:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179317:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.179321:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179328:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179341:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270152.179344:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.179348:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179354:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0a9fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179383:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179390:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179395:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179400:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.179402:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179412:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179420:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270152.179422:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.179424:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179429:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0aade lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179439:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179445:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179450:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179454:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c143b9e800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.179457:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179463:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179470:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270152.179472:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.179474:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179480:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0ab0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179490:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179494:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179500:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179504:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.179506:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179511:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179518:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270152.179520:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.179523:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179529:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ab71 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179540:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179545:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179551:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179556:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.179559:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179565:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179572:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270152.179574:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.179577:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179582:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0aba2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179603:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179609:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179615:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179620:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.179623:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179632:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179638:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff98c1429f7e00) 00010000:00010000:2.0:1788270152.179640:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.179643:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.179648:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0ac04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.180321:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.180333:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.180352:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270152.180354:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270152.180356:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270152.181110:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788270152.181125:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262688896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788270152.181152:0:48230:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:203 count 1 00010000:00010000:3.0:1788270152.181172:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.181412:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 10 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.181423:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xcb:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1788270152.181427:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270152.181431:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.181465:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 10 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.181476:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 10 pid: 48230 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.181489:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:48230:1875136262689152:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270152.181731:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.181801:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253314816 00000100:00100000:2.0:1788270152.181808:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253314816 00000100:00100000:2.0:1788270152.181852:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 538 00000100:00100000:2.0:1788270152.181860:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:43531:x1875136253314816:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788270152.182063:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143a466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270152.182482:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:43531:x1875136253314816:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 622us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.182490:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 538 00000100:00100000:0.0:1788270152.185211:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.185266:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270152.185381:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:47281:1875136262689024:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270152.185411:0:47281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.185534:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253314944 00000100:00100000:2.0:1788270152.185540:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253314944 00000100:00100000:2.0:1788270152.185593:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253315072 00000100:00100000:2.0:1788270152.185596:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253315072 00010000:00010000:2.0:1788270152.185621:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 14 pid: 48231 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.185647:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:2.0:1788270152.185656:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253315072:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.185680:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270152.185687:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 14 pid: 48231 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.185701:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 14 pid: 48231 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.185722:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c20d3c36/0xc5f5d7a016e0abbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ce expref: 14 pid: 48231 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.185738:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270152.185742:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270152.185748:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.185756:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.185781:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270152.185828:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253315072:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 172us (560us total) trans 0 rc 0/0 00010000:00010000:0.0:1788270152.186124:0:47281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.186134:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.186144:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.186155:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.186174:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270152.186205:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788270152.186216:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:1.0:1788270152.186222:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:2401:x1875136253314944:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270152.186235:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270152.186251:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ac4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f8 expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.186268:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:1.0:1788270152.186272:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270152.186293:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:2401:x1875136253314944:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 76us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270152.186299:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00010000:00010000:1.0:1788270152.186318:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270152.186325:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.186332:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270152.186336:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.186351:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.186363:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.186371:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270152.186373:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270152.186374:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270152.186407:0:47281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046700543/0xc5f5d7a016e0ac5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.186583:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3610:x1875136262688768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8483us (8713us total) trans 30064771169 rc 0/0 00000100:00100000:0.0:1788270152.186592:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000004:00080000:1.0:1788270152.186921:0:3610:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27c309180/2, rc 0, transno 30064771169 00000100:00100000:1.0:1788270152.186928:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262688768:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788270152.187806:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270152.192623:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270152.192733:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.192905:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253315328 00000100:00100000:2.0:1788270152.192914:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253315328 00000100:00100000:2.0:1788270152.192980:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 539 00000100:00100000:2.0:1788270152.192992:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:43531:x1875136253315328:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788270152.193125:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:43531:x1875136253315328:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 136us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.193133:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 539 00000100:00080000:1.0:1788270152.193278:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270152.193401:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253315200 00000100:00100000:0.0:1788270152.193406:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253315200 00010000:00010000:0.0:1788270152.193521:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 11 pid: 48230 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.193557:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:0.0:1788270152.193565:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253315200:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270152.193577:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270152.193583:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 11 pid: 48230 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.193597:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 11 pid: 48230 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.193620:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270152.193625:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270152.193630:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.193640:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.193661:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270152.193724:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253315200:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 160us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270152.193731:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00010000:00010000:3.0:1788270152.194063:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f622673/0xc5f5d7a016e0ab2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610219d expref: 10 pid: 48230 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.194079:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:48230:1875136262689152:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270152.194098:0:48230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.194113:0:48230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.194120:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.194130:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.194137:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.194163:0:48230:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788270152.194212:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270152.194335:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262688896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13215us (15844us total) trans 30064771142 rc 0/0 00000100:00100000:3.0:1788270152.194343:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00010000:00010000:0.0:1788270152.194396:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270152.194403:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.194410:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270152.194415:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.194424:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.194437:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.194445:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ac66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.194467:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270152.194469:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270152.194471:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788270152.194662:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27a61a680/2, rc 0, transno 30064771142 00000100:00100000:1.0:1788270152.194678:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262688896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788270152.230122:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.230739:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253315584 00000100:00100000:2.0:1788270152.230748:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253315584 00000100:00100000:2.0:1788270152.230805:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 540 00000100:00100000:2.0:1788270152.230815:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+42:43363:x1875136253315584:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788270152.230834:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.230837:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270152.230860:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0ac20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ea expref: 42 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.230874:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270152.230878:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270152.230888:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ac6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561021ff expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.230969:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.230978:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.230984:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.231010:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 5 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.231076:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 5 pid: 45777 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.231091:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262689280:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270152.231171:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788270152.233768:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262689280:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270152.233795:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.234294:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.234334:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253315712 00000100:00100000:2.0:1788270152.234341:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253315712 00010000:00010000:2.0:1788270152.234387:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 6 pid: 45777 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788270152.234460:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270152.234509:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:2.0:1788270152.234519:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+6:2401:x1875136253315712:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.234534:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270152.234541:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 6 pid: 45777 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.234554:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 6 pid: 45777 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.234573:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ac2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021f1 expref: 6 pid: 45777 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.234602:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270152.234607:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.234620:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.234627:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.234660:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270152.234718:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253315712:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 200us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.234726:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00010000:00010000:0.0:1788270152.234742:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.234852:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.234875:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.234885:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.234892:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270152.235260:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcc:0x0], index 0: 0 00010000:00010000:0.0:1788270152.235386:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235393:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235398:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235433:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235440:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235444:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235448:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235452:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270152.235455:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235459:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235469:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270152.235471:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270152.235474:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235478:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ac74 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270152.235488:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006871eaf5 reply state 0000000067a5b0d8 transno 30064771453 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235495:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235499:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff98c1429f1a00) 00010000:00010000:0.0:1788270152.235501:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270152.235502:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270152.235524:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ac6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 44 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235533:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 43 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.235537:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270152.235538:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270152.235540:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500baa00, rc 0) 00000100:00100000:0.0:1788270152.235571:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:43363:x1875136253315584:12345-192.168.201.42@tcp:101:bash.0 Request processed in 4758us (5459us total) trans 30064771453 rc 0/0 00000100:00100000:0.0:1788270152.235578:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 540 00000100:00100000:1.0:1788270152.237684:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.237757:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253315840 00000100:00100000:0.0:1788270152.237766:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253315840 00000100:00100000:0.0:1788270152.237843:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:0.0:1788270152.237851:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:43363:x1875136253315840:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788270152.237864:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.237879:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102206 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270152.237899:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788270152.237914:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=943s v=(0 0) 00010000:00010000:0.0:1788270152.237917:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270152.237923:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 11 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.237938:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 11 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.237946:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bae00, rc 0) 00000100:00100000:0.0:1788270152.237987:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:43363:x1875136253315840:12345-192.168.201.42@tcp:101:bash.0 Request processed in 136us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270152.237994:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:2.0:1788270152.239910:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.239994:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253316096 00000100:00100000:0.0:1788270152.240002:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253316096 00000100:00100000:0.0:1788270152.240496:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788270152.240506:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:43363:x1875136253316096:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788270152.240767:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:43363:x1875136253316096:12345-192.168.201.42@tcp:35:bash.0 Request processed in 262us (863us total) trans 30064771454 rc 0/0 00000100:00100000:0.0:1788270152.240775:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:2.0:1788270152.251739:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270152.251917:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253316224 00000100:00100000:1.0:1788270152.251928:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253316224 00000100:00100000:1.0:1788270152.252023:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 541 00000100:00100000:1.0:1788270152.252034:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:43542:x1875136253316224:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270152.252097:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270152.252118:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0ac97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610220d expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.252180:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ac9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.252194:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ac9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.252205:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ac9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270152.252244:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788270152.252248:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270152.252267:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ac9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.252290:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0ac97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610220d expref: 47 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.252308:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ac9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610220d expref: 46 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.252315:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270152.252317:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788270152.252319:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169200, rc 0) 00000100:00100000:1.0:1788270152.252373:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:43542:x1875136253316224:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 343us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270152.252377:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 541 00000100:00100000:3.0:1788270152.353110:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.353216:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253316480 00000100:00100000:0.0:1788270152.353234:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253316480 00000100:00100000:0.0:1788270152.353330:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 542 00000100:00100000:0.0:1788270152.353343:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:43558:x1875136253316480:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270152.353368:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.353397:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0aca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102214 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.353538:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0acac lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.353561:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0acac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.353577:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0acac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270152.353591:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:0.0:1788270152.354451:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0aca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102214 expref: 49 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.354477:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0acac lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102214 expref: 48 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.354488:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270152.354491:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270152.354495:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb600, rc 0) 00000100:00100000:0.0:1788270152.354633:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:43558:x1875136253316480:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1285us (1525us total) trans 30064771455 rc 0/0 00000100:00100000:0.0:1788270152.354642:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 542 00000100:00100000:3.0:1788270152.361118:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.361188:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253316736 00000100:00100000:0.0:1788270152.361204:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253316736 00000100:00100000:0.0:1788270152.361290:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 543 00000100:00100000:0.0:1788270152.361305:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:43558:x1875136253316736:12345-192.168.201.42@tcp:101:lfs.0 00000100:00100000:3.0:1788270152.361321:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:0.0:1788270152.361344:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.361379:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0acba lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610221b expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.361504:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253316864 00000100:00100000:1.0:1788270152.361516:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253316864 00000100:00100000:1.0:1788270152.361583:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788270152.361593:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2402:x1875136253316864:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270152.361609:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270152.361612:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0acc1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.361635:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0acac lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102214 expref: 50 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.361645:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0acc1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.361660:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270152.361669:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0acc1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.361687:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1788270152.361695:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00000100:00100000:1.0:1788270152.361791:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2402:x1875136253316864:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 197us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270152.361801:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00010000:00010000:0.0:1788270152.361841:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0acba lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610221b expref: 50 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.361875:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0acc1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610221b expref: 49 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.361884:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:0.0:1788270152.361889:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788270152.361892:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bac00, rc 0) 00000100:00100000:0.0:1788270152.362029:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:43558:x1875136253316736:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 727us (916us total) trans 30064771456 rc 0/0 00000100:00100000:0.0:1788270152.362037:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 543 00000100:00100000:3.0:1788270152.373501:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.373565:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253316992 00000100:00100000:0.0:1788270152.373577:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253316992 00000100:00100000:0.0:1788270152.373850:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:0.0:1788270152.373869:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253316992:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:0.0:1788270152.373931:0:48231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.373958:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 11 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.373968:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xcc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788270152.373973:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788270152.373978:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 4/0,1 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.374015:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 11 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.374028:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 11 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.374074:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262689408:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270152.374164:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143932600 going to sleep for 11 seconds 00000100:00100000:0.0:1788270152.375349:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262689408:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270152.375370:0:48231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.375686:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270152.375876:0:47288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253317120 00000100:00100000:1.0:1788270152.375884:0:47288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253317120 00002000:00100000:1.0:1788270152.375933:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xcc:0x0] (0->23) req@ffff98c27fb73b80 x1875136253317120/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:568/0 lens 512/0 e 0 to 0 dl 1788270163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270152.375942:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73b80 with x1875136253317120 ext(0->23) 00010000:00010000:1.0:1788270152.375948:0:47288:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 12 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.375959:0:47288:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 12 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270152.375965:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27fb73b80 00000100:00100000:1.0:1788270152.375992:0:47288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788270152.376001:0:47288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253317120:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:1.0:1788270152.377068:0:47288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253317120:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 1062us (1378us total) trans 30064771143 rc 0/0 00000100:00100000:1.0:1788270152.377079:0:47288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00002000:00100000:1.0:1788270152.377087:0:47288:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xcc:0x0] (0->23) req@ffff98c27fb73b80 x1875136253317120/t30064771143(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:568/0 lens 512/448 e 0 to 0 dl 1788270163 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788270152.377097:0:47288:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27fb73b80 with x1875136253317120 ext(0->23) 00010000:00010000:1.0:1788270152.377104:0:47288:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 14 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.377118:0:47288:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 14 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788270152.377123:0:47288:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c27fb73b80 00000100:00100000:1.0:1788270152.379637:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.379856:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253317248 00000100:00100000:2.0:1788270152.379867:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253317248 00010000:00010000:2.0:1788270152.379913:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 14 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.379983:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:2.0:1788270152.379991:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253317248:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.380006:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788270152.380028:0:45762:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:2.0:1788270152.380032:0:45762:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb mtime from disk: 0 -> 1788270152 00002000:00010000:2.0:1788270152.380034:0:45762:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb atime from disk: 0 -> 1788270152 00002000:00010000:2.0:1788270152.380080:0:45762:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb ctime from disk: 0 -> 1788270152 00002000:00010000:2.0:1788270152.380083:0:45762:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xcc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788270152.380089:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 14 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.380106:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 14 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.380130:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ac90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102206 expref: 14 pid: 47284 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.380147:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270152.380151:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270152.380156:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.380164:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.380186:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270152.380251:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253317248:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 260us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.380258:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00010000:00010000:0.0:1788270152.380348:0:48231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380358:0:48231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380381:0:48231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380388:0:48231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380394:0:48231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380398:0:48231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bbc00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270152.380402:0:48231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380407:0:48231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380415:0:48231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.380421:0:48231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000012a909a/0xc5f5d7a016e0accf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.380461:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253316992:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 6602us (6974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270152.380466:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:3.0:1788270152.382197:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.382239:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253317504 00000100:00100000:2.0:1788270152.382248:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253317504 00000100:00100000:2.0:1788270152.382307:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788270152.382316:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:43558:x1875136253317504:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:2.0:1788270152.382391:0:45779:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x2a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0acc1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610221b expref: 49 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270152.382852:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771457 00000001:00080000:2.0:1788270152.382937:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771458 00000001:00080000:2.0:1788270152.383271:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771459 00010000:00010000:2.0:1788270152.383304:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.383317:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 53 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.383324:0:45779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.383357:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 53 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.383368:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 53 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.383380:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262689536:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270152.383501:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.386281:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.386294:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262689536:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270152.386326:0:45779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.387368:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253317632 00000100:00100000:3.0:1788270152.387380:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253317632 00010000:00010000:3.0:1788270152.387434:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 54 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.387521:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:3.0:1788270152.387533:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:2400:x1875136253317632:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270152.387550:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270152.387558:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 54 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.387573:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 54 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.387618:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0ac82 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561021ff expref: 54 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.387641:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:3.0:1788270152.387647:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.387658:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.387677:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.387714:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270152.387799:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:2400:x1875136253317632:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 268us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.387807:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00010000:00010000:2.0:1788270152.388599:0:45779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.388611:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270152.388768:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771460 00000001:00080000:2.0:1788270152.388905:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771461 00000040:00080000:1.0:1788270152.388977:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270152.388983:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270152.389007:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000100:00100000:2.0:1788270152.389014:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262689664:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1788270152.389014:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788270152.389098:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270152.389132:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244180 going to sleep for 11 seconds 00000100:00100000:3.0:1788270152.389174:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262689664 00000100:00100000:3.0:1788270152.389181:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262689664 00000100:00100000:3.0:1788270152.389235:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788270152.389245:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262689664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270152.389336:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262689664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.389344:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788270152.389394:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262689664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788270152.389521:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771462 00000100:00100000:2.0:1788270152.389558:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262689920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788270152.389571:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262689792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270152.389583:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270152.389625:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.389781:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262689920 00000100:00100000:1.0:1788270152.389785:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262689920 00000100:00100000:1.0:1788270152.389822:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788270152.389829:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262689920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788270152.390075:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:45779:x1875136262689920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 246us (489us total) trans 30064771144 rc 0/0 00000100:00100000:1.0:1788270152.390083:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788270152.390121:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262689920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788270152.390159:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771463 00000100:00100000:0.0:1788270152.390162:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788270152.390192:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.390203:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.390211:0:45779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.390217:0:45779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.390223:0:45779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.390231:0:45779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.390254:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:2.0:1788270152.390257:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788270152.390262:0:45779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.390269:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0acd6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.390324:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262689792 00000100:00100000:1.0:1788270152.390329:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262689792 00000004:00080000:2.0:1788270152.390371:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1788270152.390442:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000040:00080000:2.0:1788270152.390446:0:45779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].16, 64 off9384 00000100:00100000:1.0:1788270152.390450:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262689792:12345-0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1788270152.390460:0:45779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 944097419692ns, next at 945097416914ns, rc = 0 00000001:00080000:2.0:1788270152.390466:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771464 00002000:00000024:1.0:1788270152.390466:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175394496 pending 28672 free 3839610880 avail 3608088576 00010000:00010000:2.0:1788270152.390487:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429f1b00) 00010000:00010000:2.0:1788270152.390491:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270152.390498:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0acc1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610221b expref: 57 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.390506:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262689792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270152.390512:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788270152.390541:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270152.390604:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:43558:x1875136253317504:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 8288us (8412us total) trans 30064771465 rc 0/0 00000100:00100000:2.0:1788270152.390989:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000020:00080000:2.0:1788270152.390995:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788270152.391189:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262689792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270152.392269:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.392368:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253317760 00000100:00100000:2.0:1788270152.392376:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253317760 00000100:00100000:2.0:1788270152.392457:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 544 00000100:00100000:2.0:1788270152.392467:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:43558:x1875136253317760:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270152.392490:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.392516:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0acdd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102222 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.392579:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0acdd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102222 expref: 57 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.392607:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0acdd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102222 expref: 57 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.392636:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.392639:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270152.392643:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ee00, rc 0) 00000100:00100000:2.0:1788270152.392727:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:43558:x1875136253317760:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 261us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.392733:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 544 00000100:00100000:0.0:1788270152.395063:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.395684:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253318016 00000100:00100000:3.0:1788270152.395698:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253318016 00000100:00100000:3.0:1788270152.395766:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788270152.395778:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:43558:x1875136253318016:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270152.396085:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:43558:x1875136253318016:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 308us (1059us total) trans 30064771466 rc 0/0 00000100:00100000:3.0:1788270152.396093:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788270152.447009:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.447472:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253318144 00000100:00100000:0.0:1788270152.447487:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253318144 00000100:00100000:0.0:1788270152.447563:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 545 00000100:00100000:0.0:1788270152.447573:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:43564:x1875136253318144:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270152.447603:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.447630:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0ace4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102229 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447758:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447774:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447786:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447799:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447807:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447813:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447908:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447918:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.447925:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270152.447971:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00000004:00200000:0.0:1788270152.447976:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270152.447996:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448009:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448018:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448024:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448031:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448063:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270152.448068:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448076:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448090:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270152.448094:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270152.448098:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448105:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0aceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448119:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448125:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448130:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448136:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270152.448139:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448145:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448151:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff98c1429f1a00) 00010000:00010000:0.0:1788270152.448153:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270152.448155:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448161:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0acf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448185:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0ace4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 60 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448204:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 59 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.448212:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270152.448215:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270152.448217:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba200, rc 0) 00000100:00100000:0.0:1788270152.448298:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:43564:x1875136253318144:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 727us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270152.448306:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 545 00000100:00100000:1.0:1788270152.452359:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.452509:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253318400 00000100:00100000:0.0:1788270152.452673:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253318400 00000100:00100000:0.0:1788270152.452805:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 546 00000100:00100000:0.0:1788270152.452817:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:43564:x1875136253318400:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270152.452845:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.452881:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ad00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102230 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.453014:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.453030:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 60 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.457212:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.457343:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 60 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.457363:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 60 pid: 48110 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.457383:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262690048:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270152.457504:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143932600 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.460327:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.460417:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262690048:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270152.460448:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.460497:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253318528 00000100:00100000:2.0:1788270152.460511:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253318528 00010000:00010000:2.0:1788270152.460556:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 61 pid: 48110 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.460599:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:2.0:1788270152.460618:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:2401:x1875136253318528:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.460637:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270152.460646:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 61 pid: 48110 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.460670:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 61 pid: 48110 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.460703:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0acf9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102229 expref: 61 pid: 48110 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.460723:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.460728:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.460739:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.460747:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.460777:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270152.460828:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.460836:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.460837:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:2401:x1875136253318528:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 229us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.460846:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000004:00200000:0.0:1788270152.460859:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:0.0:1788270152.461021:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ad00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 61 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.461065:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 60 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.461094:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270152.461097:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788270152.461100:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba400, rc 0) 00000100:00100000:0.0:1788270152.461132:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:43564:x1875136253318400:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 8319us (8789us total) trans 30064771467 rc 0/0 00000100:00100000:0.0:1788270152.461142:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 546 00000100:00100000:1.0:1788270152.479524:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.479625:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253318784 00000100:00100000:2.0:1788270152.479634:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253318784 00000100:00100000:2.0:1788270152.479698:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 547 00000100:00100000:2.0:1788270152.479709:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:43567:x1875136253318784:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270152.479733:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.479751:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ad15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102237 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480327:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480343:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480352:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480360:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480366:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480369:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480463:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0ad2a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480472:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0ad2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480478:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0ad2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270152.480488:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:3.0:1788270152.480556:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480561:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480565:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480569:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480573:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.480575:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480582:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480591:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270152.480593:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.480596:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480600:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480610:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480613:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480617:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480619:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.480621:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480624:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480627:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff98c1429f1a00) 00010000:00010000:3.0:1788270152.480629:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.480630:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.480636:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.481226:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ad15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102237 expref: 63 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.481247:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0ad2a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102237 expref: 62 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.481256:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.481258:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788270152.481261:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543e00, rc 0) 00000100:00100000:3.0:1788270152.481324:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:43567:x1875136253318784:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1617us (1807us total) trans 30064771468 rc 0/0 00000100:00100000:3.0:1788270152.481332:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 547 00000100:00100000:3.0:1788270152.485158:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.485253:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253318912 00000100:00100000:2.0:1788270152.485268:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253318912 00000100:00100000:2.0:1788270152.485341:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 548 00000100:00100000:2.0:1788270152.485352:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:43567:x1875136253318912:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788270152.485413:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.485428:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 62 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.485437:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.485472:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 62 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.485483:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 62 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.485494:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262690176:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270152.485569:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244780 going to sleep for 11 seconds 00000100:00100000:2.0:1788270152.488917:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262690176:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270152.488926:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:2.0:1788270152.488954:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.489071:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253319168 00000100:00100000:3.0:1788270152.489082:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253319168 00000100:00100000:3.0:1788270152.489195:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:3.0:1788270152.489208:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:38059:x1875136253319168:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788270152.489510:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:38059:x1875136253319168:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 305us (603us total) trans 30064771469 rc 0/0 00000100:00100000:3.0:1788270152.489519:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788270152.491141:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.491275:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253319296 00000100:00100000:2.0:1788270152.491283:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253319296 00010000:00010000:2.0:1788270152.491321:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 64 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.491382:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:2.0:1788270152.491390:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+64:2401:x1875136253319296:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.491402:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270152.491407:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 64 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.491416:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 64 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.491434:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0ad07 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102230 expref: 64 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.491445:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.491449:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.491456:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.491461:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.491482:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270152.491530:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:2401:x1875136253319296:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 141us (396us total) trans 0 rc 0/0 00010000:00010000:3.0:1788270152.491533:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.491535:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00010000:00010000:3.0:1788270152.491555:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.491608:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.493232:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.493240:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.493244:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.493248:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.493254:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.493271:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.493273:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270152.493276:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.493281:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ad38 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.493478:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:43567:x1875136253318912:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 8122us (8326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.493488:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 548 00000100:00100000:1.0:1788270152.499726:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.499934:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253319552 00000100:00100000:3.0:1788270152.499954:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253319552 00000100:00100000:3.0:1788270152.500061:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:3.0:1788270152.500073:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:43567:x1875136253319552:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270152.500294:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:43567:x1875136253319552:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 223us (578us total) trans 30064771470 rc 0/0 00000100:00100000:3.0:1788270152.500303:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:0.0:1788270152.572783:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.572875:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253319808 00000100:00100000:3.0:1788270152.572885:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253319808 00000100:00100000:3.0:1788270152.572955:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 549 00000100:00100000:3.0:1788270152.572966:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:43579:x1875136253319808:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270152.572988:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270152.573008:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610223e expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573125:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573138:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573149:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573160:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573167:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573177:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573279:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573288:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573295:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270152.573303:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:3.0:1788270152.573373:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573381:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573387:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573392:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573398:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.573402:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573409:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573427:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270152.573429:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.573433:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573438:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ad46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573452:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573459:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573464:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573470:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.573472:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573478:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573485:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff98c1429f1a00) 00010000:00010000:3.0:1788270152.573487:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.573490:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573496:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573537:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 66 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573550:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 65 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.573557:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.573559:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270152.573562:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543a00, rc 0) 00000100:00100000:3.0:1788270152.573611:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:43579:x1875136253319808:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 647us (836us total) trans 30064771471 rc 0/0 00000100:00100000:3.0:1788270152.573618:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 549 00000100:00100000:0.0:1788270152.579874:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.581804:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253319936 00000100:00100000:3.0:1788270152.581819:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253319936 00000100:00100000:3.0:1788270152.581928:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 550 00000100:00100000:3.0:1788270152.581950:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:43579:x1875136253319936:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:3.0:1788270152.582015:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582028:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582066:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582101:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582112:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582116:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582120:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.582123:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582128:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582136:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.582138:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270152.582141:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.582145:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad62 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.582218:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:43579:x1875136253319936:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 281us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.582223:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 550 00000100:00100000:1.0:1788270152.586133:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.586430:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253320192 00000100:00100000:3.0:1788270152.586439:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253320192 00000100:00100000:3.0:1788270152.586486:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:3.0:1788270152.586493:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:43579:x1875136253320192:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270152.586843:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:43579:x1875136253320192:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 350us (718us total) trans 30064771472 rc 0/0 00000100:00100000:3.0:1788270152.586849:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:1.0:1788270152.605481:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.605530:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253320448 00000100:00100000:3.0:1788270152.605539:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253320448 00000100:00100000:3.0:1788270152.605635:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 551 00000100:00100000:3.0:1788270152.605643:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:43585:x1875136253320448:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270152.605680:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270152.605700:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102245 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.605793:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.605807:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 67 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.605815:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.605859:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 67 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.605873:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 67 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.605885:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262690304:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270152.605969:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143a46b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788270152.607833:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262690304:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270152.607858:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.608879:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.609113:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253320576 00000100:00100000:3.0:1788270152.609121:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253320576 00010000:00010000:3.0:1788270152.609157:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 68 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.609196:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:3.0:1788270152.609206:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:2401:x1875136253320576:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270152.609219:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270152.609226:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 68 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.609238:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 68 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.609260:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ad54 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610223e expref: 68 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.609275:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.609279:0:45761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.609288:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.609295:0:45761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.609326:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270152.609369:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:2401:x1875136253320576:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 165us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.609377:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00010000:00010000:2.0:1788270152.610072:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.610081:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270152.610100:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:2.0:1788270152.610218:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542c00/0xc5f5d7a016e0ad69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102245 expref: 68 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.610235:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102245 expref: 67 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.610242:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.610245:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788270152.610248:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543000, rc 0) 00000100:00100000:2.0:1788270152.610293:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43585:x1875136253320448:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 4650us (4819us total) trans 30064771473 rc 0/0 00000100:00100000:2.0:1788270152.610301:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 551 00000100:00100000:1.0:1788270152.612946:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.613077:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253320832 00000100:00100000:0.0:1788270152.613086:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253320832 00000100:00100000:0.0:1788270152.613136:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 552 00000100:00100000:0.0:1788270152.613143:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43585:x1875136253320832:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270152.613163:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.613165:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788270152.613185:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543000/0xc5f5d7a016e0ad70 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102245 expref: 67 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.613200:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270152.613203:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270152.613212:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ad7e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610224c expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.613287:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ad85 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.613303:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ad85 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.613313:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ad85 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270152.613325:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:0.0:1788270152.613418:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0ad7e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610224c expref: 69 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.613432:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ad85 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610224c expref: 68 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.613440:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270152.613442:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788270152.613445:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba200, rc 0) 00000100:00100000:0.0:1788270152.613548:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43585:x1875136253320832:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 404us (610us total) trans 30064771474 rc 0/0 00000100:00100000:0.0:1788270152.613555:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 552 00000100:00100000:0.0:1788270152.617572:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.617626:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321088 00000100:00100000:2.0:1788270152.617636:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321088 00000100:00100000:2.0:1788270152.617710:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788270152.617722:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43585:x1875136253321088:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:2.0:1788270152.617739:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270152.617761:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543e00/0xc5f5d7a016e0ad2a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102237 expref: 68 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.617778:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0acdd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102222 expref: 67 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.617786:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.617790:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270152.617841:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:43585:x1875136253321088:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 122us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.617848:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788270152.620117:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.620263:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321216 00000100:00100000:3.0:1788270152.620271:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321216 00000100:00100000:3.0:1788270152.620323:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 553 00000100:00100000:3.0:1788270152.620333:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:43585:x1875136253321216:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:3.0:1788270152.620431:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.620446:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.620457:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270152.620550:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].9, 136 off9416 00000100:00100000:3.0:1788270152.620625:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:43585:x1875136253321216:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 293us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.620633:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 553 00000100:00100000:0.0:1788270152.622479:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.622547:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321344 00000100:00100000:2.0:1788270152.622555:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321344 00000100:00100000:2.0:1788270152.622605:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 554 00000100:00100000:2.0:1788270152.622615:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:43585:x1875136253321344:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270152.622631:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.622649:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102253 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.622708:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.622719:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 67 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.622737:0:45777:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.622751:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 67 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.622765:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270152.622768:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270152.622778:0:45777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 67 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.622786:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270152.622839:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43585:x1875136253321344:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 226us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.622846:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 554 00000040:00080000:1.0:1788270152.836262:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270152.836273:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270152.836303:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 10 count 5 00000040:00080000:1.0:1788270152.836314:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270152.836510:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262690432:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270152.836672:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c247fa9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.841470:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262690432:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270152.841744:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.841864:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321472 00000100:00100000:2.0:1788270152.841872:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321472 00000100:00100000:2.0:1788270152.841927:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 555 00000100:00100000:2.0:1788270152.841940:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43588:x1875136253321472:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270152.841971:0:45778:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270152.842105:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43588:x1875136253321472:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 167us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.842112:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 555 00000100:00100000:0.0:1788270152.846696:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.846786:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321600 00000100:00100000:3.0:1788270152.846796:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321600 00000100:00100000:3.0:1788270152.846906:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 556 00000100:00100000:3.0:1788270152.846918:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43588:x1875136253321600:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788270152.846985:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847006:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847017:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847031:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847068:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847077:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847100:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847108:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847115:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270152.847222:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00000004:00200000:3.0:1788270152.847227:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270152.847241:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847254:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847264:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847270:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847277:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847283:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.847287:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847295:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847307:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:3.0:1788270152.847310:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.847314:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847321:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0ada1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847335:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847342:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847348:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847354:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.847357:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847363:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847370:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x21136b04 (ffff98c1429f7d00) 00010000:00010000:3.0:1788270152.847373:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.847376:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847382:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0ada8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x21136b04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847396:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847402:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847408:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847413:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.847416:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847423:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847434:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.847437:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270152.847440:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.847446:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adaf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.847518:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43588:x1875136253321600:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 603us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270152.847525:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 556 00000100:00100000:0.0:1788270152.849705:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.849929:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321856 00000100:00100000:3.0:1788270152.849938:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321856 00000100:00100000:3.0:1788270152.850093:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 557 00000100:00100000:3.0:1788270152.850104:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:43588:x1875136253321856:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270152.850121:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270152.850200:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0adb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610225a expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850309:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850318:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850325:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270152.850333:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:3.0:1788270152.850391:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850396:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850400:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850403:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270152.850406:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850410:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850417:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270152.850419:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788270152.850422:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850426:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0adbd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850453:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0adb6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610225a expref: 69 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850459:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:3.0:1788270152.850461:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270152.850464:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0adb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610225a expref: 69 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.850472:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241542600, rc 0) 00000100:00100000:3.0:1788270152.850648:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43588:x1875136253321856:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 545us (948us total) trans 30064771475 rc 301/301 00000100:00100000:3.0:1788270152.850664:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 557 00000100:00100000:1.0:1788270152.853362:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.853442:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253321984 00000100:00100000:2.0:1788270152.853450:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253321984 00000100:00100000:2.0:1788270152.853536:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 558 00000100:00100000:2.0:1788270152.853546:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43588:x1875136253321984:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270152.853576:0:45778:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270152.853676:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43588:x1875136253321984:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.853684:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 558 00000100:00100000:0.0:1788270152.855972:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.856106:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253322240 00000100:00100000:3.0:1788270152.856113:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253322240 00000100:00100000:3.0:1788270152.856173:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 559 00000100:00100000:3.0:1788270152.856182:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43588:x1875136253322240:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270152.856198:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270152.856201:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788270152.856226:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ac9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610220d expref: 68 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.856246:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270152.856251:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270152.856264:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adcb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102261 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788270152.856584:0:45776:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xcc:0x0], index 1: 0 00010000:00010000:3.0:1788270152.856730:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0add2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.856744:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0add2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.856758:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0add2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.856812:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0adcb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102261 expref: 70 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.856827:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0add2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102261 expref: 69 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.856834:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429f7d00) 00010000:00010000:3.0:1788270152.856837:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270152.856839:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543200, rc 0) 00000100:00100000:3.0:1788270152.857147:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:43588:x1875136253322240:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 964us (1180us total) trans 30064771476 rc 0/0 00000100:00100000:3.0:1788270152.857155:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 559 00000100:00100000:0.0:1788270152.859471:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.859730:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253322368 00000100:00100000:3.0:1788270152.859739:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253322368 00000100:00100000:3.0:1788270152.859790:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 560 00000100:00100000:3.0:1788270152.859797:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:43588:x1875136253322368:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270152.859814:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270152.859828:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0ade0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102268 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.859872:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0ade7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.859881:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0ade7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.859888:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0ade7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270152.867126:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270152.867136:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270152.867171:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0ade7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.867214:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0ade0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102268 expref: 71 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.867242:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0ade7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102268 expref: 70 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.867250:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270152.867254:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270152.867257:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241542000, rc 0) 00000100:00100000:2.0:1788270152.867332:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:43588:x1875136253322368:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 7534us (7868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.867340:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 560 00000100:00100000:1.0:1788270152.875481:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.875577:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253322624 00000100:00100000:2.0:1788270152.875588:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253322624 00000100:00100000:2.0:1788270152.875648:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 561 00000100:00100000:2.0:1788270152.875667:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:43588:x1875136253322624:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.875721:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788270152.875748:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0add2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102261 expref: 70 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875770:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429f7d00) 00010000:00010000:2.0:1788270152.875786:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0ade7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102268 expref: 69 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875795:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270152.875799:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270152.875820:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875838:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875848:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875863:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875870:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875875:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875915:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875922:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875929:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875935:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ee00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.875939:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875946:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875953:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270152.875956:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.875960:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875965:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0adee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875974:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875980:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875986:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.875992:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270152.876007:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.876013:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.876020:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa78346b2 (ffff98c1429fe700) 00010000:00010000:2.0:1788270152.876023:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270152.876026:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.876032:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0adf5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa78346b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.876152:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43588:x1875136253322624:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 486us (680us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270152.876161:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 561 00000100:00100000:1.0:1788270152.880607:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.880710:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253322752 00000100:00100000:2.0:1788270152.880726:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253322752 00000100:00100000:2.0:1788270152.880796:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 562 00000100:00100000:2.0:1788270152.880807:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:43588:x1875136253322752:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.880826:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.880851:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0adfc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610226f expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.880885:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.880898:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.880909:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.881017:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0adfc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 70 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.881094:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 69 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.881103:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270152.881106:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270152.881110:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fa00, rc 0) 00000100:00100000:2.0:1788270152.881174:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:43588:x1875136253322752:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 368us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.881181:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 562 00000100:00100000:0.0:1788270152.885201:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.885313:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253323008 00000100:00100000:2.0:1788270152.885323:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253323008 00000100:00100000:2.0:1788270152.885377:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 563 00000100:00100000:2.0:1788270152.885388:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:43588:x1875136253323008:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.885465:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.885481:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.885492:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270152.885660:0:48110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].15, 88 off9392 00000004:00080000:2.0:1788270152.885671:0:48110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 944592630941ns, next at 945592628656ns, rc = 0 00000004:00010000:2.0:1788270152.885721:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093744f48 reply state 00000000363a4741 transno 30064771477 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.885734:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.885742:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270152.885744:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270152.885748:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270152.885839:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:43588:x1875136253323008:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 453us (647us total) trans 30064771477 rc 0/0 00000100:00100000:2.0:1788270152.885846:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 563 00000100:00100000:1.0:1788270152.888343:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.888475:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253323136 00000100:00100000:2.0:1788270152.888488:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253323136 00000100:00100000:2.0:1788270152.888598:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 564 00000100:00100000:2.0:1788270152.888610:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:43588:x1875136253323136:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.888640:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.888679:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102276 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.888749:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 72 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.888766:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 72 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.888788:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270152.888792:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270152.888796:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ee00, rc 0) 00000100:00100000:2.0:1788270152.888865:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:43588:x1875136253323136:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 258us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.888872:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 564 00000100:00100000:1.0:1788270152.891314:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.891418:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253323264 00000100:00100000:0.0:1788270152.891429:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253323264 00000100:00100000:0.0:1788270152.891499:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:0.0:1788270152.891510:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253323264:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788270152.891799:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253323264:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 290us (495us total) trans 30064771170 rc 0/0 00000100:00100000:0.0:1788270152.891807:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:0.0:1788270152.894393:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.894485:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253323520 00000100:00100000:3.0:1788270152.894495:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253323520 00000100:00100000:3.0:1788270152.894606:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:3.0:1788270152.894618:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:43588:x1875136253323520:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270152.894907:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:43588:x1875136253323520:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 292us (524us total) trans 30064771478 rc 0/0 00000100:00100000:3.0:1788270152.894915:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:2.0:1788270152.899172:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.899430:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253323776 00000100:00100000:0.0:1788270152.899445:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253323776 00000100:00100000:0.0:1788270152.899591:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 565 00000100:00100000:0.0:1788270152.899603:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:43588:x1875136253323776:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788270152.899761:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:43588:x1875136253323776:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 159us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270152.899770:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 565 00000100:00100000:2.0:1788270152.900282:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270152.900516:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262690560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270152.900641:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270152.900764:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262690560 00000100:00100000:1.0:1788270152.900771:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262690560 00000100:00100000:1.0:1788270152.900852:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788270152.900863:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262690560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270152.900896:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:1.0:1788270152.900960:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262690560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270152.900968:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788270152.901076:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262690560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270152.904166:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.904296:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253323904 00000100:00100000:2.0:1788270152.904309:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253323904 00000100:00100000:2.0:1788270152.904380:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 566 00000100:00100000:2.0:1788270152.904392:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:43588:x1875136253323904:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.904421:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270152.904447:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae18 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610227d expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.904649:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae1f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.904678:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.904692:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270152.904750:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270152.904773:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.904803:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae18 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610227d expref: 75 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.904827:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae1f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610227d expref: 74 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.904838:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270152.904842:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270152.904846:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ec00, rc 0) 00000100:00100000:2.0:1788270152.904926:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:43588:x1875136253323904:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 537us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.904934:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 566 00000100:00100000:2.0:1788270152.911682:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.911806:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324032 00000100:00100000:0.0:1788270152.911819:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324032 00000100:00100000:0.0:1788270152.911888:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:0.0:1788270152.911898:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2400:x1875136253324032:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270152.911919:0:47284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.911997:0:47284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102284 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270152.912150:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d649, blocks: 0x0 00010000:00010000:0.0:1788270152.912174:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=944s v=(0 0) 00010000:00010000:0.0:1788270152.912178:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270152.912189:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 15 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.912211:0:47284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 15 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.912225:0:47284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb200, rc 0) 00000100:00100000:0.0:1788270152.912340:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2400:x1875136253324032:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 443us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270152.912348:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:1.0:1788270152.916597:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.916683:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324288 00000100:00100000:2.0:1788270152.916696:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324288 00000100:00100000:2.0:1788270152.916765:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 567 00000100:00100000:2.0:1788270152.916776:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:43588:x1875136253324288:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270152.916912:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:43588:x1875136253324288:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 138us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.916919:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 567 00000100:00100000:2.0:1788270152.921734:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.921883:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324416 00000100:00100000:0.0:1788270152.921894:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324416 00000100:00100000:0.0:1788270152.921994:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:0.0:1788270152.922006:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:43588:x1875136253324416:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270152.922029:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270152.922075:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610228b expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.922123:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.922132:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270152.922137:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270152.922143:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 16 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.922181:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.922194:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 1044 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.922209:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262690688:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788270152.922316:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143932b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788270152.924203:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:48231:1875136262690688:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270152.924244:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 16 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.924266:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bae00, rc 0) 00000100:00100000:2.0:1788270152.924360:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:43588:x1875136253324416:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2356us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.924371:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:1.0:1788270152.928598:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.929957:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324544 00000100:00100000:2.0:1788270152.929973:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324544 00010000:00010000:2.0:1788270152.930125:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 1044 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.930175:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:2.0:1788270152.930184:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2400:x1875136253324544:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.930203:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270152.930231:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 1044 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.930245:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 1044 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.930271:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd1841b3/0xc5f5d7a016e0ae26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102284 expref: 16 pid: 47284 timeout: 1044 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.930290:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270152.930295:0:45762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270152.930305:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.930317:0:45762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.930390:0:45762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.930407:0:45762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15306f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262690816:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270152.931032:0:45762:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244780 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.936326:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270152.936581:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324672 00000100:00100000:0.0:1788270152.936594:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324672 00002000:00100000:0.0:1788270152.936670:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xcc:0x0] (0->23) req@ffff98c27a623100 x1875136253324672/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:568/0 lens 512/0 e 0 to 0 dl 1788270163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270152.936681:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623100 with x1875136253324672 ext(0->23) 00002000:00010000:0.0:1788270152.936689:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a623100 00000100:00100000:0.0:1788270152.936723:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:0.0:1788270152.936733:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253324672:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788270152.939158:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+18:2401:x1875136253324672:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 2412us (2832us total) trans 30064771171 rc 0/0 00000100:00100000:0.0:1788270152.939175:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00002000:00100000:0.0:1788270152.939188:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xcc:0x0] (0->23) req@ffff98c27a623100 x1875136253324672/t30064771171(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:568/0 lens 512/448 e 0 to 0 dl 1788270163 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788270152.939199:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c27a623100 with x1875136253324672 ext(0->23) 00002000:00010000:0.0:1788270152.939206:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c27a623100 00000100:00100000:2.0:1788270152.939933:0:45762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15306f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:45762:1875136262690816:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270152.939959:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270152.940061:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2400:x1875136253324544:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 9877us (11476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.940074:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:0.0:1788270152.943328:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.943883:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324800 00000100:00100000:2.0:1788270152.943895:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324800 00000100:00100000:2.0:1788270152.943967:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 568 00000100:00100000:2.0:1788270152.943979:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:43588:x1875136253324800:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788270152.946817:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771478 is committed 00000004:00080000:2.0:1788270152.946841:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:2.0:1788270152.946878:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000020:00080000:2.0:1788270152.946903:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c251244840 refcount 2 committed 0 result 0 batchid 25769803849 00000020:00080000:2.0:1788270152.946909:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c250d4e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c251244180 00000020:00080000:2.0:1788270152.946913:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c250d4ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1534f3800 00000020:00080000:2.0:1788270152.946937:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803848 batchid updated 00000100:00100000:2.0:1788270152.947130:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:43588:x1875136253324800:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 3146us (3809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.947141:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 568 00000020:00080000:3.0:1788270152.947242:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803849 committed batchid 25769803848 00000020:00080000:3.0:1788270152.947325:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803848 00000100:00100000:3.0:1788270152.947424:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270152.947457:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262690944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788270152.947527:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270152.947582:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262690944 00000100:00100000:3.0:1788270152.947590:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262690944 00000100:00100000:3.0:1788270152.947637:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788270152.947646:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262690944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788270152.947692:0:47283:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:204 count 1 00002000:00010000:3.0:1788270152.947734:0:47283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcc:0x0] initial LVB size: 24, mtime: 0x6a96d648, atime: 0x6a96d648, ctime: 0x6a96d648, blocks: 0x8 00010000:00010000:3.0:1788270152.947744:0:47283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.947763:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=944s v=(0 0) 00010000:00010000:3.0:1788270152.947768:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270152.947777:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.947794:0:47283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.947804:0:47283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.947813:0:47283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.947834:0:47283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788270152.947962:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3609:x1875136262690944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 317us (435us total) trans 30064771145 rc 0/0 00000100:00100000:3.0:1788270152.947970:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:3.0:1788270152.947991:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270152.947997:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.948006:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270152.948010:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.948021:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.948077:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.948087:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.948107:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270152.948110:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270152.948112:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788270152.948147:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27fb70700/2, rc 0, transno 30064771145 00000100:00100000:3.0:1788270152.948153:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262690944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788270152.948475:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270152.948488:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262691072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788270152.948526:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270152.948562:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262691072 00000100:00100000:1.0:1788270152.948566:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262691072 00000100:00100000:1.0:1788270152.948593:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788270152.948599:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3608:x1875136262691072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788270152.948804:0:47284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:1.0:1788270152.948808:0:47284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb mtime from disk: 0 -> 1788270153 00002000:00010000:1.0:1788270152.948811:0:47284:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788270152.948813:0:47284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb ctime from disk: 1788270153 -> 1788270153 00002000:00010000:1.0:1788270152.948815:0:47284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788270152.948845:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3608:x1875136262691072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (317us total) trans 30064771172 rc 0/0 00000100:00100000:1.0:1788270152.948850:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000004:00080000:1.0:1788270152.948878:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27a622300/2, rc 0, transno 30064771172 00000100:00100000:1.0:1788270152.948882:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262691072:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788270152.950554:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950574:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950582:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950592:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270152.950598:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950606:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950625:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff98c1429f1a00) 00010000:00010000:0.0:1788270152.950629:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270152.950634:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950641:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0ac7b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950682:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950689:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950695:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950700:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270152.950703:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950709:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950721:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:0.0:1788270152.950724:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270152.950727:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.950732:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae0a lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.953685:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.953768:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253324928 00000100:00100000:2.0:1788270152.953778:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253324928 00000100:00100000:2.0:1788270152.953838:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:2.0:1788270152.953847:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+17:2403:x1875136253324928:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788270152.959424:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771172 is committed 00000001:00080000:0.0:1788270152.959439:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771171 is committed 00000100:00100000:2.0:1788270152.959673:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2403:x1875136253324928:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 5804us (5977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270152.959689:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:0.0:1788270152.965269:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.965534:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253325184 00000100:00100000:2.0:1788270152.965545:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253325184 00000100:00100000:2.0:1788270152.965615:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 569 00000100:00100000:2.0:1788270152.965627:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:43588:x1875136253325184:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.966131:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270152.966161:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae1f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610227d expref: 46 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.966183:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270152.966188:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270152.966219:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.966233:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.966243:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270152.966357:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009339ffad reply state 000000005274b8cf transno 30064771479 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.966370:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.966377:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270152.966379:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270152.966382:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270152.967205:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:43588:x1875136253325184:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1577us (1943us total) trans 30064771479 rc 0/0 00000100:00100000:2.0:1788270152.967214:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 569 00000100:00100000:0.0:1788270152.981894:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.981986:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253325312 00000100:00100000:3.0:1788270152.982007:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253325312 00000100:00100000:3.0:1788270152.982095:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:3.0:1788270152.982106:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253325312:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788270152.982266:0:47281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb size from disk: 24 -> 24 00002000:00010000:3.0:1788270152.982270:0:47281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb mtime from disk: 1788270153 -> 1788270152 00002000:00010000:3.0:1788270152.982272:0:47281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb atime from disk: 0 -> 1788270152 00002000:00010000:3.0:1788270152.982275:0:47281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb ctime from disk: 1788270153 -> 1788270152 00002000:00010000:3.0:1788270152.982278:0:47281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xcc:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788270152.982338:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253325312:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 233us (454us total) trans 30064771173 rc 0/0 00000100:00100000:3.0:1788270152.982346:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:1.0:1788270152.990152:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.990238:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253325568 00000100:00100000:2.0:1788270152.990248:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253325568 00000100:00100000:2.0:1788270152.990306:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 570 00000100:00100000:2.0:1788270152.990316:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:43588:x1875136253325568:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788270152.990384:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.990402:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 47 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.990412:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.990446:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 47 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270152.990460:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 47 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.990475:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15306f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262691200:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270152.990546:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c251244900 going to sleep for 11 seconds 00000100:00100000:2.0:1788270152.992720:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270152.992816:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253325696 00000100:00100000:1.0:1788270152.992823:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253325696 00010000:00010000:1.0:1788270152.992856:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 48 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270152.992894:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:1.0:1788270152.992904:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253325696:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270152.992916:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270152.992922:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 48 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.992935:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 48 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.992957:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:1.0:1788270152.992962:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.992971:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.992979:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270152.993005:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270152.993081:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253325696:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 179us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270152.993088:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00010000:00010000:0.0:1788270152.993346:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0ae03 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610226f expref: 47 pid: 45776 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.993364:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15306f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262691200:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270152.993383:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993392:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993397:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993434:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993442:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993449:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993456:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270152.993460:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993466:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993476:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:0.0:1788270152.993479:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788270152.993483:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270152.993489:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae42 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270152.993544:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:43588:x1875136253325568:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 3229us (3402us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788270152.993552:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 570 00000100:00100000:2.0:1788270152.997365:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270152.997453:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253325824 00000100:00100000:3.0:1788270152.997463:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253325824 00000100:00100000:3.0:1788270152.997525:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:3.0:1788270152.997536:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2402:x1875136253325824:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788270152.997577:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.997598:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.997607:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788270152.997611:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788270152.997616:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.997661:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270152.997676:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270152.997692:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262691328:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270152.997777:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c143a469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788270152.999754:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270152.999877:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253325952 00000100:00100000:2.0:1788270152.999885:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253325952 00010000:00010000:2.0:1788270152.999917:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 16 pid: 48231 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270152.999956:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788270152.999965:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253325952:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270152.999979:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270153.000000:0:45763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 16 pid: 48231 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.000015:0:45763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 16 pid: 48231 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.000070:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270153.000075:0:45763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270153.000081:0:45763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.000091:0:45763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.000110:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270153.000149:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+16:2401:x1875136253325952:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 186us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270153.000156:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00010000:00010000:3.0:1788270153.000307:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec47e4ee/0xc5f5d7a016e0ae2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610228b expref: 15 pid: 48231 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270153.000322:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262691328:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270153.000341:0:48230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000352:0:48230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000360:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000379:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000387:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000396:0:48230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000403:0:48230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270153.000407:0:48230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000415:0:48230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000426:0:48230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.000435:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de48bf8/0xc5f5d7a016e0ae49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270153.000476:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253325824:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 2942us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270153.000484:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:0.0:1788270153.002136:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270153.002252:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253326208 00000100:00100000:2.0:1788270153.002259:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253326208 00000100:00100000:2.0:1788270153.002308:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 571 00000100:00100000:2.0:1788270153.002318:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:43588:x1875136253326208:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788270153.002388:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002405:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002415:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002560:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002571:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 47 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002579:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002607:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 47 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.002621:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 47 pid: 45778 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270153.002635:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15306f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262691456:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270153.002804:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c142b740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270153.004323:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15306f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262691456:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270153.004345:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270153.004770:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270153.004839:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253326336 00000100:00100000:2.0:1788270153.004845:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253326336 00010000:00010000:2.0:1788270153.004874:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 48 pid: 45778 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270153.004911:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788270153.004920:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253326336:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270153.004933:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270153.004939:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 48 pid: 45778 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.004951:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 48 pid: 45778 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.004970:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae11 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102276 expref: 48 pid: 45778 timeout: 1044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.004987:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:2.0:1788270153.004994:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.005001:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.005008:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.005062:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270153.005222:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.005230:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270153.005310:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771480 00000001:00080000:3.0:1788270153.005399:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771481 00000001:00080000:3.0:1788270153.005425:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771482 00000100:00100000:3.0:1788270153.005484:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262691584:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270153.005522:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270153.005551:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c242b4f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788270153.005588:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2400:x1875136253326336:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 669us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270153.005596:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788270153.005659:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262691584 00000100:00100000:1.0:1788270153.005664:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262691584 00000100:00100000:1.0:1788270153.005695:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788270153.005702:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262691584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270153.005769:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262691584:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270153.005775:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788270153.005850:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771172 gen 2 00000004:00080000:3.0:1788270153.005855:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c248219c00, transno 30064771168 00000004:00080000:3.0:1788270153.005867:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27c309180, transno 30064771169 00000004:00080000:3.0:1788270153.005870:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27a622300, transno 30064771172 00000100:00100000:3.0:1788270153.005875:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262691584:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788270153.005962:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771483 00000100:00100000:3.0:1788270153.005996:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262691712:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788270153.006018:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270153.006063:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14343bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788270153.006113:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262691712 00000100:00100000:2.0:1788270153.006117:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262691712 00000100:00100000:2.0:1788270153.006144:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788270153.006150:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262691712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270153.006229:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262691712:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (210us total) trans 30064771174 rc 0/0 00000100:00100000:2.0:1788270153.006235:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788270153.006433:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262691712:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788270153.006473:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771484 00010000:00010000:3.0:1788270153.006491:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006500:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006507:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006513:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270153.006517:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006524:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006536:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:3.0:1788270153.006538:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270153.006542:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006548:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae57 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006568:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006575:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006585:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006590:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270153.006593:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006598:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006605:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270153.006607:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788270153.006611:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006620:0:45776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006628:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.006647:0:45776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 51 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270153.006675:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262691840:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788270153.006714:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14343b000 going to sleep for 11 seconds 00000004:00080000:1.0:1788270153.006977:0:45802:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1788270153.009870:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270153.009940:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253326464 00000100:00100000:2.0:1788270153.009949:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253326464 00000100:00100000:2.0:1788270153.010008:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:2.0:1788270153.010017:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:43585:x1875136253326464:12345-192.168.201.42@tcp:49:lfs.0 00000100:00100000:2.0:1788270153.010158:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:43585:x1875136253326464:12345-192.168.201.42@tcp:49:lfs.0 Request processed in 141us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270153.010166:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:3.0:1788270153.010876:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262691840:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788270153.010906:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.010916:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0ad93 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.010947:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011106:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011121:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011132:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011138:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011145:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011151:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270153.011190:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011197:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011209:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270153.011213:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270153.011217:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011222:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0ae5e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011232:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011239:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011244:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011249:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270153.011252:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011257:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011265:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:3.0:1788270153.011268:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788270153.011270:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270153.011276:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae50 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270153.011500:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:43588:x1875136253326208:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 9181us (9368us total) trans 30064771485 rc 0/0 00000100:00100000:2.0:1788270153.011509:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 571 00000020:00080000:2.0:1788270153.011514:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1788270153.012391:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270153.012398:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270153.013128:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 5 00000040:00080000:1.0:1788270153.013139:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270153.014003:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270153.014388:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253326592 00000100:00100000:2.0:1788270153.014398:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253326592 00000100:00100000:2.0:1788270153.014478:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:2.0:1788270153.014488:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:43585:x1875136253326592:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270153.014506:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270153.014528:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102292 expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270153.014554:0:48231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcc:0x0] initial LVB size: 24, mtime: 0x6a96d648, atime: 0x6a96d648, ctime: 0x6a96d648, blocks: 0x8 00010000:00010000:2.0:1788270153.014580:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=944s v=(0 0) 00010000:00010000:2.0:1788270153.014585:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270153.014595:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.014611:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 15 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270153.014624:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418e400, rc 0) 00000100:00100000:2.0:1788270153.015284:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:43585:x1875136253326592:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 796us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270153.015291:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788270153.015468:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270153.016218:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253326848 00000100:00100000:1.0:1788270153.016225:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253326848 00000100:00100000:1.0:1788270153.016305:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788270153.016315:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:43588:x1875136253326848:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788270153.016585:0:45780:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x2c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788270153.016619:0:45780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771486 00010000:00010000:1.0:1788270153.016812:0:45780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270153.016829:0:45780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270153.016841:0:45780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270153.016849:0:45780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270153.016855:0:45780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270153.016862:0:45780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270153.016886:0:45780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270153.016962:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:43588:x1875136253326848:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 648us (1492us total) trans 30064771487 rc 0/0 00000100:00100000:1.0:1788270153.016970:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00000020:00080000:1.0:1788270153.016974:0:45780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788270153.018454:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788270153.018465:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270153.018474:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:0.0:1788270153.018480:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270153.018488:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270153.018504:0:45765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:0.0:1788270153.018507:0:45765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788270153.018511:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270153.018517:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0ae6c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 45780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270153.018530:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270153.018532:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270153.018534:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270153.018891:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270153.018954:0:49680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253326976 00000100:00100000:3.0:1788270153.018963:0:49680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253326976 00002000:00100000:3.0:1788270153.019015:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xcc:0x0] (0->4095) req@ffff98c1534aa680 x1875136253326976/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:569/0 lens 488/0 e 0 to 0 dl 1788270164 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270153.019024:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1534aa680 with x1875136253326976 ext(0->4095) 00002000:00010000:3.0:1788270153.019028:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1534aa680 00000100:00100000:3.0:1788270153.019082:0:49680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:3.0:1788270153.019091:0:49680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253326976:12345-192.168.201.42@tcp:3:lfs.0 00000100:00100000:3.0:1788270153.019229:0:49680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253326976:12345-192.168.201.42@tcp:3:lfs.0 Request processed in 139us (340us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788270153.019237:0:49680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00002000:00100000:3.0:1788270153.019243:0:49680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xcc:0x0] (0->4095) req@ffff98c1534aa680 x1875136253326976/t0(0) o3->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:569/0 lens 488/4536 e 0 to 0 dl 1788270164 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788270153.019252:0:49680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1534aa680 with x1875136253326976 ext(0->4095) 00002000:00010000:3.0:1788270153.019255:0:49680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c1534aa680 00010000:00010000:0.0:1788270153.156969:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270154.180256:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270154.948344:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262691968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270154.948417:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270154.948588:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262691968 00000100:00100000:2.0:1788270154.948596:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262691968 00000100:00100000:2.0:1788270154.948658:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788270154.948677:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262691968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270154.948719:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270154.948774:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262691968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270154.948782:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788270154.948852:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262691968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270155.204231:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270155.266020:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270155.266127:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270155.266166:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270155.266200:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270155.266223:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327232 00000100:00100000:1.0:1788270155.266230:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270155.266233:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327232 00000100:00100000:1.0:1788270155.266257:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270155.266288:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270155.266358:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327744 00000100:00100000:3.0:1788270155.266363:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327744 00000100:00100000:1.0:1788270155.266383:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327104 00000100:00100000:3.0:1788270155.266386:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327360 00000100:00100000:1.0:1788270155.266390:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327104 00000100:00100000:3.0:1788270155.266391:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327360 00000100:00100000:3.0:1788270155.266411:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327872 00000100:00100000:3.0:1788270155.266413:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327872 00000100:00100000:3.0:1788270155.266435:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 205 00000100:00100000:1.0:1788270155.266441:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:3.0:1788270155.266446:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:2402:x1875136253327232:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270155.266458:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253327104:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270155.266520:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:2402:x1875136253327232:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270155.266528:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 205 00000100:00100000:0.0:1788270155.266550:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327488 00000100:00100000:0.0:1788270155.266556:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327488 00000100:00100000:0.0:1788270155.266590:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253327616 00000100:00100000:0.0:1788270155.266593:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253327616 00000100:00100000:0.0:1788270155.266629:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:0.0:1788270155.266638:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253327488:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270155.267246:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:3.0:1788270155.267257:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253327744:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270155.268182:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:2.0:1788270155.268196:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253327360:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270155.268321:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2402:x1875136253327488:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1682us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270155.268331:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:3.0:1788270155.268337:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253327744:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1079us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270155.268347:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:0.0:1788270155.268353:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:0.0:1788270155.268365:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2402:x1875136253327616:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270155.268372:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:3.0:1788270155.268383:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253327872:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270155.268402:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2402:x1875136253327616:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 38us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270155.268410:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:3.0:1788270155.268418:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253327872:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270155.268426:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00080000:3.0:1788270155.268448:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270155.268452:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270155.268455:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270155.268458:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270155.268881:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253327104:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2427us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270155.268891:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:2.0:1788270155.271701:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253327360:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3492us (5454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.271718:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:2.0:1788270155.460271:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270155.460295:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262692096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270155.460365:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270155.460485:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692096 00000100:00100000:0.0:1788270155.460493:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692096 00000100:00100000:0.0:1788270155.460554:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788270155.460564:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3610:x1875136262692096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270155.460591:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175394496 pending 28672 free 3839610880 avail 3608088576 00000100:00080000:2.0:1788270155.460707:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270155.460962:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270155.460972:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15306d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262692224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270155.461171:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262692352:0@lo:400:kworker.0 00000100:00100000:3.0:1788270155.461239:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262692736:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462083:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462125:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262692608:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462152:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462170:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262693120:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462192:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462213:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262693632:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462236:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462268:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692608 00000100:00100000:2.0:1788270155.462273:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692608 00000100:00100000:2.0:1788270155.462314:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693120 00000100:00100000:2.0:1788270155.462317:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693120 00000100:00100000:2.0:1788270155.462338:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788270155.462346:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262692608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462391:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262692608:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.462398:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788270155.462415:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788270155.462421:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262693120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462448:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262693120:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.462457:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788270155.462475:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270155.462501:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262692608:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462511:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262693120:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462535:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693632 00000100:00100000:2.0:1788270155.462538:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693632 00000100:00100000:2.0:1788270155.462567:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788270155.462573:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262693632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462621:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262693632:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.462628:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1788270155.462645:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270155.462660:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262693632:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462703:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262692480:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462798:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462825:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262692992:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462847:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462865:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262693504:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.462885:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462902:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270155.462908:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262693888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270155.462956:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.462991:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692480 00000100:00100000:2.0:1788270155.462995:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692480 00000100:00100000:2.0:1788270155.463029:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788270155.463037:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262692480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.463100:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262692480:12345-0@lo:400:kworker.0 Request processed in 64us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.463106:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788270155.463123:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692992 00000100:00100000:2.0:1788270155.463127:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692992 00000100:00100000:2.0:1788270155.463155:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788270155.463161:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262692992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.463190:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262692992:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.463196:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788270155.463210:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270155.463230:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262692480:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.463241:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262692992:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.463269:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693504 00000100:00100000:2.0:1788270155.463273:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693504 00000100:00100000:2.0:1788270155.463302:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788270155.463308:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262693504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.463344:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262693504:12345-0@lo:400:kworker.0 Request processed in 36us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.463350:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1788270155.463364:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270155.463380:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262693504:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.463404:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692224 00000100:00100000:2.0:1788270155.463407:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692224 00000100:00100000:2.0:1788270155.463423:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693888 00000100:00100000:2.0:1788270155.463426:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693888 00000100:00100000:2.0:1788270155.463438:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788270155.463445:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262692224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270155.463466:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:2.0:1788270155.463502:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262692224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.463508:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788270155.463520:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788270155.463526:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262693888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270155.463536:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:2.0:1788270155.463563:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262693888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.463569:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788270155.463599:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15306d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262692224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270155.463641:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262693888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270155.463783:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3610:x1875136262692096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3219us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270155.463791:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788270155.466759:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270155.466824:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262692864:0@lo:400:kworker.0 00000100:00100000:0.0:1788270155.466839:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692352 00000100:00100000:0.0:1788270155.466846:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692352 00000100:00100000:1.0:1788270155.466858:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270155.466886:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262693376:0@lo:400:kworker.0 00000100:00100000:0.0:1788270155.466899:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788270155.466910:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262692352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.466912:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692864 00000100:00100000:1.0:1788270155.466914:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270155.466918:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692864 00000100:00100000:2.0:1788270155.466952:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788270155.466960:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262692864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270155.466961:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693376 00000100:00100000:1.0:1788270155.466969:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693376 00000100:00100000:0.0:1788270155.466978:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262692352:12345-0@lo:400:kworker.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270155.466985:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788270155.466990:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262692352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270155.467013:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262692864:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.467017:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262692864:12345-0@lo:400:kworker.0 Request processed in 56us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.467026:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1788270155.467070:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270155.467103:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788270155.467110:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262693376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270155.467138:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270155.467150:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262693376:12345-0@lo:400:kworker.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270155.467156:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788270155.467166:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262693248:0@lo:400:kworker.0 00000100:00100000:0.0:1788270155.467168:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262692736 00000100:00100000:0.0:1788270155.467172:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262692736 00000100:00100000:0.0:1788270155.467193:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788270155.467194:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270155.467200:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262693376:0@lo:400:kworker.0 00000100:00100000:0.0:1788270155.467202:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262692736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.467217:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693248 00000100:00100000:3.0:1788270155.467219:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262693760:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.467224:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693248 00000100:00100000:3.0:1788270155.467260:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270155.467260:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262692736:12345-0@lo:400:kworker.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.467267:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788270155.467275:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788270155.467278:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262693760 00000100:00100000:2.0:1788270155.467281:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262693248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270155.467284:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262693760 00000100:00100000:3.0:1788270155.467303:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262692096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788270155.467307:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270155.467323:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262693248:12345-0@lo:400:kworker.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270155.467330:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788270155.467333:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262692736:0@lo:400:kworker.0 00000100:00100000:2.0:1788270155.467337:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788270155.467340:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262693760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270155.467359:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262693248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270155.467381:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262693760:12345-0@lo:400:kworker.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270155.467386:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262693760:0@lo:400:kworker.0 00000100:00100000:1.0:1788270155.467391:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788270155.624869:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270155.624970:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253328000 00000100:00100000:2.0:1788270155.624980:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253328000 00000100:00100000:2.0:1788270155.625119:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 572 00000100:00100000:2.0:1788270155.625130:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:43590:x1875136253328000:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270155.625148:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270155.625168:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102299 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.625227:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ae7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.625240:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ae7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.625252:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ae7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270155.625304:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270155.625309:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270155.625329:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ae7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.625353:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0ae73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102299 expref: 55 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.625371:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ae7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102299 expref: 54 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.625380:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270155.625383:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270155.625387:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f000, rc 0) 00000100:00100000:2.0:1788270155.625447:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:43590:x1875136253328000:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 320us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.625454:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 572 00000100:00100000:1.0:1788270155.627895:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270155.627954:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253328128 00000100:00100000:2.0:1788270155.627962:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253328128 00000100:00100000:2.0:1788270155.628015:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 573 00000100:00100000:2.0:1788270155.628027:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:43590:x1875136253328128:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270155.628660:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270155.628680:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ae81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022a0 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.628871:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.628895:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.628906:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.628920:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.628927:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.628937:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629015:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629025:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629032:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270155.629099:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00000004:00200000:2.0:1788270155.629104:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270155.629121:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629130:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629138:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629144:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629150:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629155:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629165:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270155.629169:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629176:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629187:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270155.629190:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270155.629194:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629200:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0ae88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629212:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629217:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629222:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629226:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270155.629229:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629234:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629254:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff98c1429fe200) 00010000:00010000:2.0:1788270155.629257:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270155.629260:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629266:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0ae8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629296:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0ae81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 56 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629308:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 55 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270155.629316:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270155.629319:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270155.629322:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ec00, rc 0) 00000100:00100000:2.0:1788270155.629380:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:43590:x1875136253328128:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1356us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270155.629388:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 573 00000040:00080000:2.0:1788270156.080285:0:51283:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270156.080294:0:51283:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270156.080330:0:51283:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 10 count 5 00000040:00080000:2.0:1788270156.080337:0:51283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270156.105257:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270156.105629:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253328384 00000100:00100000:1.0:1788270156.105640:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253328384 00000100:00100000:1.0:1788270156.105693:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 574 00000100:00100000:1.0:1788270156.105702:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:43601:x1875136253328384:12345-192.168.201.42@tcp:58:lfs.0 00000040:00080000:1.0:1788270156.106016:0:45776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].10, 136 off9552 00000100:00100000:1.0:1788270156.106122:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:43601:x1875136253328384:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 419us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270156.106131:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 574 00010000:00010000:0.0:1788270156.228460:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270157.124239:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270157.124249:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270157.124276:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 11 count 6 00000040:00080000:1.0:1788270157.124286:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270157.124863:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262694016:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270157.125012:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b53c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270157.135817:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270157.135915:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253328512 00000100:00100000:2.0:1788270157.135934:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253328512 00000100:00100000:2.0:1788270157.136013:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 575 00000100:00100000:2.0:1788270157.136024:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:43602:x1875136253328512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270157.136099:0:48110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270157.136197:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:43602:x1875136253328512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 175us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270157.136204:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 575 00000100:00080000:0.0:1788270157.137196:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270157.138775:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262694016:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270157.139736:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270157.139962:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253328768 00000100:00100000:2.0:1788270157.139970:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253328768 00000100:00100000:2.0:1788270157.140027:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 576 00000100:00100000:2.0:1788270157.140058:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:43602:x1875136253328768:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270157.140077:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270157.140098:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022a7 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140191:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140201:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140211:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270157.140218:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 24 00010000:00010000:2.0:1788270157.140267:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140275:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140282:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140288:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270157.140292:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140300:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140311:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:2.0:1788270157.140314:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788270157.140318:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140323:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0aea4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140364:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae9d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a7 expref: 57 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140374:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270157.140376:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270157.140379:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0ae9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a7 expref: 57 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270157.140387:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f600, rc 0) 00000100:00100000:2.0:1788270157.140592:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:43602:x1875136253328768:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 544us (846us total) trans 30064771488 rc 301/301 00000100:00100000:2.0:1788270157.140600:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 576 00000100:00100000:2.0:1788270157.145251:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270157.146095:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329024 00000100:00100000:1.0:1788270157.146106:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329024 00000100:00100000:1.0:1788270157.146277:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 577 00000100:00100000:1.0:1788270157.146289:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:43602:x1875136253329024:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788270157.146364:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146383:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146394:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146557:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146565:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146572:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146591:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270157.146596:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146602:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146611:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:1.0:1788270157.146614:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788270157.146616:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270157.146621:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168200/0xc5f5d7a016e0aeb2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270157.146730:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:43602:x1875136253329024:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 444us (1488us total) trans 30064771489 rc 0/0 00000100:00100000:1.0:1788270157.146736:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 577 00000040:00080000:3.0:1788270157.146838:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270157.146842:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270157.147213:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 6 00000040:00080000:3.0:1788270157.147219:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270157.149644:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270157.149705:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329280 00000100:00100000:2.0:1788270157.149714:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329280 00000100:00100000:2.0:1788270157.149762:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:2.0:1788270157.149772:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276990050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:43602:x1875136253329280:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788270157.149967:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276990050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:43602:x1875136253329280:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 197us (330us total) trans 30064771490 rc 0/0 00000100:00100000:2.0:1788270157.149976:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00010000:00010000:3.0:1788270157.252381:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270157.508356:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270157.508379:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262694144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270157.508443:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270157.509725:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694144 00000100:00100000:3.0:1788270157.509736:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694144 00000100:00100000:3.0:1788270157.509894:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788270157.509906:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262694144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270157.509937:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175394496 pending 28672 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270157.510005:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262694144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270157.510013:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788270157.510087:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262694144:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270157.510154:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270158.024692:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270158.024717:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262694272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270158.024829:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270158.025074:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694272 00000100:00100000:3.0:1788270158.025082:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694272 00000100:00100000:3.0:1788270158.025131:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788270158.025140:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262694272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270158.025170:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:3.0:1788270158.025222:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262694272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270158.025232:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788270158.025314:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262694272:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788270158.025514:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771174 is committed 00000001:00080000:0.0:1788270158.025523:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771173 is committed 00000001:00080000:2.0:1788270158.025604:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771490 is committed 00000020:00080000:2.0:1788270158.025627:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c242b4f180 refcount 2 committed 0 result 0 batchid 25769803850 00000020:00080000:2.0:1788270158.025631:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c27a1c2400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c242b4f480 00000020:00080000:2.0:1788270158.025634:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c27a1c2700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c14d91b000 00000020:00080000:2.0:1788270158.025652:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803849 batchid updated 00010000:00010000:0.0:1788270158.025700:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270158.025711:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270158.025719:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270158.025725:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270158.025729:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270158.025737:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270158.025755:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff98c1429fed00) 00010000:00010000:0.0:1788270158.025758:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270158.025763:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270158.025769:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0ae3b lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788270158.025830:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803850 committed batchid 25769803849 00000020:00080000:3.0:1788270158.025880:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803849 00000001:00080000:1.0:1788270158.029909:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771145 is committed 00000001:00080000:1.0:1788270158.029925:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771143 is committed 00010000:00010000:0.0:1788270158.276606:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270158.532333:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270158.532340:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270158.532358:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 2 count 2 00000040:00080000:2.0:1788270158.532368:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788270159.172313:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270159.172323:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270159.172412:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 11 count 4 00000040:00080000:3.0:1788270159.172419:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270159.302748:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270160.068183:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270160.068334:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262694400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270160.068393:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270160.068597:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694400 00000100:00100000:1.0:1788270160.068604:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694400 00000100:00100000:1.0:1788270160.068708:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788270160.068716:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262694400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270160.068744:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270160.068802:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262694400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270160.068810:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788270160.068874:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262694400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270160.324364:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270160.386100:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270160.386144:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270160.386398:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329408 00000100:00100000:1.0:1788270160.386408:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329408 00000100:00100000:1.0:1788270160.386470:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:1.0:1788270160.386481:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253329408:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270160.386604:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253329408:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 124us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270160.386613:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:3.0:1788270160.387645:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329536 00000100:00100000:3.0:1788270160.387652:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329536 00000100:00100000:3.0:1788270160.387755:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00100000:3.0:1788270160.387765:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2402:x1875136253329536:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270160.387826:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2402:x1875136253329536:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 62us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270160.387834:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00080000:0.0:1788270160.388597:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270160.389911:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270160.389980:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270160.390011:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270160.390063:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270160.390107:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329792 00000100:00100000:3.0:1788270160.390114:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329792 00000100:00100000:3.0:1788270160.390152:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329920 00000100:00100000:3.0:1788270160.390154:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329920 00000100:00100000:3.0:1788270160.390168:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:3.0:1788270160.390174:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253329792:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270160.390224:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253329792:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270160.390229:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:3.0:1788270160.390238:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:3.0:1788270160.390242:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253329920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270160.390257:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2402:x1875136253329920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 15us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270160.390262:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00080000:3.0:1788270160.390444:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270160.390447:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270160.391271:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270160.391336:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253329664 00000100:00100000:2.0:1788270160.391342:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253329664 00000100:00100000:2.0:1788270160.391430:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330048 00000100:00100000:2.0:1788270160.391434:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330048 00000100:00100000:0.0:1788270160.391554:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330176 00000100:00100000:0.0:1788270160.391559:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330176 00000100:00080000:1.0:1788270160.391637:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270160.391641:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270160.391663:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:1.0:1788270160.391675:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253329664:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270160.391723:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253329664:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270160.391731:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:2.0:1788270160.391985:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:2.0:1788270160.391994:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253330048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270160.392058:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253330048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 65us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.392065:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:0.0:1788270160.392452:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:0.0:1788270160.392459:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253330176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270160.392492:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253330176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270160.392498:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:2.0:1788270160.580876:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15306f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262694528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270160.580945:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270160.581166:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262694656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270160.581198:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270160.581234:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694528 00000100:00100000:0.0:1788270160.581241:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694528 00000100:00100000:0.0:1788270160.581292:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694656 00000100:00100000:0.0:1788270160.581295:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694656 00000100:00100000:0.0:1788270160.581312:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788270160.581320:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262694528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270160.581348:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:0.0:1788270160.581397:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262694528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270160.581404:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788270160.581421:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788270160.581427:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262694656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270160.581441:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270160.581470:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262694656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270160.581477:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788270160.581507:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771145 gen 2 00000004:00080000:0.0:1788270160.581543:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27a61a680, transno 30064771142 00000004:00080000:0.0:1788270160.581555:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771144 committed transno 30064771145 00000004:00080000:0.0:1788270160.581571:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27fb70700, transno 30064771145 00000100:00100000:0.0:1788270160.581583:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262694656:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788270160.581699:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270160.581703:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270160.582095:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270160.582106:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262694784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270160.582137:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270160.582169:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694784 00000100:00100000:1.0:1788270160.582173:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694784 00000100:00100000:1.0:1788270160.582204:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788270160.582210:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262694784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270160.582220:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:1.0:1788270160.582251:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262694784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270160.582257:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788270160.582281:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771174 gen 2 00000004:00080000:1.0:1788270160.582285:0:3610:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771174 committed transno 30064771174 00000100:00100000:1.0:1788270160.582301:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262694784:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788270160.582314:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270160.582675:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15306f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262694528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270160.582967:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788270160.582992:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.583148:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262695296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583170:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.583192:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695296 00000100:00100000:2.0:1788270160.583195:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695296 00000100:00100000:2.0:1788270160.583218:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788270160.583223:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262695296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583249:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262695296:12345-0@lo:400:kworker.0 Request processed in 26us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.583253:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788270160.583272:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262695296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583282:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262695040:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583296:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.583306:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270160.583309:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262695168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583322:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.583339:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695168 00000100:00100000:2.0:1788270160.583341:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695168 00000100:00100000:2.0:1788270160.583359:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788270160.583363:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262695168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583406:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262695168:12345-0@lo:400:kworker.0 Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.583412:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788270160.583438:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262695168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583471:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695040 00000100:00100000:2.0:1788270160.583475:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695040 00000100:00100000:2.0:1788270160.583496:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788270160.583501:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262695040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583547:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262695040:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.583553:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788270160.583576:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262694912 00000100:00100000:2.0:1788270160.583578:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262695040:0@lo:400:kworker.0 00000100:00100000:0.0:1788270160.583580:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262694912 00000100:00100000:0.0:1788270160.583624:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788270160.583640:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262694912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583786:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270160.583917:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262695808:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583942:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.583962:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262695424:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.583982:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.584010:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695424 00000100:00100000:2.0:1788270160.584014:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695424 00000100:00100000:2.0:1788270160.584065:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788270160.584072:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262695424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584106:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262695424:12345-0@lo:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.584112:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788270160.584128:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262695680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584152:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.584177:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270160.584183:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262695552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584204:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270160.584230:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695808 00000100:00100000:2.0:1788270160.584234:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695808 00000100:00100000:2.0:1788270160.584254:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695680 00000100:00100000:2.0:1788270160.584257:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695680 00000100:00100000:2.0:1788270160.584271:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695552 00000100:00100000:2.0:1788270160.584274:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695552 00000100:00100000:2.0:1788270160.584288:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788270160.584294:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262695808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584326:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262695808:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.584332:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788270160.584344:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788270160.584351:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262695680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584381:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262695680:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.584387:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788270160.584397:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788270160.584403:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262695552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584430:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262695552:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270160.584435:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788270160.584462:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262695808:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584473:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262695424:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584497:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262695552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.584504:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262695680:0@lo:400:kworker.0 00000100:00080000:2.0:1788270160.584533:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270160.584537:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270160.584540:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270160.584815:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270160.584925:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270160.584935:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262696064:0@lo:400:kworker.0 00000100:00100000:3.0:1788270160.584964:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270160.584990:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696064 00000100:00100000:3.0:1788270160.584994:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696064 00000100:00100000:3.0:1788270160.585024:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788270160.585032:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262696064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270160.585084:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262696064:12345-0@lo:400:kworker.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270160.585090:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788270160.585120:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262696064:0@lo:400:kworker.0 00000100:00080000:3.0:1788270160.585146:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270160.585202:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262695936:0@lo:400:kworker.0 00000100:00100000:2.0:1788270160.585229:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270160.585325:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262695936 00000100:00100000:3.0:1788270160.585330:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262695936 00000100:00100000:3.0:1788270160.585403:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788270160.585410:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262695936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270160.585443:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262695936:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270160.585449:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788270160.585489:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262695936:0@lo:400:kworker.0 00000100:00080000:2.0:1788270160.585535:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270160.586796:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262694912:12345-0@lo:400:kworker.0 Request processed in 3160us (3797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270160.586807:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788270160.587742:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262694912:0@lo:400:kworker.0 00010000:00010000:0.0:1788270161.348341:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270162.373906:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270162.628947:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270162.628985:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262696192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270162.629124:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270162.629233:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696192 00000100:00100000:0.0:1788270162.629244:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696192 00000100:00100000:0.0:1788270162.629330:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788270162.629343:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15306f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262696192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270162.629383:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00080000:2.0:1788270162.629526:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270162.629528:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15306f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262696192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270162.629539:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788270162.629796:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262696192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270163.141278:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262696320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270163.141390:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270163.141543:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696320 00000100:00100000:0.0:1788270163.141564:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696320 00000100:00100000:0.0:1788270163.141644:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788270163.141655:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262696320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270163.141693:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:0.0:1788270163.141782:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262696320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270163.141791:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788270163.141839:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262696320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270163.396770:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788270164.176072:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803850 batchid updated 00000020:00080000:3.0:1788270164.176171:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803850 00000020:00080000:3.0:1788270164.176185:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803850 00010000:00010000:0.0:1788270164.420887:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270165.188475:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262696448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270165.188579:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270165.189329:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696448 00000100:00100000:2.0:1788270165.189340:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696448 00000100:00100000:2.0:1788270165.189412:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788270165.189423:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262696448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270165.189475:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270165.189545:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262696448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270165.189558:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788270165.189597:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262696448:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270165.444522:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270165.506913:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270165.507072:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270165.507109:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270165.507140:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270165.507204:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330304 00000100:00100000:0.0:1788270165.507217:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330304 00000100:00100000:0.0:1788270165.507282:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:0.0:1788270165.507294:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253330304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270165.507314:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330688 00000100:00100000:1.0:1788270165.507320:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330688 00000100:00100000:1.0:1788270165.507377:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:0.0:1788270165.507385:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253330304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.507391:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253330688:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270165.507398:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:1.0:1788270165.507460:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253330688:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.507469:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00080000:0.0:1788270165.507476:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270165.508728:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270165.508796:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330432 00000100:00100000:2.0:1788270165.508804:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330432 00000100:00100000:2.0:1788270165.508864:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330944 00000100:00100000:2.0:1788270165.508868:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330944 00000100:00100000:2.0:1788270165.508895:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:2.0:1788270165.508904:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2400:x1875136253330432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270165.508964:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2400:x1875136253330432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 62us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270165.508973:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:2.0:1788270165.508991:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:2.0:1788270165.508998:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253330944:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270165.509023:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253330944:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270165.509029:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00080000:1.0:1788270165.509171:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270165.509316:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270165.509411:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330560 00000100:00100000:2.0:1788270165.509416:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330560 00000100:00100000:1.0:1788270165.509459:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00080000:1.0:1788270165.509487:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270165.509515:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331072 00000100:00100000:0.0:1788270165.509520:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331072 00000100:00100000:0.0:1788270165.509567:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 227 00000100:00100000:0.0:1788270165.509575:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253330560:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270165.509613:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253330560:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.509621:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 227 00000100:00100000:0.0:1788270165.509635:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:0.0:1788270165.509641:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253331072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270165.509664:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253331072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.509670:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00080000:1.0:1788270165.509838:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270165.510583:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253330816 00000100:00100000:3.0:1788270165.510592:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253330816 00000100:00080000:1.0:1788270165.510640:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270165.510652:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:3.0:1788270165.510662:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253330816:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270165.510717:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253330816:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 57us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270165.510724:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:3.0:1788270165.700278:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262696576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270165.700363:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.700466:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262696960:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.700505:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.700548:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270165.700555:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262696832:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.700588:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.700630:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696960 00000100:00100000:1.0:1788270165.700639:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696960 00000100:00100000:1.0:1788270165.700698:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788270165.700709:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262696960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.700773:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262696960:12345-0@lo:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.700781:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788270165.700829:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262696960:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.700868:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262696704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270165.700897:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.700919:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270165.700926:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262697088:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.700947:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.700993:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697088 00000100:00100000:1.0:1788270165.700997:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697088 00000100:00100000:1.0:1788270165.701067:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788270165.701076:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262697088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.701114:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262697088:12345-0@lo:400:kworker.0 Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.701121:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788270165.701138:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270165.701162:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262697088:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.701187:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696832 00000100:00100000:1.0:1788270165.701190:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696832 00000100:00100000:1.0:1788270165.701217:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788270165.701223:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262696832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.701258:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262696832:12345-0@lo:400:kworker.0 Request processed in 35us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.701264:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788270165.701297:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262696832:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.701331:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696576 00000100:00100000:1.0:1788270165.701335:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696576 00000100:00100000:1.0:1788270165.701362:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262696704 00000100:00100000:1.0:1788270165.701364:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262696704 00000100:00100000:1.0:1788270165.701375:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788270165.701381:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262696576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270165.701407:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00080000:0.0:1788270165.703109:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270165.703141:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788270165.703159:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262696704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270165.703189:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270165.703260:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262696704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.703265:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788270165.703316:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262696704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270165.703401:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262697216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270165.703448:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270165.703710:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697216 00000100:00100000:0.0:1788270165.703715:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697216 00000100:00100000:0.0:1788270165.703972:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788270165.703980:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262697216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270165.703992:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:0.0:1788270165.704155:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262697216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.704162:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1788270165.704178:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270165.704193:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262697216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270165.709678:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262696576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8284us (9303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.709692:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788270165.709758:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262696576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270165.716186:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262697344:0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.716277:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270165.716403:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697344 00000100:00100000:3.0:1788270165.716411:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697344 00000100:00100000:3.0:1788270165.716494:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788270165.716504:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262697344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.716705:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262697344:12345-0@lo:400:kworker.0 Request processed in 202us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270165.716714:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788270165.716749:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262697472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.716780:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.716858:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697472 00000100:00100000:1.0:1788270165.716863:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697472 00000100:00100000:1.0:1788270165.716904:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788270165.716912:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262697472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.716951:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262697472:12345-0@lo:400:kworker.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.716957:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788270165.717076:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262697472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.717293:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262697600:0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.717323:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.717382:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697600 00000100:00100000:1.0:1788270165.717387:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697600 00000100:00100000:1.0:1788270165.717442:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788270165.717451:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262697600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.717527:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262697344:0@lo:400:kworker.0 00000100:00080000:0.0:1788270165.717556:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270165.717666:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262697728:0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.717697:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270165.717738:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697728 00000100:00100000:0.0:1788270165.717742:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697728 00000100:00100000:0.0:1788270165.717767:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788270165.717773:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262697728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.717807:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262697728:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.717813:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788270165.717838:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.717945:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262697600:12345-0@lo:400:kworker.0 Request processed in 496us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.717952:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788270165.718054:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270165.718225:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270165.718234:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262697984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.718260:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270165.718299:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697984 00000100:00100000:0.0:1788270165.718303:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697984 00000100:00100000:0.0:1788270165.718332:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788270165.718338:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262697984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.718369:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262697984:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.718375:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:0.0:1788270165.718387:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270165.718402:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262697984:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.718504:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262697856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.718532:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270165.718600:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262697856 00000100:00100000:0.0:1788270165.718605:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262697856 00000100:00100000:0.0:1788270165.718644:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788270165.718650:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262697856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.718684:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262697856:12345-0@lo:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.718690:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:1.0:1788270165.718746:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270165.718765:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262697856:0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.718830:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262697600:0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.721417:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262698112:0@lo:400:kworker.0 00000100:00100000:3.0:1788270165.721500:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270165.721584:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698112 00000100:00100000:0.0:1788270165.721592:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698112 00000100:00100000:0.0:1788270165.721665:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788270165.721672:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262698112:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788270165.721772:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270165.721952:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262698240:0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.721984:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270165.722016:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698240 00000100:00100000:1.0:1788270165.722020:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698240 00000100:00100000:1.0:1788270165.722084:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788270165.722091:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262698240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270165.722124:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262698240:12345-0@lo:400:kworker.0 Request processed in 34us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270165.722131:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1788270165.722148:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270165.722174:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262698240:0@lo:400:kworker.0 00000100:00100000:0.0:1788270165.722347:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262698112:12345-0@lo:400:kworker.0 Request processed in 675us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270165.722357:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788270165.722412:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262698112:0@lo:400:kworker.0 00010000:00010000:3.0:1788270166.468589:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270167.492244:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270167.750622:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262698368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270167.750694:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270167.750763:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698368 00000100:00100000:1.0:1788270167.750770:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698368 00000100:00100000:1.0:1788270167.750832:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788270167.750840:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262698368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270167.750862:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00080000:3.0:1788270167.751023:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270167.751238:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262698368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 397us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270167.751246:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788270167.751479:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262698368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270168.260394:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262698496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270168.260483:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270168.260649:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698496 00000100:00100000:0.0:1788270168.260658:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698496 00000100:00100000:0.0:1788270168.260711:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788270168.260728:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262698496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270168.260761:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:0.0:1788270168.260810:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262698496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270168.260816:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788270168.260870:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262698496:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270168.516234:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270168.772247:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270168.772256:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270168.772354:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 1 count 1 00000040:00080000:0.0:1788270168.772363:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788270169.412287:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270169.412296:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270169.412317:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 11 count 4 00000040:00080000:3.0:1788270169.412325:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270169.540927:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270170.308268:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270170.308333:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262698624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270170.308434:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270170.308628:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698624 00000100:00100000:3.0:1788270170.308637:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698624 00000100:00100000:3.0:1788270170.308725:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788270170.308752:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15334ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262698624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270170.308786:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270170.308850:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15334ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262698624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.308858:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788270170.308933:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262698624:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270170.564240:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270170.627915:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.627972:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.628006:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.628069:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.628092:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.628114:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.628181:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270170.628211:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331200 00000100:00100000:2.0:1788270170.628215:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331328 00000100:00100000:0.0:1788270170.628221:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331200 00000100:00100000:2.0:1788270170.628223:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331328 00000100:00100000:0.0:1788270170.628270:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:2.0:1788270170.628278:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331840 00000100:00100000:0.0:1788270170.628284:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253331200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270170.628294:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331840 00000100:00100000:2.0:1788270170.628317:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331456 00000100:00100000:2.0:1788270170.628320:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331456 00000100:00100000:2.0:1788270170.628337:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331968 00000100:00100000:2.0:1788270170.628339:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331968 00000100:00100000:0.0:1788270170.628364:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253331200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 82us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270170.628370:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:0.0:1788270170.628377:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:2.0:1788270170.628383:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2401:x1875136253331328:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270170.628419:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:2.0:1788270170.628428:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:2401:x1875136253331328:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 47us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.628431:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253331840:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270170.628443:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:2.0:1788270170.628462:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 237 00000100:00100000:0.0:1788270170.628470:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253331840:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270170.628473:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253331456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270170.628485:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:0.0:1788270170.628505:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:2.0:1788270170.628511:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253331456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.628516:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253331968:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270170.628525:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 237 00000100:00100000:0.0:1788270170.628546:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253331968:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.628551:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:1.0:1788270170.628686:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331584 00000100:00100000:1.0:1788270170.628692:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331584 00000100:00100000:1.0:1788270170.628728:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253331712 00000100:00100000:1.0:1788270170.628731:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253331712 00000100:00100000:1.0:1788270170.628763:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:1.0:1788270170.628771:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253331584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270170.628800:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253331584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270170.628806:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:1.0:1788270170.628820:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788270170.628824:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253331712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270170.628847:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253331712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270170.628852:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00080000:3.0:1788270170.629149:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270170.629154:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270170.629156:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270170.629159:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270170.820231:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270170.820256:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262699008:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.820323:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262699136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270170.820352:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270170.820414:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262698752:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.820460:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.820470:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262699392:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.820511:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262699648:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.820514:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.820546:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262699904:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.820553:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270170.820581:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262700160:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.820586:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.820616:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788270170.820620:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.820626:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262699520:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.820659:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.820679:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262700032:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.820698:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.820755:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699904 00000100:00100000:0.0:1788270170.820761:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699904 00000100:00100000:0.0:1788270170.820806:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262700160 00000100:00100000:0.0:1788270170.820809:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262700160 00000100:00100000:0.0:1788270170.820825:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262700032 00000100:00100000:0.0:1788270170.820827:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262700032 00000100:00100000:0.0:1788270170.820843:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788270170.820851:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262699904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270170.820902:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262698880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270170.820934:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270170.820958:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262700544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270170.820982:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270170.821000:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270170.821006:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262700416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270170.821029:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270170.821227:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699008 00000100:00100000:1.0:1788270170.821227:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699136 00000100:00100000:2.0:1788270170.821234:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699008 00000100:00100000:1.0:1788270170.821235:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699136 00000100:00100000:3.0:1788270170.821242:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270170.821271:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262699264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270170.821277:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699648 00000100:00100000:1.0:1788270170.821282:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699648 00000100:00100000:3.0:1788270170.821293:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270170.821306:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821320:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262699904:12345-0@lo:400:kworker.0 Request processed in 466us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.821325:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.821335:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788270170.821350:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262700288:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821368:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699264 00000100:00100000:3.0:1788270170.821372:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270170.821374:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699264 00000100:00100000:0.0:1788270170.821395:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699776 00000100:00100000:0.0:1788270170.821398:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699776 00000100:00100000:3.0:1788270170.821400:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698752 00000100:00100000:3.0:1788270170.821405:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698752 00000100:00100000:0.0:1788270170.821413:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262700288 00000100:00100000:0.0:1788270170.821418:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262700288 00000100:00100000:3.0:1788270170.821440:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788270170.821445:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788270170.821453:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262698752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821458:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262700160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270170.821503:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262698752:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.821513:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788270170.821513:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262700160:12345-0@lo:400:kworker.0 Request processed in 59us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.821523:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788270170.821540:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788270170.821548:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262700032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821575:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262700032:12345-0@lo:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.821582:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788270170.821593:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788270170.821598:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262699264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821623:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262699264:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.821628:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788270170.821639:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788270170.821644:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262699776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821669:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262699776:12345-0@lo:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.821674:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788270170.821684:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788270170.821690:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262700288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821714:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262700288:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.821720:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788270170.821732:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699520 00000100:00100000:2.0:1788270170.821738:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788270170.821739:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699520 00000100:00100000:0.0:1788270170.821750:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788270170.821752:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262699136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821762:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262699008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.821795:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262699136:12345-0@lo:400:kworker.0 Request processed in 49us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270170.821803:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788270170.821825:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788270170.821828:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262699008:12345-0@lo:400:kworker.0 Request processed in 68us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270170.821836:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262699648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821837:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788270170.821861:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270170.821867:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270170.821871:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270170.821874:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270170.821886:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788270170.821893:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262700032:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.821894:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262699648:12345-0@lo:400:kworker.0 Request processed in 57us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270170.821900:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262699520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.821912:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788270170.821919:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262698752:0@lo:400:kworker.0 00000100:00100000:0.0:1788270170.821922:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262699904:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.821942:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262698880 00000100:00100000:3.0:1788270170.821943:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262699264:0@lo:400:kworker.0 00000100:00100000:2.0:1788270170.821949:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262698880 00000100:00100000:1.0:1788270170.821954:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262699520:12345-0@lo:400:kworker.0 Request processed in 57us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270170.821961:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262699520:0@lo:400:kworker.0 00000100:00100000:1.0:1788270170.821966:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788270170.821976:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262700544 00000100:00100000:2.0:1788270170.821980:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262700544 00000100:00100000:3.0:1788270170.821981:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262699776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270170.821996:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262700416 00000100:00100000:3.0:1788270170.821998:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262700288:0@lo:400:kworker.0 00000100:00100000:1.0:1788270170.822002:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262700416 00000100:00100000:1.0:1788270170.822027:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788270170.822035:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262698880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270170.822083:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262699136:0@lo:400:kworker.0 00000100:00100000:3.0:1788270170.822093:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262699648:0@lo:400:kworker.0 00000100:00100000:3.0:1788270170.822103:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262700160:0@lo:400:kworker.0 00000100:00100000:3.0:1788270170.822147:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262699392 00000100:00100000:3.0:1788270170.822151:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262699392 00000100:00100000:3.0:1788270170.822178:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788270170.822185:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262699392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270170.822221:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262699392:12345-0@lo:400:kworker.0 Request processed in 37us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.822227:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788270170.822286:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788270170.822294:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262700544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270170.822315:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270170.822359:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262700544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.822365:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788270170.822381:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788270170.822389:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262700416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270170.822404:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00002000:00000024:3.0:1788270170.822406:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:1.0:1788270170.822450:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262698880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 415us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.822454:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262700416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270170.822461:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788270170.822500:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262700416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270170.822513:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262700544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270170.822526:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788270170.822528:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262699008:0@lo:400:kworker.0 00000100:00100000:3.0:1788270170.822548:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262698880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270170.822590:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262699392:0@lo:400:kworker.0 00010000:00010000:0.0:1788270171.588309:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270172.613590:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270172.868346:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270172.868372:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262700672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270172.868445:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270172.868506:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262700672 00000100:00100000:1.0:1788270172.868515:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262700672 00000100:00080000:3.0:1788270172.868611:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270172.868654:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788270172.868666:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262700672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270172.868708:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270172.868764:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262700672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270172.868772:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788270172.868852:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262700672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270173.112208:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270173.112289:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253332096 00000100:00100000:2.0:1788270173.112311:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253332096 00000100:00100000:2.0:1788270173.112388:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:2.0:1788270173.112401:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2403:x1875136253332096:12345-192.168.201.42@tcp:1:lfs.0 00000100:00080000:3.0:1788270173.112482:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788270173.112559:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.112577:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 14 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.112583:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=20s v=(0 0) 00010000:00010000:2.0:1788270173.112586:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270173.112590:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.112617:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 14 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.112627:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 14 pid: 48231 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270173.112638:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262700800:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270173.112713:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c25e956f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788270173.113978:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:48230:1875136262700800:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270173.114002:0:48230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270173.115281:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270173.115352:0:45763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253332224 00000100:00100000:2.0:1788270173.115360:0:45763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253332224 00010000:00010000:2.0:1788270173.115404:0:45763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 15 pid: 48231 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270173.115501:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788270173.115514:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+15:2401:x1875136253332224:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270173.115529:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270173.115557:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 15 pid: 48231 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.115571:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 15 pid: 48231 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.115593:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aac72402/0xc5f5d7a016e0ae65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102292 expref: 15 pid: 48231 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.115609:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270173.115614:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270173.115619:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.115631:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.115662:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270173.115691:0:48230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115702:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270173.115712:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253332224:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 199us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270173.115720:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00010000:00010000:2.0:1788270173.115724:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115734:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115743:0:48230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115751:0:48230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ee00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270173.115756:0:48230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115765:0:48230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115778:0:48230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.115786:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098f1480/0xc5f5d7a016e0aeb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270173.115849:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253332096:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 3452us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270173.115858:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:0.0:1788270173.117650:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270173.117731:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253332480 00000100:00100000:3.0:1788270173.117739:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253332480 00000100:00080000:0.0:1788270173.117788:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270173.117794:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788270173.117803:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:43585:x1875136253332480:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788270173.117851:0:45779:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x2a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ad85 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610224c expref: 45 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270173.118011:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771491 00000001:00080000:3.0:1788270173.118719:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771492 00010000:00010000:3.0:1788270173.118755:0:45779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270173.118769:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 48 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270173.118778:0:45779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 48 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270173.118785:0:45779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 5/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270173.118813:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 48 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270173.118830:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 48 pid: 46770 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270173.118843:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262700928:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270173.118929:0:45779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 48 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270173.118938:0:45779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 48 pid: 45777 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270173.118946:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262701056:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270173.118968:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c14343b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788270173.124433:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262700928:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788270173.124449:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:45779:1875136262701056:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788270173.124473:0:45779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270173.124690:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270173.124929:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270173.125062:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253332608 00000100:00100000:2.0:1788270173.125071:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253332608 00010000:00010000:2.0:1788270173.125105:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 49 pid: 46770 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270173.125291:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253332736 00000100:00100000:2.0:1788270173.125296:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253332736 00010000:00010000:2.0:1788270173.125326:0:45762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 50 pid: 45777 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270173.125404:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788270173.125430:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2400:x1875136253332608:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270173.125444:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270173.125451:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 50 pid: 46770 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125464:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 50 pid: 46770 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125487:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0ae96 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022a0 expref: 50 pid: 46770 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125504:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270173.125509:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125519:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125525:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270173.125574:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:2400:x1875136253332608:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 160us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270173.125582:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788270173.125603:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:0.0:1788270173.125609:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253332736:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270173.125617:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270173.125624:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 48 pid: 45777 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125635:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 48 pid: 45777 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125649:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0ad9a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102253 expref: 48 pid: 45777 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125660:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270173.125664:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125672:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125680:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125705:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270173.125722:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:2401:x1875136253332736:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 113us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270173.125729:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00010000:00010000:0.0:1788270173.125762:0:45779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.125770:0:45779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270173.125890:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771493 00000001:00080000:0.0:1788270173.126003:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771494 00000100:00100000:0.0:1788270173.126114:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262701184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788270173.126172:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270173.126381:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701184 00000100:00100000:3.0:1788270173.126388:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701184 00000100:00100000:0.0:1788270173.126394:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275ab4b40 going to sleep for 11 seconds 00000100:00080000:0.0:1788270173.126426:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270173.126444:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788270173.126452:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262701184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788270173.126639:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262701184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270173.126732:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262701184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (361us total) trans 0 rc 0/0 00000001:00080000:0.0:1788270173.126738:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771495 00000100:00100000:3.0:1788270173.126744:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788270173.126781:0:45779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262701312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788270173.126806:0:45779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270173.126825:0:45779:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c144293540 going to sleep for 11 seconds 00000100:00100000:3.0:1788270173.126847:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701312 00000100:00100000:3.0:1788270173.126852:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701312 00000100:00100000:3.0:1788270173.126882:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788270173.126889:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:45779:x1875136262701312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788270173.126980:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45779:x1875136262701312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (172us total) trans 30064771175 rc 0/0 00000100:00100000:3.0:1788270173.126987:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788270173.127028:0:45779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:45779:1875136262701312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788270173.127082:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771496 00010000:00010000:0.0:1788270173.127107:0:45779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.127116:0:45779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.127124:0:45779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.127316:0:45779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270173.127322:0:45779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.127331:0:45779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.127346:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270173.127349:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788270173.127353:0:45779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270173.127361:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0aec0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788270173.127590:0:45779:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788270173.127646:0:45779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].16, 64 off9456 00000004:00080000:0.0:1788270173.127657:0:45779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 964834617499ns, next at 965834615361ns, rc = 0 00000001:00080000:0.0:1788270173.127664:0:45779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771497 00010000:00010000:0.0:1788270173.127685:0:45779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fe000) 00010000:00010000:0.0:1788270173.127689:0:45779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788270173.127695:0:45779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0ad85 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610224c expref: 51 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270173.127783:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:43585:x1875136253332480:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 9980us (10136us total) trans 30064771498 rc 0/0 00000100:00100000:0.0:1788270173.127795:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000020:00080000:0.0:1788270173.127800:0:45779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1788270173.130841:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270173.130940:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253332864 00000100:00100000:2.0:1788270173.130950:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253332864 00000100:00100000:2.0:1788270173.131004:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 578 00000100:00100000:2.0:1788270173.131017:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:43585:x1875136253332864:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270173.131503:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270173.131525:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0aec7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022ae expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.131573:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0aec7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ae expref: 51 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.131583:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ee00/0xc5f5d7a016e0aec7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ae expref: 51 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270173.131595:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff98c1429fb500) 00010000:00010000:2.0:1788270173.131597:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270173.131600:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ee00, rc 0) 00000100:00100000:2.0:1788270173.131656:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:43585:x1875136253332864:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 642us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270173.131663:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 578 00000100:00100000:3.0:1788270173.137860:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270173.138165:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333120 00000100:00100000:1.0:1788270173.138179:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333120 00000100:00100000:1.0:1788270173.138420:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:1.0:1788270173.138433:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:43585:x1875136253333120:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788270173.138748:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:43585:x1875136253333120:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 316us (902us total) trans 30064771499 rc 0/0 00000100:00100000:1.0:1788270173.138757:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:0.0:1788270173.380798:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262701440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270173.380901:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270173.382539:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701440 00000100:00100000:1.0:1788270173.382555:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701440 00000100:00100000:1.0:1788270173.382635:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788270173.382647:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262701440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270173.382697:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:1.0:1788270173.382787:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262701440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270173.382795:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788270173.382923:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262701440:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270173.636610:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270174.662800:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270175.428465:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270175.428497:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262701568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270175.428585:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.429013:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701568 00000100:00100000:1.0:1788270175.429022:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701568 00000100:00100000:1.0:1788270175.429097:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788270175.429106:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262701568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270175.429143:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270175.429206:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262701568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270175.429213:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788270175.429294:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262701568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270175.686780:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270175.747601:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270175.747722:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270175.747762:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270175.749401:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333632 00000100:00100000:0.0:1788270175.749422:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333632 00000100:00100000:0.0:1788270175.749512:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:0.0:1788270175.749526:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253333632:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270175.749544:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270175.749572:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270175.749627:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253333632:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 104us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270175.749635:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00080000:0.0:1788270175.749665:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270175.752378:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333376 00000100:00100000:1.0:1788270175.752399:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333376 00000100:00100000:2.0:1788270175.752484:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333888 00000100:00100000:2.0:1788270175.752489:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333888 00000100:00100000:1.0:1788270175.752509:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 245 00000100:00100000:1.0:1788270175.752527:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:2403:x1875136253333376:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270175.752639:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:2403:x1875136253333376:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 119us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.753005:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270175.753054:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270175.753090:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333248 00000100:00100000:3.0:1788270175.753095:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333248 00000100:00100000:3.0:1788270175.753132:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:3.0:1788270175.753141:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253333248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270175.753179:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253333248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.753186:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:3.0:1788270175.753227:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333504 00000100:00100000:3.0:1788270175.753231:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333504 00000100:00100000:2.0:1788270175.755428:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253334016 00000100:00100000:2.0:1788270175.755445:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253334016 00000100:00100000:2.0:1788270175.755505:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 246 00000100:00100000:2.0:1788270175.755518:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253333888:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270175.755607:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253333888:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 93us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270175.755617:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 246 00000100:00100000:2.0:1788270175.755637:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 247 00000100:00100000:2.0:1788270175.755643:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253334016:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270175.755664:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253334016:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270175.755670:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 247 00000100:00100000:2.0:1788270175.755752:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253333760 00000100:00100000:2.0:1788270175.755756:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253333760 00000100:00100000:2.0:1788270175.755800:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:2.0:1788270175.755806:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253333760:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270175.755832:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253333760:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270175.755838:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00080000:2.0:1788270175.756025:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270175.756031:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270175.756033:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270175.762622:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 245 00000100:00100000:3.0:1788270175.765127:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:3.0:1788270175.765154:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253333504:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270175.766075:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253333504:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 926us (16492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.766087:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:0.0:1788270175.940957:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270175.940989:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262701696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270175.941187:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270175.941482:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701696 00000100:00100000:0.0:1788270175.941493:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701696 00000100:00100000:2.0:1788270175.941668:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262701824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270175.941707:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270175.941748:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701824 00000100:00100000:2.0:1788270175.941752:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701824 00000100:00100000:0.0:1788270175.941825:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788270175.941834:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262701696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270175.941867:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270175.941923:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262701696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270175.941934:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788270175.941996:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262701696:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788270175.944353:0:45803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 967651309845ns, next at 968651305870ns, rc = 0 00000100:00100000:1.0:1788270175.944399:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262701952:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788270175.944453:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270175.944460:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270175.944492:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.944558:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262702464:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.944586:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.944622:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262702976:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.944652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.944673:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788270175.944679:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262702336:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.944682:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262702080:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.944714:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.944716:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270175.944738:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262702592:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.944738:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262702848:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.944759:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270175.944760:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270175.944783:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262703104:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.944791:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262701952 00000100:00100000:1.0:1788270175.944805:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262701952 00000100:00100000:3.0:1788270175.944814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270175.944835:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788270175.944841:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262702208:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.944862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.944864:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788270175.944874:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262701952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270175.944878:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262702720:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.944897:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788270175.944910:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:3.0:1788270175.944912:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262703232:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.944930:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270175.944953:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262701952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.944956:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702080 00000100:00100000:3.0:1788270175.944959:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702080 00000100:00100000:1.0:1788270175.944961:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788270175.944984:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702464 00000100:00100000:1.0:1788270175.944987:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702464 00000100:00100000:3.0:1788270175.944988:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788270175.944994:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262702080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945013:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788270175.945019:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262702464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945025:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262702080:12345-0@lo:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.945031:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788270175.945084:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702976 00000100:00100000:3.0:1788270175.945087:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702976 00000100:00100000:1.0:1788270175.945087:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262702464:12345-0@lo:400:kworker.0 Request processed in 69us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270175.945093:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788270175.945110:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702336 00000100:00100000:1.0:1788270175.945111:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702848 00000100:00100000:3.0:1788270175.945112:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702336 00000100:00100000:1.0:1788270175.945114:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702848 00000100:00100000:3.0:1788270175.945124:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262703104 00000100:00100000:3.0:1788270175.945126:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262703104 00000100:00100000:1.0:1788270175.945129:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702720 00000100:00100000:1.0:1788270175.945130:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702720 00000100:00100000:3.0:1788270175.945138:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262703232 00000100:00100000:3.0:1788270175.945140:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262703232 00000100:00100000:1.0:1788270175.945142:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788270175.945148:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262702976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945152:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788270175.945158:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262702336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945178:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262702976:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.945181:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262702336:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270175.945184:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788270175.945187:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788270175.945197:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788270175.945202:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262702848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945205:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788270175.945210:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262703104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945227:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262702848:12345-0@lo:400:kworker.0 Request processed in 25us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.945233:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262703104:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270175.945234:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788270175.945239:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788270175.945245:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788270175.945261:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788270175.945264:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262702720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945267:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262703232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945290:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262703232:12345-0@lo:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270175.945290:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262702720:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270175.945297:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788270175.945299:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:1.0:1788270175.945313:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270175.945316:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270175.945317:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702592 00000100:00080000:1.0:1788270175.945318:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270175.945320:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702592 00000100:00100000:3.0:1788270175.945351:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262702208 00000100:00100000:3.0:1788270175.945354:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262702208 00000100:00100000:1.0:1788270175.945356:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262702336:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945368:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262702848:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945370:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788270175.945375:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262702592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945376:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262702464:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945385:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262702976:0@lo:400:kworker.0 00000100:00100000:1.0:1788270175.945402:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262701952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270175.945405:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262702592:12345-0@lo:400:kworker.0 Request processed in 30us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.945410:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788270175.945420:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788270175.945426:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262702208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945447:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262702208:12345-0@lo:400:kworker.0 Request processed in 22us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270175.945453:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788270175.945476:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270175.945491:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262702208:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945500:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262702720:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945509:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262703232:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945515:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262702080:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945523:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262702592:0@lo:400:kworker.0 00000100:00100000:3.0:1788270175.945531:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262703104:0@lo:400:kworker.0 00000100:00100000:2.0:1788270175.945701:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788270175.945710:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262701824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270175.945722:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776675840 avail 3545153536 00000100:00100000:2.0:1788270175.945759:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262701824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270175.945768:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788270175.945800:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262701824:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788270176.714932:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270177.220010:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270177.220495:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253334144 00000100:00100000:1.0:1788270177.220508:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253334144 00000100:00080000:3.0:1788270177.220576:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270177.220600:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 579 00000100:00100000:1.0:1788270177.220612:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:43531:x1875136253334144:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788270177.220740:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:43531:x1875136253334144:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 131us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270177.220748:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 579 00000100:00100000:3.0:1788270177.224218:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270177.225911:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253334272 00000100:00100000:0.0:1788270177.225933:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253334272 00000100:00080000:3.0:1788270177.226214:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270177.226326:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 580 00000100:00100000:2.0:1788270177.226341:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:43531:x1875136253334272:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788270177.226491:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:43531:x1875136253334272:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 154us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270177.226500:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 580 00000100:00100000:2.0:1788270177.230589:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270177.230737:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253334528 00000100:00100000:0.0:1788270177.230750:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253334528 00000100:00100000:0.0:1788270177.230941:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:0.0:1788270177.230955:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:43531:x1875136253334528:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788270177.231513:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:43531:x1875136253334528:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 559us (937us total) trans 30064771500 rc 0/0 00000100:00100000:0.0:1788270177.231523:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00010000:00010000:1.0:1788270177.732380:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270177.988618:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270177.988641:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262703360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270177.988709:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270177.988759:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262703360 00000100:00100000:1.0:1788270177.988766:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262703360 00000100:00100000:1.0:1788270177.988821:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788270177.988831:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262703360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270177.988858:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175365824 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270177.988903:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262703360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270177.988909:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788270177.988930:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270177.988962:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262703360:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1788270178.312296:0:51502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 09:42:57 (1788270177) 00000100:00100000:0.0:1788270178.500875:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270178.500899:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262703488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270178.500969:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270178.501069:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262703488 00000100:00100000:2.0:1788270178.501078:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262703488 00000100:00100000:2.0:1788270178.501134:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788270178.501144:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262703488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270178.501176:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446133760 avail 1299894272 00000100:00100000:2.0:1788270178.501242:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262703488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270178.501250:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788270178.501296:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262703488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270178.538930:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.540434:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253334784 00000100:00100000:2.0:1788270178.540448:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253334784 00000100:00100000:2.0:1788270178.540517:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 581 00000100:00100000:2.0:1788270178.540528:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:44227:x1875136253334784:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270178.540553:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270178.540573:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aece lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022b5 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540649:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540663:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540677:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540692:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540699:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540706:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540799:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0aee3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540808:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0aee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540815:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0aee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270178.540825:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788270178.540912:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540920:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540927:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540933:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540939:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.540944:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540951:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540963:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c14387f000) 00010000:00010000:2.0:1788270178.540966:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.540971:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540976:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0aed5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540989:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.540995:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541001:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541005:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.541009:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541015:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541022:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c1429fb300) 00010000:00010000:2.0:1788270178.541024:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.541027:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541032:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aedc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541325:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aece lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022b5 expref: 56 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541339:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0aee3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022b5 expref: 55 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.541346:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270178.541348:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.541351:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270178.541414:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:44227:x1875136253334784:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 888us (2492us total) trans 30064771501 rc 0/0 00000100:00100000:2.0:1788270178.541421:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 581 00000001:00080000:0.0:1788270178.542985:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771501 is committed 00000004:00080000:0.0:1788270178.543000:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000004:00080000:0.0:1788270178.543098:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000100:00100000:3.0:1788270178.543304:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262703616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788270178.543368:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270178.543495:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262703616 00000100:00100000:1.0:1788270178.543503:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262703616 00000100:00100000:1.0:1788270178.543561:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788270178.543571:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262703616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788270178.543595:0:47284:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:204 count 1 00002000:00010000:1.0:1788270178.543627:0:47284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xcc:0x0] initial LVB size: 24, mtime: 0x6a96d648, atime: 0x6a96d648, ctime: 0x6a96d648, blocks: 0x8 00010000:00010000:1.0:1788270178.543636:0:47284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543652:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=970s v=(0 0) 00010000:00010000:1.0:1788270178.543657:0:47284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270178.543663:0:47284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543679:0:47284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543690:0:47284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543699:0:47284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543720:0:47284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788270178.543881:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3609:x1875136262703616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 310us (511us total) trans 30064771176 rc 0/0 00000100:00100000:1.0:1788270178.543889:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00010000:1.0:1788270178.543908:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270178.543915:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543923:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168600 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270178.543928:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543937:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543954:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543961:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000865053c7/0xc5f5d7a016e0aef1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.543978:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270178.543980:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270178.543982:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788270178.544013:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1534d3b80/2, rc 0, transno 30064771176 00000100:00100000:1.0:1788270178.544019:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262703616:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788270178.544428:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270178.544736:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270178.544777:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253335040 00000100:00100000:2.0:1788270178.544777:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270178.544785:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253335040 00000100:00100000:3.0:1788270178.544837:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 582 00000100:00100000:3.0:1788270178.544848:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:44227:x1875136253335040:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270178.544878:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253334912 00000100:00100000:1.0:1788270178.544883:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253334912 00000100:00100000:1.0:1788270178.544919:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788270178.544934:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44227:x1875136253335040:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270178.544934:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:2400:x1875136253334912:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788270178.544949:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 582 00010000:00010000:1.0:1788270178.544950:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270178.544971:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0aee3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022b5 expref: 51 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.544988:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:1.0:1788270178.544993:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270178.545016:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2400:x1875136253334912:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270178.545024:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000020:00080000:0.0:1788270178.545675:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c275ab4840 refcount 2 committed 0 result 0 batchid 25769803851 00000020:00080000:0.0:1788270178.545681:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14437ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c24a6e3e40 00000020:00080000:0.0:1788270178.545685:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c14437cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c1519ae800 00000001:00080000:1.0:1788270178.546463:0:48095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771176 is committed 00000020:00080000:3.0:1788270178.546555:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803851 committed batchid 25769803850 00000020:00080000:3.0:1788270178.546615:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803850 00000100:00100000:0.0:1788270178.547646:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270178.547765:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253335168 00000100:00100000:1.0:1788270178.547774:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253335168 00000100:00100000:1.0:1788270178.548018:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 583 00000100:00100000:1.0:1788270178.548030:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:44227:x1875136253335168:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788270178.548150:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:44227:x1875136253335168:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 122us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270178.548158:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 583 00000040:00080000:1.0:1788270178.628494:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270178.628504:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270178.632403:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 4 00000040:00080000:1.0:1788270178.632426:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270178.644361:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.644464:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253335296 00000100:00100000:2.0:1788270178.644473:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253335296 00000100:00100000:2.0:1788270178.644538:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 584 00000100:00100000:2.0:1788270178.644561:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:44248:x1875136253335296:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270178.644582:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270178.644604:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022bc expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644681:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644696:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644708:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644722:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644729:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644735:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644779:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644786:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644792:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644800:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644805:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.644809:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644816:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644827:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270178.644830:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.644834:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644840:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0aeff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644853:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644858:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644865:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644870:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.644872:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644883:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644891:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff98c1429fb300) 00010000:00010000:2.0:1788270178.644893:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.644896:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644902:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644934:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aef8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022bc expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644944:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270178.644947:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.644951:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022bc expref: 44 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.644960:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fe00, rc 0) 00000100:00100000:2.0:1788270178.645018:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:44248:x1875136253335296:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 470us (667us total) trans 0 rc 301/301 00000100:00100000:2.0:1788270178.645025:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 584 00000100:00100000:3.0:1788270178.650760:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.650913:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253335552 00000100:00100000:2.0:1788270178.650925:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253335552 00000100:00100000:2.0:1788270178.650989:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 585 00000100:00100000:2.0:1788270178.651000:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+43:44248:x1875136253335552:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:2.0:1788270178.651082:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270178.651109:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0ae7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102299 expref: 43 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.651126:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270178.651129:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270178.651177:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.651186:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.651193:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.651279:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.651288:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.651296:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652176:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652190:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652198:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270178.652229:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006153ef3a reply state 0000000000a8ff07 transno 30064771502 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652241:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652248:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:2.0:1788270178.652250:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270178.652253:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788270178.652259:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00010000:00010000:2.0:1788270178.652267:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652274:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652281:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652288:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.652292:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652299:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652308:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270178.652310:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.652314:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652324:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af0d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270178.652335:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006153ef3a reply state 0000000000a8ff07 transno 30064771502 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652343:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.652349:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff98c1429fb300) 00010000:00010000:2.0:1788270178.652351:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270178.652353:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788270178.652449:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:44248:x1875136253335552:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 1449us (1698us total) trans 30064771502 rc 0/0 00000100:00100000:2.0:1788270178.652457:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 585 00000100:00100000:0.0:1788270178.664543:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.664634:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253335680 00000100:00100000:2.0:1788270178.664646:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253335680 00000100:00100000:2.0:1788270178.664747:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 586 00000100:00100000:2.0:1788270178.664758:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+44:44249:x1875136253335680:12345-192.168.201.42@tcp:101:chmod.0 00010000:00010000:2.0:1788270178.664780:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270178.664799:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022c3 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.664864:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0af29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.664877:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0af29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.664893:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0af29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270178.664935:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788270178.664939:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270178.664981:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0af29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.665006:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0af22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022c3 expref: 46 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.665024:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0af29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022c3 expref: 45 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.665075:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270178.665078:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270178.665082:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f000, rc 0) 00000100:00100000:2.0:1788270178.665135:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:44249:x1875136253335680:12345-192.168.201.42@tcp:101:chmod.0 Request processed in 379us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270178.665142:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 586 00000100:00100000:3.0:1788270178.667160:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.667292:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253335808 00000100:00100000:0.0:1788270178.667301:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253335808 00000100:00100000:0.0:1788270178.667352:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 587 00000100:00100000:0.0:1788270178.667362:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+45:44249:x1875136253335808:12345-192.168.201.42@tcp:101:chmod.0 00010000:00010000:0.0:1788270178.667378:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270178.667396:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0af30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022ca expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667448:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667461:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667471:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667481:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667488:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667494:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667569:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af45 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667578:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667586:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270178.667620:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000004:00200000:0.0:1788270178.667624:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270178.667646:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667655:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667659:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667664:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667667:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.667670:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667675:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667683:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270178.667685:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.667687:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667690:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667698:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667705:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667708:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667711:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.667712:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667715:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667719:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff98c1429fb300) 00010000:00010000:0.0:1788270178.667720:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.667722:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667725:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667740:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0af30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ca expref: 47 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667747:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af45 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ca expref: 46 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.667751:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270178.667752:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270178.667754:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bba00, rc 0) 00000100:00100000:0.0:1788270178.667829:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:44249:x1875136253335808:12345-192.168.201.42@tcp:101:chmod.0 Request processed in 469us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270178.667834:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 587 00000100:00100000:3.0:1788270178.670442:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.670505:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253336064 00000100:00100000:2.0:1788270178.670513:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253336064 00000100:00100000:2.0:1788270178.670568:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 588 00000100:00100000:2.0:1788270178.670578:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+46:44249:x1875136253336064:12345-192.168.201.42@tcp:36:chmod.0 00010000:00010000:2.0:1788270178.670626:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270178.670652:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af45 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ca expref: 46 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.670676:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:2.0:1788270178.670680:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270178.670702:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.670711:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.670717:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270178.670829:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae793c45 reply state 0000000027bb79ed transno 30064771503 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.670838:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.670842:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:2.0:1788270178.670844:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270178.670845:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788270178.670851:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000100:00100000:2.0:1788270178.670911:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:44249:x1875136253336064:12345-192.168.201.42@tcp:36:chmod.0 Request processed in 335us (477us total) trans 30064771503 rc 0/0 00000100:00100000:2.0:1788270178.670918:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 588 00000100:00100000:2.0:1788270178.677109:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270178.677190:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253336192 00000100:00100000:1.0:1788270178.677437:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253336192 00000100:00100000:1.0:1788270178.677502:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 589 00000100:00100000:1.0:1788270178.677512:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+47:44250:x1875136253336192:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788270178.677537:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270178.677702:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0af53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022d1 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677765:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677775:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677783:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677789:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677794:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677798:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677862:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0af68 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677867:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0af68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677871:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0af68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270178.677898:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000004:00200000:1.0:1788270178.677900:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270178.677918:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0af68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677926:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677930:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677935:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677939:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270178.677941:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677946:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677954:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:1.0:1788270178.677956:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270178.677959:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677963:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0af5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677972:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677976:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677979:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677982:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270178.677984:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677987:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677991:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff98c1429fb300) 00010000:00010000:1.0:1788270178.677992:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270178.677994:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.677997:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0af61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.678013:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0af53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022d1 expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.678020:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0af68 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022d1 expref: 48 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.678025:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:1.0:1788270178.678026:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788270178.678028:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168a00, rc 0) 00000100:00100000:1.0:1788270178.678315:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:44250:x1875136253336192:12345-192.168.201.42@tcp:101:rm.0 Request processed in 803us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270178.678323:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 589 00000100:00100000:3.0:1788270178.680498:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.680561:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253336320 00000100:00100000:0.0:1788270178.680570:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253336320 00000100:00100000:0.0:1788270178.680756:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 590 00000100:00100000:0.0:1788270178.680764:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:44250:x1875136253336320:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:0.0:1788270178.680779:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270178.680793:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0af6f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022d8 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680837:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680846:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680854:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680862:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680866:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680870:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680902:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680907:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680911:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680915:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.680918:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680923:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680930:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270178.680932:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.680936:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680940:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0af76 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680949:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680953:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680956:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680959:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.680961:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680965:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680968:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2c00) 00010000:00010000:0.0:1788270178.680970:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.680971:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680974:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0af7d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.680994:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0af6f lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022d8 expref: 49 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.681000:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270178.681001:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.681003:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0af6f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022d8 expref: 49 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.681008:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bae00, rc 0) 00000100:00100000:0.0:1788270178.681091:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:44250:x1875136253336320:12345-192.168.201.42@tcp:101:rm.0 Request processed in 327us (598us total) trans 0 rc 301/301 00000100:00100000:0.0:1788270178.681099:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 590 00000100:00100000:3.0:1788270178.683996:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.684116:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253336448 00000100:00100000:0.0:1788270178.684125:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253336448 00000100:00100000:0.0:1788270178.684183:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 591 00000100:00100000:0.0:1788270178.684193:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:44250:x1875136253336448:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:0.0:1788270178.684433:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270178.684455:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0af84 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022df expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684520:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684533:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684544:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684561:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684568:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684574:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684610:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684617:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684623:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684630:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684637:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.684641:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684647:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684658:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270178.684661:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.684666:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684671:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0af8b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684685:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684691:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684696:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684700:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bba00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.684703:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684708:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684720:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.684722:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.684725:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684730:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0af92 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684762:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0af84 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022df expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684771:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270178.684772:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.684775:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0af84 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022df expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.684781:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb000, rc 0) 00000100:00100000:0.0:1788270178.685022:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:44250:x1875136253336448:12345-192.168.201.42@tcp:101:rm.0 Request processed in 830us (1034us total) trans 0 rc 301/301 00000100:00100000:0.0:1788270178.685029:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 591 00000100:00100000:3.0:1788270178.718692:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270178.718913:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253336704 00000100:00100000:1.0:1788270178.718924:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253336704 00000100:00100000:1.0:1788270178.718983:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 592 00000100:00100000:1.0:1788270178.718994:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:44256:x1875136253336704:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:1.0:1788270178.719014:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270178.719035:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0af99 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022e6 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.719228:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.719248:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.719258:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.719272:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.719279:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270178.719722:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.723942:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0afae lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.723965:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0afae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.723979:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0afae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270178.723995:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 0 00010000:00010000:0.0:1788270178.724022:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724030:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724036:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724061:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270178.724066:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724074:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724088:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270178.724091:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270178.724095:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724101:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0afa0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270178.724116:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fd570c7 reply state 00000000408e070f transno 30064771504 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724128:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724139:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1434d7b00) 00010000:00010000:0.0:1788270178.724141:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270178.724144:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270178.724182:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0af99 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022e6 expref: 51 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.724197:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0afae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022e6 expref: 50 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.726644:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.726648:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270178.726653:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb000, rc 0) 00000100:00100000:0.0:1788270178.726740:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:44256:x1875136253336704:12345-192.168.201.42@tcp:101:dd.500 Request processed in 7744us (8054us total) trans 30064771504 rc 0/0 00000100:00100000:0.0:1788270178.726750:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 592 00000100:00100000:3.0:1788270178.733504:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.733656:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253336960 00000100:00100000:2.0:1788270178.733666:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253336960 00000100:00100000:2.0:1788270178.733727:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:2.0:1788270178.733738:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:44256:x1875136253336960:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:2.0:1788270178.734013:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44256:x1875136253336960:12345-192.168.201.42@tcp:35:dd.500 Request processed in 276us (518us total) trans 30064771505 rc 0/0 00000100:00100000:2.0:1788270178.734021:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00010000:00010000:1.0:1788270178.756454:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270178.790692:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.790800:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253337216 00000100:00100000:0.0:1788270178.790809:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253337216 00000100:00100000:0.0:1788270178.790918:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 593 00000100:00100000:0.0:1788270178.790929:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44266:x1875136253337216:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270178.790953:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270178.790972:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022ed expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270178.791105:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00010000:00010000:0.0:1788270178.791223:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afbc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ed expref: 54 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.791244:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270178.791247:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270178.791252:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022ed expref: 54 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.791266:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bba00, rc 0) 00000100:00100000:0.0:1788270178.791337:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:44266:x1875136253337216:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 410us (652us total) trans 30064771506 rc 301/301 00000100:00100000:0.0:1788270178.791344:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 593 00000100:00100000:3.0:1788270178.793692:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.795033:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253337472 00000100:00100000:0.0:1788270178.795064:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253337472 00000100:00100000:0.0:1788270178.795136:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:0.0:1788270178.795145:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276992c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:44266:x1875136253337472:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788270178.795381:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276992c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:44266:x1875136253337472:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 235us (1697us total) trans 30064771507 rc 0/0 00000100:00100000:0.0:1788270178.795389:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788270178.869961:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.870033:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253337728 00000100:00100000:0.0:1788270178.870069:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253337728 00000100:00100000:0.0:1788270178.870136:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 594 00000100:00100000:0.0:1788270178.870144:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:44272:x1875136253337728:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270178.870171:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270178.870189:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afca lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022f4 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.870312:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0afd1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.870325:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0afd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.870333:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0afd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270178.870341:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 0 00010000:00010000:0.0:1788270178.870426:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afca lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022f4 expref: 57 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.870439:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0afd1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022f4 expref: 56 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.870446:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.870448:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270178.870450:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba400, rc 0) 00000100:00100000:0.0:1788270178.870500:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44272:x1875136253337728:12345-192.168.201.42@tcp:101:dd.500 Request processed in 357us (551us total) trans 30064771508 rc 0/0 00000100:00100000:0.0:1788270178.870507:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 594 00000100:00100000:3.0:1788270178.872968:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270178.873080:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253337984 00000100:00100000:1.0:1788270178.873090:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253337984 00000100:00100000:1.0:1788270178.873137:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:1.0:1788270178.873145:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44272:x1875136253337984:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:1.0:1788270178.873381:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:44272:x1875136253337984:12345-192.168.201.42@tcp:35:dd.500 Request processed in 235us (421us total) trans 30064771509 rc 0/0 00000100:00100000:1.0:1788270178.873389:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788270178.924965:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.925231:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253338112 00000100:00100000:0.0:1788270178.925243:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253338112 00000100:00100000:0.0:1788270178.925313:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 595 00000100:00100000:0.0:1788270178.925324:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+57:44278:x1875136253338112:12345-192.168.201.42@tcp:101:truncate.500 00010000:00010000:0.0:1788270178.925348:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270178.925373:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afdf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561022fb expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.925411:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.925425:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.925436:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.925583:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0afdf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 59 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.925601:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 58 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.925610:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.925612:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270178.925615:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bae00, rc 0) 00000100:00100000:0.0:1788270178.926602:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:44278:x1875136253338112:12345-192.168.201.42@tcp:101:truncate.500 Request processed in 1275us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270178.926611:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 595 00000100:00100000:3.0:1788270178.930506:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.930880:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253338368 00000100:00100000:0.0:1788270178.930890:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253338368 00000100:00100000:0.0:1788270178.931019:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 596 00000100:00100000:0.0:1788270178.931030:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:44278:x1875136253338368:12345-192.168.201.42@tcp:36:truncate.500 00010000:00010000:0.0:1788270178.931105:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270178.931133:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0afd1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022f4 expref: 58 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.931152:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.931156:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270178.931531:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.931545:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.931554:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270178.931591:0:45777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771510 00000004:00010000:0.0:1788270178.931613:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dea30b57 reply state 0000000073d5e178 transno 30064771511 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.931624:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.931631:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.931634:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270178.931636:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270178.931776:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:44278:x1875136253338368:12345-192.168.201.42@tcp:36:truncate.500 Request processed in 746us (1275us total) trans 30064771511 rc 0/0 00000100:00100000:0.0:1788270178.931783:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 596 00000020:00080000:0.0:1788270178.931788:0:45777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270178.984175:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270178.984366:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253338496 00000100:00100000:2.0:1788270178.984377:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253338496 00000100:00100000:2.0:1788270178.984450:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 597 00000100:00100000:2.0:1788270178.984460:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:44284:x1875136253338496:12345-192.168.201.42@tcp:101:truncate.500 00010000:00010000:2.0:1788270178.984484:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270178.984506:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aff4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102302 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984574:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984588:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984597:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984608:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984614:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984620:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984706:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984715:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984722:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270178.984760:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 256 00000004:00200000:2.0:1788270178.984764:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270178.984784:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984796:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984803:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984808:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984814:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984820:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.984824:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984833:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984845:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:2.0:1788270178.984848:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.984852:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984858:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0affb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984872:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984878:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984884:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984889:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270178.984891:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984897:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984903:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1434d7b00) 00010000:00010000:2.0:1788270178.984905:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270178.984909:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984914:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b002 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984939:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0aff4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102302 expref: 62 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984953:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102302 expref: 61 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270178.984960:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270178.984962:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270178.984965:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fc00, rc 0) 00000100:00100000:2.0:1788270178.985031:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:44284:x1875136253338496:12345-192.168.201.42@tcp:101:truncate.500 Request processed in 572us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270178.985090:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 597 00000100:00100000:3.0:1788270178.988024:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270178.988094:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253338752 00000100:00100000:0.0:1788270178.988104:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253338752 00000100:00100000:0.0:1788270178.988158:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 598 00000100:00100000:0.0:1788270178.988168:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:44284:x1875136253338752:12345-192.168.201.42@tcp:36:truncate.500 00010000:00010000:0.0:1788270178.988222:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270178.988244:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b009 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102302 expref: 61 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.988264:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.988269:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270178.988437:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.988450:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.988460:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270178.988498:0:45778:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771512 00000004:00010000:0.0:1788270178.988515:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf72b01b reply state 00000000a047a352 transno 30064771513 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.988524:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270178.988530:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270178.988533:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270178.988545:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270178.988630:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:44284:x1875136253338752:12345-192.168.201.42@tcp:36:truncate.500 Request processed in 463us (616us total) trans 30064771513 rc 0/0 00000100:00100000:0.0:1788270178.988638:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 598 00000020:00080000:0.0:1788270178.988642:0:45778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788270179.012265:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270179.012275:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270179.012871:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:0.0:1788270179.012881:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788270179.019010:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270179.019080:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253339008 00000100:00100000:0.0:1788270179.019089:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253339008 00000100:00100000:0.0:1788270179.019165:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 599 00000100:00100000:0.0:1788270179.019176:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:44290:x1875136253339008:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270179.019209:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270179.019230:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0b017 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102309 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019375:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019390:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019401:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019413:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019418:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019423:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019476:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0b02c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019486:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0b02c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019491:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0b02c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270179.019498:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 2048 00010000:00010000:0.0:1788270179.019579:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019584:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019588:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019592:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.019595:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019600:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019610:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270179.019612:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.019616:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019622:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb400/0xc5f5d7a016e0b01e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019639:0:45777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019646:0:45777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019652:0:45777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019657:0:45777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.019659:0:45777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019663:0:45777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019668:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1434d7b00) 00010000:00010000:0.0:1788270179.019669:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.019671:0:45777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019674:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba600/0xc5f5d7a016e0b025 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019702:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bba00/0xc5f5d7a016e0b017 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102309 expref: 66 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019711:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0b02c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102309 expref: 65 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.019719:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270179.019721:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270179.019723:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba800, rc 0) 00000100:00100000:0.0:1788270179.019774:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:44290:x1875136253339008:12345-192.168.201.42@tcp:101:dd.500 Request processed in 600us (774us total) trans 30064771514 rc 0/0 00000100:00100000:0.0:1788270179.019780:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 599 00000100:00080000:2.0:1788270179.020374:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270179.022105:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.022150:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270179.022190:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253339392 00000100:00100000:0.0:1788270179.022209:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253339392 00000100:00100000:1.0:1788270179.022252:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253339136 00000100:00100000:1.0:1788270179.022257:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253339136 00000100:00100000:0.0:1788270179.022323:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 600 00000100:00100000:0.0:1788270179.022334:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:44290:x1875136253339392:12345-192.168.201.42@tcp:36:dd.500 00000100:00100000:3.0:1788270179.022338:0:45763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788270179.022346:0:45763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:2400:x1875136253339136:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270179.022358:0:45763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270179.022381:0:45763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba800/0xc5f5d7a016e0b02c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102309 expref: 66 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.022398:0:45763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270179.022403:0:45763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270179.022456:0:45763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+65:2400:x1875136253339136:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270179.022464:0:45763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00010000:00010000:0.0:1788270179.022525:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.022538:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.022548:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788270179.022587:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771515 00000004:00010000:0.0:1788270179.022607:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000641bad43 reply state 00000000138ac9ea transno 30064771516 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.022620:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.022627:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270179.022630:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270179.022633:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788270179.022689:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:44290:x1875136253339392:12345-192.168.201.42@tcp:36:dd.500 Request processed in 357us (537us total) trans 30064771516 rc 0/0 00000100:00100000:0.0:1788270179.022696:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 600 00000020:00080000:0.0:1788270179.022699:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270179.026467:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.026652:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253339648 00000100:00100000:1.0:1788270179.026662:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253339648 00000100:00100000:1.0:1788270179.026716:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788270179.026727:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:44290:x1875136253339648:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:1.0:1788270179.027002:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:44290:x1875136253339648:12345-192.168.201.42@tcp:35:dd.500 Request processed in 276us (544us total) trans 30064771517 rc 0/0 00000100:00100000:1.0:1788270179.027010:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:3.0:1788270179.078266:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.078533:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253339904 00000100:00100000:2.0:1788270179.078543:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253339904 00000100:00100000:2.0:1788270179.078597:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 601 00000100:00100000:2.0:1788270179.078605:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:44300:x1875136253339904:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270179.078631:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270179.078653:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102310 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270179.078739:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00010000:00010000:2.0:1788270179.078819:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b041 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102310 expref: 70 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.078830:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:2.0:1788270179.078832:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270179.078835:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102310 expref: 70 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.078850:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fe00, rc 0) 00000100:00100000:2.0:1788270179.078907:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:44300:x1875136253339904:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 302us (652us total) trans 30064771518 rc 301/301 00000100:00100000:2.0:1788270179.078914:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 601 00000100:00100000:3.0:1788270179.080980:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.081076:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253340160 00000100:00100000:1.0:1788270179.081085:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253340160 00000100:00100000:1.0:1788270179.081137:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:1.0:1788270179.081146:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:44300:x1875136253340160:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788270179.081374:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:44300:x1875136253340160:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 228us (401us total) trans 30064771519 rc 0/0 00000100:00100000:1.0:1788270179.081381:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:0.0:1788270179.128019:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.128538:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253340288 00000100:00100000:3.0:1788270179.128550:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253340288 00000100:00100000:3.0:1788270179.128668:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 602 00000100:00100000:3.0:1788270179.128679:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+70:44306:x1875136253340288:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:3.0:1788270179.128705:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270179.128726:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b04f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102317 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.128790:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0b056 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.128806:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0b056 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.128817:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0b056 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270179.128860:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000004:00200000:3.0:1788270179.128863:0:45777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270179.128883:0:45777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0b056 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.129217:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b04f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102317 expref: 72 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.129238:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0b056 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102317 expref: 71 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.129259:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:3.0:1788270179.129261:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788270179.129265:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543800, rc 0) 00000100:00100000:3.0:1788270179.129333:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44306:x1875136253340288:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 657us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270179.129340:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 602 00000100:00100000:0.0:1788270179.131494:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.131667:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253340416 00000100:00100000:1.0:1788270179.131676:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253340416 00000100:00100000:1.0:1788270179.131769:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 603 00000100:00100000:1.0:1788270179.131779:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44306:x1875136253340416:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:1.0:1788270179.131796:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270179.131817:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b05d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610231e expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.131883:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.131896:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.131918:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270179.131963:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 0 00000004:00200000:1.0:1788270179.131967:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270179.131985:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.131995:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.132015:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b05d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610231e expref: 73 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.132030:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610231e expref: 72 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.132067:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:1.0:1788270179.132070:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270179.132073:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168400, rc 0) 00000100:00100000:1.0:1788270179.132166:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44306:x1875136253340416:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 389us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.132173:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 603 00000100:00100000:0.0:1788270179.144607:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.145330:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253340672 00000100:00100000:3.0:1788270179.145343:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253340672 00000100:00100000:3.0:1788270179.145407:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 604 00000100:00100000:3.0:1788270179.145418:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44306:x1875136253340672:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:3.0:1788270179.145437:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270179.145455:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b06b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102325 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.145564:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b072 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.145579:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b072 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.145590:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b072 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270179.145603:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 0 00010000:00010000:3.0:1788270179.145711:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b06b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102325 expref: 75 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.145730:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b072 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102325 expref: 74 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.145739:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270179.145742:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788270179.145745:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543a00, rc 0) 00000100:00100000:3.0:1788270179.145809:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:44306:x1875136253340672:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 392us (1214us total) trans 30064771520 rc 0/0 00000100:00100000:3.0:1788270179.145816:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 604 00000100:00100000:0.0:1788270179.149691:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.149924:0:45762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253340928 00000100:00100000:2.0:1788270179.149933:0:45762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253340928 00000100:00100000:2.0:1788270179.149989:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788270179.149996:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:44306:x1875136253340928:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:2.0:1788270179.150008:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788270179.150028:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b072 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102325 expref: 74 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.150077:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168400/0xc5f5d7a016e0b064 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610231e expref: 73 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.150092:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0afae lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022e6 expref: 72 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.150102:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.150107:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270179.150162:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44306:x1875136253340928:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 164us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.150169:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788270179.152035:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.153064:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253341056 00000100:00100000:3.0:1788270179.153074:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253341056 00000100:00100000:3.0:1788270179.153143:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 605 00000100:00100000:3.0:1788270179.153153:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44306:x1875136253341056:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:3.0:1788270179.153280:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.153298:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.153316:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788270179.153413:0:45777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].11, 136 off9688 00000100:00100000:3.0:1788270179.153498:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44306:x1875136253341056:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 346us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270179.153506:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 605 00000100:00100000:0.0:1788270179.158743:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.162599:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253341184 00000100:00100000:1.0:1788270179.162614:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253341184 00000100:00100000:1.0:1788270179.162691:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 606 00000100:00100000:1.0:1788270179.162701:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44306:x1875136253341184:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788270179.162724:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270179.162744:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610232c expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.163015:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.163030:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 72 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.163069:0:45776:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.163088:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 72 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.163102:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:1.0:1788270179.163105:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788270179.163109:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 72 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.163116:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150168600, rc 0) 00000100:00100000:1.0:1788270179.163187:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44306:x1875136253341184:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 487us (4453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.163206:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 606 00000040:00080000:1.0:1788270179.652478:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270179.652489:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270179.652572:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 12 count 4 00000040:00080000:1.0:1788270179.652579:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270179.652706:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262703744:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788270179.652817:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270179.655013:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262703744:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270179.656135:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.656222:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253341312 00000100:00100000:3.0:1788270179.656229:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253341312 00000100:00100000:3.0:1788270179.656296:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 607 00000100:00100000:3.0:1788270179.656305:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44307:x1875136253341312:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270179.656336:0:48110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270179.656448:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44307:x1875136253341312:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 143us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270179.656456:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 607 00000100:00100000:0.0:1788270179.662378:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.662477:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253341440 00000100:00100000:2.0:1788270179.662487:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253341440 00000100:00100000:2.0:1788270179.662602:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 608 00000100:00100000:2.0:1788270179.662613:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44307:x1875136253341440:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.662685:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662701:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662715:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662730:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662738:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662745:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662778:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662787:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662793:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270179.662837:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 0 00000004:00200000:2.0:1788270179.662841:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270179.662853:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662864:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662870:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662876:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662883:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662888:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.662893:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662900:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662912:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270179.662915:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270179.662920:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662926:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b08e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662940:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662946:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662953:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662959:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.662962:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662967:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662974:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x22b86094 (ffff98c1429fb800) 00010000:00010000:2.0:1788270179.662976:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270179.662978:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662983:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b095 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x22b86094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.662996:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.663002:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.663007:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.663011:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.663014:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.663023:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.663030:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.663033:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270179.663036:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.663100:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b09c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.663176:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44307:x1875136253341440:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 564us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.663193:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 608 00000100:00100000:1.0:1788270179.666640:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.666845:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253341696 00000100:00100000:2.0:1788270179.666855:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253341696 00000100:00100000:2.0:1788270179.666910:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 609 00000100:00100000:2.0:1788270179.666920:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44307:x1875136253341696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.666937:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270179.666956:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102333 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667065:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667077:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667088:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270179.667100:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 0 00010000:00010000:2.0:1788270179.667173:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667178:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667194:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667201:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418ec00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.667205:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667213:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667225:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.667227:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270179.667232:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667238:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418ec00/0xc5f5d7a016e0b0aa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667276:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0a3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102333 expref: 74 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667381:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c1429fde00) 00010000:00010000:2.0:1788270179.667384:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788270179.667389:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102333 expref: 74 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.667401:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fc00, rc 0) 00000100:00100000:2.0:1788270179.667579:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44307:x1875136253341696:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 659us (946us total) trans 30064771521 rc 301/301 00000100:00100000:2.0:1788270179.667586:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 609 00000100:00100000:0.0:1788270179.670909:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.671018:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253341824 00000100:00100000:3.0:1788270179.671028:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253341824 00000100:00100000:3.0:1788270179.671408:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 610 00000100:00100000:3.0:1788270179.671469:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44307:x1875136253341824:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788270179.671505:0:45777:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788270179.671716:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44307:x1875136253341824:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 299us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270179.671724:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 610 00000100:00100000:0.0:1788270179.674655:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.674748:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253342080 00000100:00100000:2.0:1788270179.674757:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253342080 00000100:00100000:2.0:1788270179.676844:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 611 00000100:00100000:2.0:1788270179.676865:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44307:x1875136253342080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.676889:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270179.676893:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788270179.676920:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543800/0xc5f5d7a016e0b056 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102317 expref: 73 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.676940:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:2.0:1788270179.676944:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270179.676957:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0b8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610233a expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788270179.677710:0:46770:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xcd:0x0], index 0: 0 00010000:00010000:2.0:1788270179.677847:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0bf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.677861:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.677872:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.677921:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0b8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610233a expref: 75 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.677939:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0bf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610233a expref: 74 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.677947:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:2.0:1788270179.677950:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270179.677953:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fe00, rc 0) 00000100:00100000:2.0:1788270179.678147:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:44307:x1875136253342080:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1290us (3500us total) trans 30064771522 rc 0/0 00000100:00100000:2.0:1788270179.678155:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 611 00000100:00100000:0.0:1788270179.680790:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.680861:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253342336 00000100:00100000:2.0:1788270179.680871:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253342336 00000100:00100000:2.0:1788270179.680957:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 612 00000100:00100000:2.0:1788270179.680968:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:44307:x1875136253342336:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.681028:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270179.681072:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0bf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610233a expref: 74 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681087:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429fb800) 00010000:00010000:2.0:1788270179.681095:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270179.681112:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681121:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681128:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681137:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681141:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681145:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681177:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681181:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681255:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681262:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.681266:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681275:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681284:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:2.0:1788270179.681287:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270179.681291:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681298:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b0cd lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681308:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681314:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681319:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681324:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.681326:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681332:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681339:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xd6e4a9c7 (ffff98c1429fb000) 00010000:00010000:2.0:1788270179.681343:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270179.681346:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.681351:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0d4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0xd6e4a9c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.681510:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44307:x1875136253342336:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 544us (729us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788270179.681517:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 612 00000100:00100000:0.0:1788270179.683583:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.683660:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253342464 00000100:00100000:3.0:1788270179.683669:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253342464 00000100:00100000:3.0:1788270179.683719:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 613 00000100:00100000:3.0:1788270179.683729:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44307:x1875136253342464:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788270179.683744:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270179.683763:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b0db lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102341 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.683794:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.683806:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.683817:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.683924:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b0db lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 75 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.683941:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 74 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270179.683950:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:3.0:1788270179.683952:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788270179.683956:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241543c00, rc 0) 00000100:00100000:3.0:1788270179.684174:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:44307:x1875136253342464:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 447us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270179.684179:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 613 00000100:00100000:0.0:1788270179.686422:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.691715:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253342720 00000100:00100000:2.0:1788270179.691729:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253342720 00000100:00100000:2.0:1788270179.691788:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 614 00000100:00100000:2.0:1788270179.691797:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+74:44307:x1875136253342720:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.691866:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.691882:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.691894:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788270179.692081:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].17, 88 off9472 00000004:00080000:2.0:1788270179.692089:0:46770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 971399049743ns, next at 972399047670ns, rc = 0 00000004:00010000:2.0:1788270179.692131:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e43a1638 reply state 0000000066f1ee06 transno 30064771523 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.692143:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.692150:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:2.0:1788270179.692153:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788270179.692156:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270179.692388:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+76:44307:x1875136253342720:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 591us (5972us total) trans 30064771523 rc 0/0 00000100:00100000:2.0:1788270179.692395:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 614 00000100:00100000:1.0:1788270179.694681:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.694757:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253342848 00000100:00100000:2.0:1788270179.694765:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253342848 00000100:00100000:2.0:1788270179.694856:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 615 00000100:00100000:2.0:1788270179.694866:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+76:44307:x1875136253342848:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.694887:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270179.694904:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102348 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.694955:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 77 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.694968:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 77 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.694985:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:2.0:1788270179.694989:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270179.694992:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270179.695059:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+77:44307:x1875136253342848:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 194us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.695066:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 615 00000100:00100000:0.0:1788270179.697169:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.697262:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253342976 00000100:00100000:3.0:1788270179.697270:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253342976 00000100:00100000:3.0:1788270179.697337:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:3.0:1788270179.697347:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253342976:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788270179.697555:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253342976:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 208us (391us total) trans 30064771146 rc 0/0 00000100:00100000:3.0:1788270179.697563:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00080000:2.0:1788270179.697929:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270179.699416:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270179.699542:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253343232 00000100:00100000:3.0:1788270179.699550:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253343232 00000100:00100000:3.0:1788270179.699599:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:3.0:1788270179.699607:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+77:44307:x1875136253343232:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788270179.699845:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:44307:x1875136253343232:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 238us (434us total) trans 30064771524 rc 0/0 00000100:00100000:3.0:1788270179.699853:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788270179.701449:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270179.701681:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253343488 00000100:00100000:0.0:1788270179.701689:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253343488 00000100:00100000:0.0:1788270179.701735:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 616 00000100:00100000:0.0:1788270179.701744:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:44307:x1875136253343488:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788270179.701836:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:44307:x1875136253343488:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270179.701844:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 616 00000100:00100000:0.0:1788270179.704017:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.704174:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253343616 00000100:00100000:2.0:1788270179.704195:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253343616 00000100:00100000:2.0:1788270179.704250:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 617 00000100:00100000:2.0:1788270179.704259:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:44307:x1875136253343616:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.704275:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270179.704295:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0f7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610234f expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.704387:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0fe lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.704402:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.704412:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270179.704467:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270179.704484:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.704509:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b0f7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610234f expref: 80 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.704707:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0fe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610234f expref: 79 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.704717:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:2.0:1788270179.704720:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788270179.704723:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fc00, rc 0) 00000100:00100000:2.0:1788270179.704778:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:44307:x1875136253343616:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 520us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.704786:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 617 00000100:00100000:2.0:1788270179.706928:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270179.707013:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253343744 00000100:00100000:0.0:1788270179.707023:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253343744 00000100:00100000:0.0:1788270179.707105:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:0.0:1788270179.707114:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2400:x1875136253343744:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788270179.707129:0:47281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270179.707149:0:47281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102356 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788270179.707173:0:47281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d663, blocks: 0x0 00010000:00010000:0.0:1788270179.707204:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=971s v=(0 0) 00010000:00010000:0.0:1788270179.707209:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270179.707219:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 12 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.707237:0:47281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 12 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.707251:0:47281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba600, rc 0) 00000100:00100000:0.0:1788270179.707349:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253343744:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 235us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270179.707356:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:3.0:1788270179.709492:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.709550:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344000 00000100:00100000:2.0:1788270179.709558:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344000 00000100:00100000:2.0:1788270179.709617:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 618 00000100:00100000:2.0:1788270179.709627:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:44307:x1875136253344000:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788270179.709959:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:44307:x1875136253344000:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 333us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.709968:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 618 00000100:00100000:3.0:1788270179.711864:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.712121:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344128 00000100:00100000:2.0:1788270179.712130:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344128 00000100:00100000:2.0:1788270179.712279:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:2.0:1788270179.712290:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:44307:x1875136253344128:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.712309:0:48231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270179.712327:0:48231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610235d expref: -99 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.712358:0:48231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 13 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.712367:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270179.712371:0:48231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270179.712377:0:48231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 4/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 13 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.712412:0:48231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 13 pid: 47281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.712426:0:48231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 13 pid: 47281 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.712441:0:48231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262703872:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270179.712521:0:48231:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295240 going to sleep for 11 seconds 00000100:00100000:1.0:1788270179.714665:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.714696:0:48231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:48231:1875136262703872:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270179.714732:0:48231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 13 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.714753:0:48231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ec00, rc 0) 00000100:00100000:0.0:1788270179.714771:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344256 00000100:00100000:0.0:1788270179.714779:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344256 00000100:00100000:2.0:1788270179.714808:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:44307:x1875136253344128:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2519us (2950us total) trans 0 rc 0/0 00010000:00010000:0.0:1788270179.714811:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 14 pid: 47281 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.714821:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:0.0:1788270179.715879:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:0.0:1788270179.715891:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253344256:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270179.715906:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270179.715927:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 13 pid: 47281 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.715941:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 13 pid: 47281 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.715961:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a493e4a3/0xc5f5d7a016e0b105 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102356 expref: 13 pid: 47281 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.715975:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270179.715979:0:48804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270179.715987:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.715999:0:48804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.716032:0:48804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270179.716136:0:48804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:48804:1875136262704000:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788270179.716215:0:48804:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788270179.719103:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.719106:0:48804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:48804:1875136262704000:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270179.719129:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270179.719180:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2400:x1875136253344256:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3290us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.719204:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788270179.719805:0:47287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344384 00000100:00100000:3.0:1788270179.719814:0:47287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344384 00002000:00100000:2.0:1788270179.719919:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xcd:0x0] (0->1023) req@ffff98c1534d3480 x1875136253344384/t0(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:595/0 lens 1512/0 e 0 to 0 dl 1788270190 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270179.719930:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1534d3480 with x1875136253344384 ext(0->1023) 00002000:00010000:2.0:1788270179.719935:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1534d3480 00000100:00100000:2.0:1788270179.719992:0:47287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788270179.720001:0:47287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253344384:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788270179.721895:0:47287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2401:x1875136253344384:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 1885us (2792us total) trans 30064771147 rc 0/0 00000100:00100000:2.0:1788270179.721916:0:47287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00002000:00100000:2.0:1788270179.721927:0:47287:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xcd:0x0] (0->1023) req@ffff98c1534d3480 x1875136253344384/t30064771147(0) o4->bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49@192.168.201.42@tcp:595/0 lens 1512/448 e 0 to 0 dl 1788270190 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788270179.721945:0:47287:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c1534d3480 with x1875136253344384 ext(0->1023) 00002000:00010000:2.0:1788270179.721950:0:47287:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c1534d3480 00000100:00100000:0.0:1788270179.724124:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.724202:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344512 00000100:00100000:1.0:1788270179.724211:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344512 00000100:00100000:1.0:1788270179.724265:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 619 00000100:00100000:1.0:1788270179.724276:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+79:44307:x1875136253344512:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788270179.725475:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771524 is committed 00000004:00080000:3.0:1788270179.725487:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000020:00080000:3.0:1788270179.725597:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803851 batchid updated 00000100:00100000:1.0:1788270179.725599:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:3.0:1788270179.725613:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803851 00000100:00100000:1.0:1788270179.725616:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262704128:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788270179.725620:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803851 00000100:00100000:1.0:1788270179.725671:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788270179.725685:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725695:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725702:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725708:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725712:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725719:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725734:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff98c1429fb300) 00010000:00010000:0.0:1788270179.725737:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.725741:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725746:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0af14 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725765:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725771:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725776:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725781:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f800 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725784:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725790:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.725797:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44307:x1875136253344512:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 1522us (1677us total) trans 0 rc 0/0 00010000:00010000:0.0:1788270179.725797:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270179.725800:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.725802:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.725805:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 619 00010000:00010000:0.0:1788270179.725808:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0af1b lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725818:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725824:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725830:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725835:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725838:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725844:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725852:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270179.725854:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270179.725856:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725860:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0af4c lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725867:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725871:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725874:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725877:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168e00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725878:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725881:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725885:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1434d7b00) 00010000:00010000:0.0:1788270179.725887:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.725888:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725891:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168e00/0xc5f5d7a016e0afa7 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725901:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725908:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725911:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725914:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bac00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725915:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725918:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725922:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270179.725923:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.725925:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725927:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0afed lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725933:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725936:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725939:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725941:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725943:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725947:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725950:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270179.725951:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.725953:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725956:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b010 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725960:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725963:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725966:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725969:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500baa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725970:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725973:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725977:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270179.725978:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.725980:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725983:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b03a lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725988:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725991:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725994:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.725997:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.725998:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.726001:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.726005:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:0.0:1788270179.726006:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270179.726007:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.726010:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b0e9 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.727399:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262704128 00000100:00100000:2.0:1788270179.727408:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262704128 00000100:00100000:2.0:1788270179.727465:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788270179.727472:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262704128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788270179.727577:0:48230:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1788270179.727579:0:48230:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb mtime from disk: 0 -> 1788270179 00002000:00010000:2.0:1788270179.727581:0:48230:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788270179.727583:0:48230:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb ctime from disk: 1788270179 -> 1788270179 00002000:00010000:2.0:1788270179.727584:0:48230:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788270179.727631:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262704128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (1960us total) trans 30064771148 rc 0/0 00000100:00100000:2.0:1788270179.727636:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788270179.727680:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270179.727779:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000004:00080000:1.0:1788270179.727783:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1534d0700/2, rc 0, transno 30064771148 00000100:00100000:1.0:1788270179.727793:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262704128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788270179.727831:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344640 00000100:00100000:2.0:1788270179.727835:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344640 00000100:00100000:2.0:1788270179.727866:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:2.0:1788270179.727873:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+14:2403:x1875136253344640:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788270179.728955:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771148 is committed 00000001:00080000:1.0:1788270179.728963:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771147 is committed 00000100:00100000:2.0:1788270179.729299:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2403:x1875136253344640:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1423us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.729307:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:3.0:1788270179.730724:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.730783:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253344896 00000100:00100000:2.0:1788270179.730790:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253344896 00000100:00100000:2.0:1788270179.730830:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 620 00000100:00100000:2.0:1788270179.730839:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:44307:x1875136253344896:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.730888:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270179.730910:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b0fe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610234f expref: 49 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.730925:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:2.0:1788270179.730928:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270179.730950:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.730960:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.730967:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788270179.731109:0:46770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081b341f9 reply state 000000001304ffe0 transno 30064771525 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.731121:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.731128:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:2.0:1788270179.731130:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270179.731133:0:46770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270179.731213:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:44307:x1875136253344896:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 375us (493us total) trans 30064771525 rc 0/0 00000100:00100000:2.0:1788270179.731221:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 620 00000100:00100000:0.0:1788270179.733625:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.733688:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253345024 00000100:00100000:2.0:1788270179.733697:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253345024 00000100:00100000:2.0:1788270179.733742:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:2.0:1788270179.733749:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253345024:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788270179.733865:0:48231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:2.0:1788270179.733867:0:48231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb mtime from disk: 1788270179 -> 1788270179 00002000:00010000:2.0:1788270179.733869:0:48231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb atime from disk: 0 -> 1788270178 00002000:00010000:2.0:1788270179.733870:0:48231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb ctime from disk: 1788270179 -> 1788270179 00002000:00010000:2.0:1788270179.733872:0:48231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xcd:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788270179.733915:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253345024:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 167us (299us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1788270179.733920:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:0.0:1788270179.735133:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.735204:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253345280 00000100:00100000:2.0:1788270179.735210:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253345280 00000100:00100000:2.0:1788270179.735286:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 621 00000100:00100000:2.0:1788270179.735295:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:44307:x1875136253345280:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.735349:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.735366:0:45778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 50 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.735375:0:45778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.735406:0:45778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 50 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.735455:0:45778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 50 pid: 45777 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.735471:0:45778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262704256:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270179.735567:0:45778:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788270179.736751:0:45778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:45778:1875136262704256:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270179.736772:0:45778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270179.737005:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.737295:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253345408 00000100:00100000:1.0:1788270179.737302:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253345408 00010000:00010000:1.0:1788270179.737331:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 51 pid: 45777 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.737399:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:1.0:1788270179.737409:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:2401:x1875136253345408:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270179.737428:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270179.737433:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 51 pid: 45777 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.737442:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 51 pid: 45777 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.737457:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543c00/0xc5f5d7a016e0b0e2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102341 expref: 51 pid: 45777 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.737468:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:1.0:1788270179.737471:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.737477:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.737481:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.737500:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270179.737534:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2401:x1875136253345408:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 127us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.737541:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00010000:00010000:0.0:1788270179.737583:0:45778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737588:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737620:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737624:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737628:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737632:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.737635:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737639:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737645:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:0.0:1788270179.737647:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788270179.737649:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.737653:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b11a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270179.737680:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:44307:x1875136253345280:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 2388us (2551us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788270179.737686:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 621 00000100:00100000:3.0:1788270179.738788:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.738839:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253345536 00000100:00100000:2.0:1788270179.738845:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253345536 00000100:00100000:2.0:1788270179.738886:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:2.0:1788270179.738894:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253345536:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788270179.738925:0:48230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.738938:0:48230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.738945:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270179.738948:0:48230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788270179.738951:0:48230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.738971:0:48230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.738981:0:48230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.738991:0:48230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:48230:1875136262704384:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270179.739064:0:48230:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c275295cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270179.740623:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.740692:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253345664 00000100:00100000:1.0:1788270179.740700:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253345664 00010000:00010000:1.0:1788270179.740730:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 13 pid: 48231 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.740767:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788270179.740775:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253345664:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270179.740788:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270179.740809:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 13 pid: 48231 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.740822:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 13 pid: 48231 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.740844:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270179.740848:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788270179.740853:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.740863:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.740881:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270179.740926:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253345664:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 151us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.740934:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00010000:00010000:2.0:1788270179.741006:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b10c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610235d expref: 12 pid: 48231 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.741021:0:48230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:48230:1875136262704384:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270179.741141:0:48230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741152:0:48230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741160:0:48230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741180:0:48230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741201:0:48230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741209:0:48230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741222:0:48230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:2.0:1788270179.741226:0:48230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741235:0:48230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741246:0:48230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.741254:0:48230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aac72402/0xc5f5d7a016e0b121 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.741309:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253345536:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 2416us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.741317:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:3.0:1788270179.742629:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.742669:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253345920 00000100:00100000:1.0:1788270179.742677:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253345920 00000100:00100000:1.0:1788270179.742738:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 622 00000100:00100000:1.0:1788270179.742745:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+49:44307:x1875136253345920:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788270179.742804:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.742814:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.742821:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.742845:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.742854:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 49 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.742864:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262704512:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270179.742921:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c2489a6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788270179.744976:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.745024:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253346048 00000100:00100000:2.0:1788270179.745031:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253346048 00010000:00010000:2.0:1788270179.745092:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.745125:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:2.0:1788270179.745135:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2400:x1875136253346048:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788270179.745148:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270179.745155:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.745167:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.745197:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.745204:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 50 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.745213:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.745221:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.745228:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.745247:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788270179.745298:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2400:x1875136253346048:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 164us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270179.745305:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00010000:00010000:1.0:1788270179.745859:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0afe6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022fb expref: 49 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.745871:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262704512:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270179.745888:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.745894:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.745898:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.746030:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.746106:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.746119:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.746148:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 49 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.746158:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 49 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.746167:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262704640:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270179.746240:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c281216000 going to sleep for 11 seconds 00000100:00100000:1.0:1788270179.747609:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262704640:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270179.747631:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270179.747804:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.747861:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253346176 00000100:00100000:1.0:1788270179.747868:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253346176 00010000:00010000:1.0:1788270179.747896:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270179.747926:0:46531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:1.0:1788270179.747935:0:46531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+50:2401:x1875136253346176:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270179.747946:0:46531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270179.747952:0:46531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.747964:0:46531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.747982:0:46531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b0f0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102348 expref: 50 pid: 45778 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.747998:0:46531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:1.0:1788270179.748002:0:46531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.748011:0:46531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.748017:0:46531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.748244:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.748251:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.748251:0:46531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:2.0:1788270179.748338:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771526 00000001:00080000:2.0:1788270179.748547:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771527 00000100:00100000:1.0:1788270179.748557:0:46531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+51:2401:x1875136253346176:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 623us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.748565:0:46531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000001:00080000:2.0:1788270179.748582:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771528 00000100:00100000:2.0:1788270179.748650:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262704768:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270179.748689:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270179.748717:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c246ed8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788270179.748797:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262704768 00000100:00100000:1.0:1788270179.748801:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262704768 00000100:00100000:1.0:1788270179.748825:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788270179.748829:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262704768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270179.748889:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262704768:12345-0@lo:1000:mdt00_000.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.748895:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788270179.748912:0:45776:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771148 gen 2 00000004:00080000:2.0:1788270179.748918:0:45776:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1534d0700, transno 30064771148 00000100:00100000:2.0:1788270179.748934:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262704768:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788270179.749030:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771529 00000100:00100000:2.0:1788270179.749492:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262704896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788270179.749519:0:45776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270179.749573:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23900 going to sleep for 11 seconds 00000100:00100000:1.0:1788270179.749591:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262704896 00000100:00100000:1.0:1788270179.749596:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262704896 00000100:00100000:1.0:1788270179.749625:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788270179.749632:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:45776:x1875136262704896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788270179.749712:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45776:x1875136262704896:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (192us total) trans 30064771150 rc 0/0 00000100:00100000:1.0:1788270179.749719:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788270179.749735:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:45776:1875136262704896:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788270179.749761:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749767:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749772:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749775:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168c00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.749778:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749783:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749794:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:2.0:1788270179.749796:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270179.749799:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749802:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168c00/0xc5f5d7a016e0b12f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749818:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749821:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749824:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749827:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.749829:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749832:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749836:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.749837:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788270179.749841:0:45776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 52 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749846:0:45776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 52 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749851:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 52 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.749868:0:45776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 52 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270179.749875:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262705024:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788270179.749945:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c24bb23900 going to sleep for 11 seconds 00000100:00100000:2.0:1788270179.751474:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262705024:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788270179.751499:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751508:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542a00/0xc5f5d7a016e0b080 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751685:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751699:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751710:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751720:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751726:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751731:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751740:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.751744:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751751:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270179.751761:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:2.0:1788270179.751761:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.751763:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270179.751767:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751773:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b136 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751782:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751789:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751795:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751800:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270179.751802:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751808:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751820:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270179.751822:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788270179.751825:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270179.751831:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169400/0xc5f5d7a016e0b128 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270179.751874:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253346304 00000100:00100000:0.0:1788270179.751880:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253346304 00000100:00100000:0.0:1788270179.751927:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:0.0:1788270179.751937:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:44306:x1875136253346304:12345-192.168.201.42@tcp:49:lfs.0 00000100:00100000:0.0:1788270179.752068:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+53:44306:x1875136253346304:12345-192.168.201.42@tcp:49:lfs.0 Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270179.752075:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:2.0:1788270179.752370:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44307:x1875136253345920:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 9624us (9744us total) trans 30064771530 rc 0/0 00000100:00100000:2.0:1788270179.752379:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 622 00000020:00080000:2.0:1788270179.752382:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788270179.752472:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270179.752477:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270179.752892:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 4 00000040:00080000:1.0:1788270179.752898:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270179.754090:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.754166:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253346560 00000100:00100000:2.0:1788270179.754174:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253346560 00000100:00100000:2.0:1788270179.754233:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 623 00000100:00100000:2.0:1788270179.754242:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44306:x1875136253346560:12345-192.168.201.42@tcp:58:lfs.0 00000040:00080000:2.0:1788270179.754997:0:46770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].12, 136 off9824 00000100:00100000:2.0:1788270179.755381:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44306:x1875136253346560:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 1138us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270179.755389:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270179.755390:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 623 00000100:00100000:0.0:1788270179.755874:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253346816 00000100:00100000:0.0:1788270179.755880:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253346816 00000100:00100000:0.0:1788270179.755919:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:0.0:1788270179.755925:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276990850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+52:44307:x1875136253346816:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788270179.756148:0:49484:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x31:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788270179.756177:0:49484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771531 00010000:00010000:0.0:1788270179.756227:0:49484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.756244:0:49484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.756256:0:49484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.756266:0:49484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.756273:0:49484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.756280:0:49484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.756298:0:49484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788270179.756367:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276990850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:44307:x1875136253346816:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 441us (976us total) trans 30064771532 rc 0/0 00000100:00100000:0.0:1788270179.756375:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000020:00080000:0.0:1788270179.756378:0:49484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788270179.756510:0:47309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270179.756517:0:47309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.756535:0:47309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb200 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270179.756539:0:47309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.756547:0:47309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.756560:0:47309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:1.0:1788270179.756563:0:47309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270179.756567:0:47309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.756571:0:47309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b13d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 49484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270179.756580:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270179.756581:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270179.756582:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270179.758029:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270179.758095:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253347072 00000100:00100000:1.0:1788270179.758103:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253347072 00000100:00100000:1.0:1788270179.758143:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:1.0:1788270179.758197:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+54:44306:x1875136253347072:12345-192.168.201.42@tcp:35:lfs.500 00000100:00100000:1.0:1788270179.758374:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:44306:x1875136253347072:12345-192.168.201.42@tcp:35:lfs.500 Request processed in 223us (348us total) trans 30064771533 rc 0/0 00000100:00100000:1.0:1788270179.758380:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:3.0:1788270179.779393:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270179.779963:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253347200 00000100:00100000:0.0:1788270179.779975:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253347200 00000100:00100000:0.0:1788270179.780087:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 624 00000100:00100000:0.0:1788270179.780098:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+55:44309:x1875136253347200:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270179.780121:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270179.780141:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b144 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102364 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780219:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780233:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780244:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780258:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780265:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780271:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780340:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780348:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780355:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270179.780392:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 2048 00000004:00200000:0.0:1788270179.780397:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270179.780415:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780615:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780624:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780630:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780636:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780642:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500ba000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.780646:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780654:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780665:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270179.780668:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.780672:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780677:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba000/0xc5f5d7a016e0b14b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780688:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780694:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780700:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780706:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270179.780709:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780714:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780721:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270179.780724:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270179.780726:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780733:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b152 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780762:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b144 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102364 expref: 57 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780775:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102364 expref: 56 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270179.780781:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270179.780783:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270179.780785:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb600, rc 0) 00000100:00100000:0.0:1788270179.780848:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44309:x1875136253347200:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 752us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270179.780855:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 624 00010000:00010000:1.0:1788270179.781174:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270180.289908:0:51551:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270180.289917:0:51551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270180.289975:0:51551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270180.289983:0:51551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270180.548421:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270180.551982:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262705152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270180.552286:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270180.552398:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262705152 00000100:00100000:3.0:1788270180.552407:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262705152 00000100:00100000:3.0:1788270180.552555:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788270180.552566:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262705152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270180.552600:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270180.552660:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262705152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270180.552668:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788270180.552759:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262705152:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788270180.804521:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270180.804530:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270180.804560:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270180.804567:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270180.804690:0:45810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262705280:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788270180.804951:0:45810:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b82a780 going to sleep for 11 seconds 00010000:00010000:1.0:1788270180.804957:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270180.811581:0:45810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:45810:1875136262705280:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788270180.812985:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.813079:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253347328 00000100:00100000:2.0:1788270180.813087:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253347328 00000100:00100000:2.0:1788270180.813144:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 625 00000100:00100000:2.0:1788270180.813153:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44322:x1875136253347328:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788270180.813400:0:45776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788270180.813522:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44322:x1875136253347328:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 369us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270180.813531:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 625 00000100:00100000:3.0:1788270180.815660:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.815766:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253347584 00000100:00100000:2.0:1788270180.815785:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253347584 00000100:00100000:2.0:1788270180.815846:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 626 00000100:00100000:2.0:1788270180.815856:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+56:44322:x1875136253347584:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788270180.815875:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270180.815895:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b160 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610236b expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270180.815997:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b167 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270180.816013:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b167 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270180.816024:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b167 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270180.816036:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2f:0x0]: returning size 2048 00010000:00010000:2.0:1788270180.816488:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b160 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610236b expref: 59 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270180.816517:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b167 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610236b expref: 58 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270180.816526:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270180.816529:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270180.816533:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f400, rc 0) 00000100:00100000:2.0:1788270180.816636:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:44322:x1875136253347584:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 781us (983us total) trans 30064771534 rc 0/0 00000100:00100000:2.0:1788270180.816644:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 626 00000100:00100000:3.0:1788270180.822490:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270180.822642:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253347840 00000100:00100000:0.0:1788270180.822653:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253347840 00000100:00100000:0.0:1788270180.822713:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 627 00000100:00100000:0.0:1788270180.822724:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:44322:x1875136253347840:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788270180.822828:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.822845:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.822857:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823002:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823009:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823017:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823022:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270180.823066:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823074:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823087:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270180.823090:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270180.823095:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270180.823102:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b175 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270180.823623:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:44322:x1875136253347840:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 899us (1141us total) trans 30064771535 rc 0/0 00000100:00100000:0.0:1788270180.823631:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 627 00000040:00080000:1.0:1788270180.823965:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270180.823972:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270180.824521:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 5 00000040:00080000:1.0:1788270180.824531:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270180.825220:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270180.825631:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253347968 00000100:00100000:1.0:1788270180.825640:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253347968 00000100:00100000:1.0:1788270180.825694:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:1.0:1788270180.825705:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:2403:x1875136253347968:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788270180.825719:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788270180.825754:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b167 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610236b expref: 59 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270180.825786:0:45761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:1.0:1788270180.825791:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270180.825844:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:2403:x1875136253347968:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 141us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270180.825851:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788270180.827692:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270180.828466:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348224 00000100:00100000:0.0:1788270180.828473:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348224 00000100:00100000:0.0:1788270180.828517:0:49484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:0.0:1788270180.828524:0:49484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+58:44322:x1875136253348224:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788270180.828703:0:49484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:44322:x1875136253348224:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 179us (1032us total) trans 30064771536 rc 0/0 00000100:00100000:0.0:1788270180.828709:0:49484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:2.0:1788270180.871358:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.871448:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.871482:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.871520:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.871545:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.871565:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270180.871590:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348608 00000100:00100000:2.0:1788270180.871600:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348608 00000100:00100000:2.0:1788270180.871645:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348736 00000100:00100000:2.0:1788270180.871648:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348736 00000100:00100000:2.0:1788270180.871678:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788270180.871687:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253348608:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270180.871768:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253348608:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270180.871786:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788270180.871806:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:2.0:1788270180.871813:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253348736:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270180.871837:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253348736:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270180.871843:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:2.0:1788270180.871864:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348864 00000100:00100000:2.0:1788270180.871868:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348864 00000100:00100000:2.0:1788270180.871904:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348480 00000100:00100000:2.0:1788270180.871907:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348480 00000100:00100000:2.0:1788270180.871924:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348992 00000100:00100000:2.0:1788270180.871927:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348992 00000100:00100000:2.0:1788270180.871941:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 255 00000100:00100000:2.0:1788270180.871947:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253348864:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270180.871973:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253348864:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270180.871979:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 255 00000100:00100000:2.0:1788270180.871993:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:2.0:1788270180.871999:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253348480:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270180.872015:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 257 00000100:00100000:2.0:1788270180.872023:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253348480:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270180.872030:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253348992:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270180.872036:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:0.0:1788270180.872102:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253348992:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (535us total) trans 0 rc 0/0 00000100:00080000:2.0:1788270180.872110:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270180.872111:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 257 00000100:00080000:2.0:1788270180.872117:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270180.872121:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270180.876390:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253348352 00000100:00100000:3.0:1788270180.876407:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253348352 00000100:00100000:3.0:1788270180.876585:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:3.0:1788270180.876594:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253348352:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270180.876667:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253348352:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 74us (5320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270180.876672:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:1.0:1788270181.060259:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270181.060285:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262705408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270181.060674:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.060765:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262705408 00000100:00100000:0.0:1788270181.060773:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262705408 00000100:00080000:1.0:1788270181.060810:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270181.060838:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788270181.060851:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262705408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270181.060881:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270181.060940:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262705408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.060948:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788270181.061055:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270181.061067:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771176 gen 2 00000100:00100000:3.0:1788270181.061069:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262705536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270181.061101:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788270181.061118:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771175 committed transno 30064771176 00000004:00080000:1.0:1788270181.061143:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1534d3b80, transno 30064771176 00000100:00100000:1.0:1788270181.061177:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262705408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270181.061199:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262705536 00000100:00100000:1.0:1788270181.061203:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262705536 00000100:00100000:1.0:1788270181.061232:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788270181.061239:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262705536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270181.061250:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608059904 00000100:00100000:1.0:1788270181.061289:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262705536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270181.061295:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788270181.061399:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270181.061832:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270181.061843:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262705664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270181.061939:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270181.061982:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262705664 00000100:00100000:2.0:1788270181.061986:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262705664 00000100:00100000:2.0:1788270181.062022:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788270181.062029:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262705664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270181.062062:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270181.062096:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262705664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270181.062103:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788270181.062134:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262705664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270181.065803:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262706048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.065874:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.065911:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262706560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.065934:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.065955:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788270181.065960:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262706176:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066059:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066077:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262706688:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066097:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066128:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706048 00000100:00100000:0.0:1788270181.066136:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706048 00000100:00100000:0.0:1788270181.066205:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788270181.066214:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262706048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066264:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262706048:12345-0@lo:400:kworker.0 Request processed in 51us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066270:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788270181.066293:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262705920:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066315:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066331:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262706432:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066347:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066362:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788270181.066367:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262705792:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066390:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066412:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262706304:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066429:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066443:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262706816:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066462:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270181.066481:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706560 00000100:00100000:0.0:1788270181.066485:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706560 00000100:00100000:0.0:1788270181.066508:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706688 00000100:00100000:0.0:1788270181.066510:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706688 00000100:00100000:0.0:1788270181.066520:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262705920 00000100:00100000:0.0:1788270181.066522:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262705920 00000100:00100000:0.0:1788270181.066533:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706432 00000100:00100000:0.0:1788270181.066535:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706432 00000100:00100000:0.0:1788270181.066545:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706304 00000100:00100000:0.0:1788270181.066547:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706304 00000100:00100000:0.0:1788270181.066555:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706816 00000100:00100000:0.0:1788270181.066556:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706816 00000100:00100000:0.0:1788270181.066569:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788270181.066574:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262706560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066739:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262706560:12345-0@lo:400:kworker.0 Request processed in 114us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066747:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788270181.066762:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788270181.066768:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262706688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066796:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262706688:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066802:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788270181.066814:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788270181.066819:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262705920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066850:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262705920:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066856:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788270181.066868:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788270181.066874:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262706432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066897:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262706432:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066903:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788270181.066912:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788270181.066917:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262706304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066938:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262706304:12345-0@lo:400:kworker.0 Request processed in 21us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066943:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788270181.066952:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788270181.066958:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262706816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.066983:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262706816:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270181.066988:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788270181.067021:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262706688:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.067032:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262706048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.067064:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262706560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.067097:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262706304:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.067105:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262706816:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.067113:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262705920:0@lo:400:kworker.0 00000100:00100000:0.0:1788270181.067121:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788270181.067225:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262706176 00000100:00100000:2.0:1788270181.067230:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262706176 00000100:00100000:2.0:1788270181.067262:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788270181.067267:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262706176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270181.067301:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262706176:12345-0@lo:400:kworker.0 Request processed in 33us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270181.067302:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262705792 00000100:00100000:3.0:1788270181.067308:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262705792 00000100:00100000:2.0:1788270181.067310:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788270181.067346:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262706176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270181.067362:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788270181.067373:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262705792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270181.067397:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262705536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270181.067420:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262705792:12345-0@lo:400:kworker.0 Request processed in 50us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270181.067428:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788270181.067445:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262705792:0@lo:400:kworker.0 00000100:00080000:1.0:1788270181.068382:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270181.068390:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270181.068393:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270181.068395:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788270181.828270:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270181.859570:0:51602:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270181.859580:0:51602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270181.859614:0:51602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270181.859621:0:51602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270181.936431:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270181.936471:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253349248 00000100:00100000:0.0:1788270181.936480:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253349248 00000100:00080000:1.0:1788270181.936520:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270181.936548:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 628 00000100:00100000:0.0:1788270181.936558:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+59:44339:x1875136253349248:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270181.936580:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270181.936598:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b17c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102372 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270181.936679:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00010000:00010000:0.0:1788270181.936776:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b17c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102372 expref: 61 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270181.936792:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270181.936795:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788270181.936800:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b17c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102372 expref: 61 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270181.936814:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bbc00, rc 0) 00000100:00100000:0.0:1788270181.936871:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:44339:x1875136253349248:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 315us (446us total) trans 30064771537 rc 301/301 00000100:00100000:0.0:1788270181.936878:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 628 00000100:00100000:1.0:1788270181.938386:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270181.938425:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253349504 00000100:00100000:3.0:1788270181.938433:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253349504 00000100:00100000:3.0:1788270181.938482:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:3.0:1788270181.938491:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+60:44339:x1875136253349504:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788270181.938645:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:44339:x1875136253349504:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 155us (262us total) trans 30064771538 rc 0/0 00000100:00100000:3.0:1788270181.938653:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:2.0:1788270182.116229:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.116299:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253349632 00000100:00100000:0.0:1788270182.116310:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253349632 00000100:00100000:0.0:1788270182.116382:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 629 00000100:00100000:0.0:1788270182.116395:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:44366:x1875136253349632:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788270182.116422:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270182.116442:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102379 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.116509:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b191 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.116523:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b191 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.116535:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b191 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270182.116591:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000004:00200000:0.0:1788270182.116595:0:45778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270182.116615:0:45778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b191 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.116650:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102379 expref: 63 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.116671:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b191 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102379 expref: 62 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.116680:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270182.116682:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270182.116686:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bb000, rc 0) 00000100:00100000:0.0:1788270182.116765:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:44366:x1875136253349632:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 373us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270182.116772:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 629 00000100:00100000:2.0:1788270182.121785:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270182.121903:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253349888 00000100:00100000:3.0:1788270182.121913:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253349888 00000100:00100000:3.0:1788270182.121972:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 630 00000100:00100000:3.0:1788270182.121983:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:44366:x1875136253349888:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:3.0:1788270182.122056:0:46770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270182.122084:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0af29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022c3 expref: 62 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.122102:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270182.122108:0:46770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270182.122274:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:44366:x1875136253349888:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 292us (497us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788270182.122281:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 630 00000100:00100000:1.0:1788270182.144214:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.144378:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253350016 00000100:00100000:0.0:1788270182.144389:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253350016 00000100:00100000:0.0:1788270182.144443:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 631 00000100:00100000:0.0:1788270182.144454:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+61:44367:x1875136253350016:12345-192.168.201.42@tcp:101:chmod.0 00010000:00010000:0.0:1788270182.144472:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270182.144493:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102380 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.144553:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0b19f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.144566:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0b19f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.144578:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0b19f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270182.144620:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788270182.144625:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270182.144644:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0b19f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.144672:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102380 expref: 63 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.144691:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba200/0xc5f5d7a016e0b19f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102380 expref: 62 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.144699:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:0.0:1788270182.144702:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788270182.144706:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba200, rc 0) 00000100:00100000:0.0:1788270182.144758:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:44367:x1875136253350016:12345-192.168.201.42@tcp:101:chmod.0 Request processed in 306us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270182.144766:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 631 00000100:00100000:2.0:1788270182.146540:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.146584:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253350272 00000100:00100000:0.0:1788270182.146591:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253350272 00000100:00100000:0.0:1788270182.146636:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 632 00000100:00100000:0.0:1788270182.146645:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:44367:x1875136253350272:12345-192.168.201.42@tcp:36:chmod.0 00010000:00010000:0.0:1788270182.146680:0:45778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788270182.146701:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b191 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102379 expref: 62 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.146722:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168a00/0xc5f5d7a016e0af68 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561022d1 expref: 61 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.146838:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429fbf00) 00010000:00010000:0.0:1788270182.146849:0:45778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270182.146870:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.146881:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.146891:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270182.147062:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ac9fbe3 reply state 00000000a047a352 transno 30064771539 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.147075:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.147083:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270182.147086:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788270182.147088:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788270182.147094:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000100:00100000:0.0:1788270182.147166:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:44367:x1875136253350272:12345-192.168.201.42@tcp:36:chmod.0 Request processed in 521us (632us total) trans 30064771539 rc 0/0 00000100:00100000:0.0:1788270182.147174:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 632 00000100:00100000:2.0:1788270182.154577:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270182.154631:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253350400 00000100:00100000:3.0:1788270182.154641:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253350400 00000100:00100000:3.0:1788270182.154691:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 633 00000100:00100000:3.0:1788270182.154702:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+62:44368:x1875136253350400:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:3.0:1788270182.154728:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270182.154747:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b1ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102387 expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154817:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154830:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154841:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154856:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154863:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154869:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154934:0:46770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0b1c2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154940:0:46770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0b1c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.154945:0:46770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0b1c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270182.154970:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000004:00200000:3.0:1788270182.154973:0:46770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788270182.156392:0:46770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0b1c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156415:0:46770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156424:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156430:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156439:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156445:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543a00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270182.156449:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156456:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156473:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270182.156476:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270182.156479:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156485:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543a00/0xc5f5d7a016e0b1b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156502:0:46770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156507:0:46770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156513:0:46770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156518:0:46770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241543200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:3.0:1788270182.156520:0:46770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156527:0:46770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156535:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff98c1429f7700) 00010000:00010000:3.0:1788270182.156537:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788270182.156540:0:46770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156545:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241543200/0xc5f5d7a016e0b1bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156585:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b1ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102387 expref: 64 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156607:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542600/0xc5f5d7a016e0b1c2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102387 expref: 63 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.156615:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:3.0:1788270182.156618:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788270182.156620:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241542600, rc 0) 00000100:00100000:3.0:1788270182.156693:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:44368:x1875136253350400:12345-192.168.201.42@tcp:101:rm.0 Request processed in 1992us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270182.156701:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 633 00000100:00100000:1.0:1788270182.161662:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.162728:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253350528 00000100:00100000:2.0:1788270182.162739:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253350528 00000100:00080000:1.0:1788270182.162794:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270182.162827:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:2.0:1788270182.162840:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253350528:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:2.0:1788270182.162858:0:47283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.162879:0:47283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610238e expref: -99 pid: 47283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788270182.162906:0:47283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xcd:0x0] initial LVB size: 1024, mtime: 0x6a96d663, atime: 0x6a96d662, ctime: 0x6a96d663, blocks: 0x8 00010000:00010000:2.0:1788270182.162926:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=973s v=(0 0) 00010000:00010000:2.0:1788270182.162931:0:47283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788270182.162941:0:47283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 12 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.162957:0:47283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 12 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.162971:0:47283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418ec00, rc 0) 00000100:00100000:2.0:1788270182.163032:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+12:2401:x1875136253350528:12345-192.168.201.42@tcp:101:rm.0 Request processed in 195us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270182.163064:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:2.0:1788270182.167004:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.167194:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253350784 00000100:00100000:0.0:1788270182.167205:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253350784 00000100:00100000:0.0:1788270182.167253:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 634 00000100:00100000:0.0:1788270182.167263:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:44368:x1875136253350784:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:0.0:1788270182.167318:0:48110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788270182.167345:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b159 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102364 expref: 63 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167368:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150168600/0xc5f5d7a016e0b087 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610232c expref: 62 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167379:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.167390:0:48110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788270182.167414:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167427:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167437:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167455:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167463:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167469:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167550:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167559:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167566:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788270182.167753:0:48110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].18, 64 off9536 00000004:00080000:0.0:1788270182.167763:0:48110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 973874722846ns, next at 974874720407ns, rc = 0 00010000:00010000:0.0:1788270182.167803:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167811:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167819:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167826:0:48110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167835:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167842:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167865:0:48110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788270182.167882:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167889:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167895:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167901:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270182.167906:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167913:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167921:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2500) 00010000:00010000:0.0:1788270182.167924:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788270182.167927:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167933:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1de lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167951:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167957:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167962:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167967:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270182.167970:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167975:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167982:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270182.167984:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270182.167987:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.167992:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1d0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270182.168002:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6bba462 reply state 00000000372d34a9 transno 30064771540 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.168012:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.168019:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:0.0:1788270182.168021:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270182.168024:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788270182.168134:0:45764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788270182.168149:0:45764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270182.168159:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:44368:x1875136253350784:12345-192.168.201.42@tcp:36:rm.0 Request processed in 894us (1160us total) trans 30064771540 rc 0/0 00010000:00010000:1.0:1788270182.168160:0:45764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bac00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:1.0:1788270182.168167:0:45764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270182.168174:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 634 00010000:00010000:1.0:1788270182.168180:0:45764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.168191:0:45764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2f:0x0].0x0 (ffff98c1429f2500) 00010000:00010000:1.0:1788270182.168194:0:45764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788270182.168198:0:45764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.168203:0:45764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bac00/0xc5f5d7a016e0b1e5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.168220:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270182.168222:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270182.168224:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270182.192428:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.192495:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253351040 00000100:00100000:0.0:1788270182.192504:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253351040 00000100:00100000:0.0:1788270182.192574:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 635 00000100:00100000:0.0:1788270182.192586:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+63:44374:x1875136253351040:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270182.192609:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270182.192630:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1ec lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b8656102395 expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.192754:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.192768:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.192779:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.192790:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.192796:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.192802:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193235:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193254:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193263:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270182.193273:0:45778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 0 00010000:00010000:0.0:1788270182.193297:0:45778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193305:0:45778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193311:0:45778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193317:0:45778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bae00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270182.193321:0:45778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193328:0:45778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193340:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270182.193343:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270182.193348:0:45778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193357:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b1f3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788270182.193368:0:45778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000641bad43 reply state 000000007bdb9226 transno 30064771541 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193375:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193379:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:0.0:1788270182.193381:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788270182.193383:0:45778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788270182.193407:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b1ec lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 66 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193421:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 65 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.193428:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.193430:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788270182.193432:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500ba400, rc 0) 00000100:00100000:0.0:1788270182.193491:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:44374:x1875136253351040:12345-192.168.201.42@tcp:101:dd.500 Request processed in 907us (1070us total) trans 30064771541 rc 0/0 00000100:00100000:0.0:1788270182.193499:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 635 00000100:00100000:3.0:1788270182.195737:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.196310:0:49484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253351296 00000100:00100000:0.0:1788270182.196319:0:49484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253351296 00000100:00100000:2.0:1788270182.196428:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788270182.196442:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+66:44374:x1875136253351296:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:2.0:1788270182.196735:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:44374:x1875136253351296:12345-192.168.201.42@tcp:35:dd.500 Request processed in 296us (1004us total) trans 30064771542 rc 0/0 00000100:00100000:2.0:1788270182.196742:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788270182.247947:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270182.248089:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253351552 00000100:00100000:3.0:1788270182.248099:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253351552 00000100:00100000:3.0:1788270182.248166:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 636 00000100:00100000:3.0:1788270182.248175:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+67:44384:x1875136253351552:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788270182.248196:0:46770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788270182.248212:0:46770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b20f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b865610239c expref: -99 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270182.248291:0:46770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00010000:00010000:3.0:1788270182.248377:0:46770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b20f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610239c expref: 69 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.248389:0:46770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c1429f8200) 00010000:00010000:3.0:1788270182.248391:0:46770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788270182.248395:0:46770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b20f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610239c expref: 69 pid: 46770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.248406:0:46770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241542000, rc 0) 00000100:00100000:3.0:1788270182.248461:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:44384:x1875136253351552:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 287us (525us total) trans 30064771543 rc 301/301 00000100:00100000:3.0:1788270182.248467:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 636 00000100:00100000:3.0:1788270182.250079:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270182.250150:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253351808 00000100:00100000:1.0:1788270182.250158:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253351808 00000100:00100000:1.0:1788270182.250204:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:1.0:1788270182.250213:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+68:44384:x1875136253351808:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788270182.250494:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:44384:x1875136253351808:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 281us (420us total) trans 30064771544 rc 0/0 00000100:00100000:1.0:1788270182.250501:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:3.0:1788270182.300984:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.301180:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253352064 00000100:00100000:0.0:1788270182.301190:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253352064 00000100:00100000:0.0:1788270182.301327:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 637 00000100:00100000:0.0:1788270182.301339:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+69:44390:x1875136253352064:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:0.0:1788270182.301366:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270182.301388:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b21d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023a3 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.301512:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b224 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.301527:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b224 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.301541:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b224 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270182.301553:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 0 00010000:00010000:0.0:1788270182.301660:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b21d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023a3 expref: 72 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.301679:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b224 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023a3 expref: 71 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.301689:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.301692:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270182.301696:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500bae00, rc 0) 00000100:00100000:0.0:1788270182.301758:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44390:x1875136253352064:12345-192.168.201.42@tcp:101:dd.500 Request processed in 422us (782us total) trans 30064771545 rc 0/0 00000100:00100000:0.0:1788270182.301775:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 637 00000100:00100000:2.0:1788270182.303370:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.303412:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253352320 00000100:00100000:0.0:1788270182.303419:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253352320 00000100:00100000:0.0:1788270182.303466:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:0.0:1788270182.303476:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276991850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+71:44390:x1875136253352320:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:0.0:1788270182.303638:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276991850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44390:x1875136253352320:12345-192.168.201.42@tcp:35:dd.500 Request processed in 158us (266us total) trans 30064771546 rc 0/0 00000100:00100000:0.0:1788270182.303646:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:3.0:1788270182.334941:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.335001:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253352448 00000100:00100000:0.0:1788270182.335010:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253352448 00000100:00100000:0.0:1788270182.335240:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 638 00000100:00100000:0.0:1788270182.335251:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+72:44396:x1875136253352448:12345-192.168.201.42@tcp:101:truncate.500 00010000:00010000:0.0:1788270182.335275:0:45778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788270182.335296:0:45778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b232 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023aa expref: -99 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.335333:0:45778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b239 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.335348:0:45778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b239 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.335358:0:45778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b239 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.335472:0:45778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb000/0xc5f5d7a016e0b232 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023aa expref: 74 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.335498:0:45778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500baa00/0xc5f5d7a016e0b239 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023aa expref: 73 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.335508:0:45778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.335511:0:45778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788270182.335513:0:45778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1500baa00, rc 0) 00000100:00100000:0.0:1788270182.335569:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44396:x1875136253352448:12345-192.168.201.42@tcp:101:truncate.500 Request processed in 320us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270182.335576:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 638 00000100:00100000:3.0:1788270182.340869:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.341352:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253352704 00000100:00100000:2.0:1788270182.341363:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253352704 00000100:00100000:2.0:1788270182.341430:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 639 00000100:00100000:2.0:1788270182.341440:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+73:44396:x1875136253352704:12345-192.168.201.42@tcp:36:truncate.500 00010000:00010000:2.0:1788270182.341493:0:45776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788270182.341521:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bae00/0xc5f5d7a016e0b224 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023a3 expref: 73 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.341542:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270182.341547:0:45776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788270182.341721:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.341736:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.341747:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270182.341789:0:45776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771547 00000004:00010000:2.0:1788270182.341811:0:45776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf72b01b reply state 00000000a17942fc transno 30064771548 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.341827:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.341833:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270182.341835:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270182.341837:0:45776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270182.341927:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+75:44396:x1875136253352704:12345-192.168.201.42@tcp:36:truncate.500 Request processed in 488us (1068us total) trans 30064771548 rc 0/0 00000100:00100000:2.0:1788270182.341934:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 639 00000020:00080000:2.0:1788270182.341939:0:45776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788270182.387858:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.387990:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253352832 00000100:00100000:0.0:1788270182.387999:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253352832 00000100:00100000:1.0:1788270182.388314:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 640 00000100:00100000:1.0:1788270182.388324:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+75:44402:x1875136253352832:12345-192.168.201.42@tcp:101:truncate.500 00010000:00010000:1.0:1788270182.388352:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788270182.388368:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0b247 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023b1 expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388418:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388428:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388436:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388443:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388451:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388454:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388527:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388533:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388536:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788270182.388567:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 256 00000004:00200000:1.0:1788270182.388572:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788270182.388593:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388604:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388612:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388616:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388620:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388635:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270182.388638:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388643:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388652:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:1.0:1788270182.388654:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270182.388657:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388660:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169200/0xc5f5d7a016e0b24e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388670:0:48110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388673:0:48110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388677:0:48110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388680:0:48110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150169000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:1.0:1788270182.388682:0:48110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388685:0:48110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388691:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:1.0:1788270182.388693:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788270182.388695:0:48110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388698:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169000/0xc5f5d7a016e0b255 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388715:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169a00/0xc5f5d7a016e0b247 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023b1 expref: 77 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388723:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023b1 expref: 76 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.388729:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:1.0:1788270182.388731:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788270182.388734:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c150169800, rc 0) 00000100:00100000:1.0:1788270182.388795:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+76:44402:x1875136253352832:12345-192.168.201.42@tcp:101:truncate.500 Request processed in 472us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270182.388802:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 640 00000100:00100000:3.0:1788270182.392852:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.392966:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253353088 00000100:00100000:2.0:1788270182.392977:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253353088 00000100:00100000:3.0:1788270182.393182:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 641 00000100:00100000:3.0:1788270182.393195:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+76:44402:x1875136253353088:12345-192.168.201.42@tcp:36:truncate.500 00010000:00010000:3.0:1788270182.393246:0:45777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270182.393274:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c150169800/0xc5f5d7a016e0b25c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023b1 expref: 76 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.393293:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270182.393298:0:45777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788270182.393462:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.393476:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.393485:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788270182.393530:0:45777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771549 00000004:00010000:3.0:1788270182.393551:0:45777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004424dc97 reply state 000000009fb30bb3 transno 30064771550 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.393563:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.393569:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270182.393571:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788270182.393573:0:45777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788270182.393665:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:44402:x1875136253353088:12345-192.168.201.42@tcp:36:truncate.500 Request processed in 473us (822us total) trans 30064771550 rc 0/0 00000100:00100000:3.0:1788270182.393672:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 641 00000020:00080000:3.0:1788270182.393677:0:45777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270182.444328:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.444455:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253353344 00000100:00100000:2.0:1788270182.444465:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253353344 00000100:00100000:2.0:1788270182.444537:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 642 00000100:00100000:2.0:1788270182.444548:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+78:44408:x1875136253353344:12345-192.168.201.42@tcp:101:dd.500 00010000:00010000:2.0:1788270182.444570:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.444590:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b26a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023b8 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444763:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444778:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444788:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444814:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444823:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444829:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444880:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b27f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444889:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b27f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444896:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b27f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270182.444906:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 2048 00010000:00010000:2.0:1788270182.444980:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444988:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.444994:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445001:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445008:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270182.445012:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445019:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445031:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:2.0:1788270182.445034:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270182.445071:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445079:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b271 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445092:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445096:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445099:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445102:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418e400 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:2.0:1788270182.445111:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445117:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445124:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:2.0:1788270182.445126:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788270182.445130:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445146:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b278 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445184:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b26a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023b8 expref: 81 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445199:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b27f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023b8 expref: 80 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.445204:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270182.445206:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788270182.445208:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270182.445273:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:44408:x1875136253353344:12345-192.168.201.42@tcp:101:dd.500 Request processed in 726us (954us total) trans 30064771551 rc 0/0 00000100:00100000:2.0:1788270182.445279:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 642 00000100:00100000:2.0:1788270182.449960:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.450017:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253353472 00000100:00100000:0.0:1788270182.450027:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253353472 00000100:00100000:2.0:1788270182.450072:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.450123:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253353728 00000100:00100000:2.0:1788270182.450128:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253353728 00000100:00100000:0.0:1788270182.450130:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:0.0:1788270182.450157:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:2403:x1875136253353472:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270182.450174:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788270182.450179:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 643 00000100:00100000:2.0:1788270182.450189:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+81:44408:x1875136253353728:12345-192.168.201.42@tcp:36:dd.500 00010000:00010000:0.0:1788270182.450202:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b27f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023b8 expref: 81 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.450226:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.450230:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270182.450331:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+80:2403:x1875136253353472:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 179us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270182.450339:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00010000:00010000:2.0:1788270182.450408:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.450422:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.450437:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788270182.450480:0:48110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771552 00000004:00010000:2.0:1788270182.450502:0:48110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efc8dffa reply state 00000000d61bfbee transno 30064771553 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.450515:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.450521:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270182.450524:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788270182.450526:0:48110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788270182.450595:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+82:44408:x1875136253353728:12345-192.168.201.42@tcp:36:dd.500 Request processed in 407us (523us total) trans 30064771553 rc 0/0 00000100:00100000:2.0:1788270182.450603:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 643 00000020:00080000:2.0:1788270182.450607:0:48110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788270182.451692:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270182.451745:0:45780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253353984 00000100:00100000:1.0:1788270182.451752:0:45780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253353984 00000100:00100000:1.0:1788270182.451796:0:45780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:1.0:1788270182.451805:0:45780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+82:44408:x1875136253353984:12345-192.168.201.42@tcp:35:dd.500 00000100:00100000:1.0:1788270182.451955:0:45780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+83:44408:x1875136253353984:12345-192.168.201.42@tcp:35:dd.500 Request processed in 151us (266us total) trans 30064771554 rc 0/0 00000100:00100000:1.0:1788270182.451960:0:45780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:3.0:1788270182.490602:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.492026:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253354240 00000100:00100000:2.0:1788270182.492036:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253354240 00000100:00100000:2.0:1788270182.492116:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 644 00000100:00100000:2.0:1788270182.492128:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+83:44418:x1875136253354240:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270182.492161:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.492187:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023bf expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.492284:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b29b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.492298:0:45777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b29b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.492310:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b29b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270182.492321:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00010000:00010000:2.0:1788270182.492418:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023bf expref: 86 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.492437:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418e400/0xc5f5d7a016e0b29b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023bf expref: 85 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.492446:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:2.0:1788270182.492449:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788270182.492452:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418e400, rc 0) 00000100:00100000:2.0:1788270182.492517:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+85:44418:x1875136253354240:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 391us (1922us total) trans 30064771555 rc 0/0 00000100:00100000:2.0:1788270182.492524:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 644 00000100:00100000:3.0:1788270182.532194:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.532305:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253354368 00000100:00100000:2.0:1788270182.532316:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253354368 00000100:00100000:2.0:1788270182.532374:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 645 00000100:00100000:2.0:1788270182.532385:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+85:44424:x1875136253354368:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270182.532408:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.532428:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023c6 expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.532485:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b2b0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.532499:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b2b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.532507:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b2b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270182.532541:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 4096 00000004:00200000:2.0:1788270182.532544:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270182.532558:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b2b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.532576:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023c6 expref: 87 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.532596:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fc00/0xc5f5d7a016e0b2b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023c6 expref: 86 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.532604:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:2.0:1788270182.532607:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788270182.532611:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418fc00, rc 0) 00000100:00100000:2.0:1788270182.532711:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+86:44424:x1875136253354368:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 327us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270182.532718:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 645 00000100:00100000:3.0:1788270182.540828:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.540997:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253354496 00000100:00100000:2.0:1788270182.541008:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253354496 00000100:00100000:2.0:1788270182.541093:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 646 00000100:00100000:2.0:1788270182.541104:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+86:44424:x1875136253354496:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270182.541124:0:48110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.541157:0:48110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2b7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023cd expref: -99 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541222:0:48110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541237:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541247:0:48110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788270182.541292:0:48110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 0 00000004:00200000:2.0:1788270182.541296:0:48110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788270182.541314:0:48110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541325:0:48110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541345:0:48110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2b7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 88 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541365:0:48110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 87 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.541373:0:48110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:2.0:1788270182.541376:0:48110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788270182.541380:0:48110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f200, rc 0) 00000100:00100000:2.0:1788270182.541438:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+87:44424:x1875136253354496:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 336us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270182.541448:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 646 00000100:00100000:3.0:1788270182.549377:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.549618:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253354752 00000100:00100000:2.0:1788270182.549629:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253354752 00000100:00100000:2.0:1788270182.549694:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 647 00000100:00100000:2.0:1788270182.549705:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+87:44424:x1875136253354752:12345-192.168.201.42@tcp:101:lfs.500 00010000:00010000:2.0:1788270182.549724:0:45777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.549744:0:45777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2c5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023d4 expref: -99 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.549883:0:45777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.549898:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 88 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.549905:0:45777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 88 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.549912:0:45777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 5/0,1 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.549943:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 88 pid: 48110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.549955:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 88 pid: 48110 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270182.549967:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262706944:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270182.550083:0:45777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 88 pid: 45778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.550092:0:45777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 88 pid: 45778 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270182.550101:0:45777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262707072:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270182.550128:0:45777:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c25e4ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1788270182.552027:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262706944:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270182.552062:0:45777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:45777:1875136262707072:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788270182.552085:0:45777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270182.552142:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270182.552172:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270182.552207:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253354880 00000100:00100000:1.0:1788270182.552215:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253354880 00010000:00010000:1.0:1788270182.552255:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 89 pid: 48110 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270182.552375:0:46531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355008 00000100:00100000:1.0:1788270182.552380:0:46531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355008 00010000:00010000:1.0:1788270182.552397:0:46531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 90 pid: 45778 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270182.553487:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:3.0:1788270182.553502:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+90:2400:x1875136253354880:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270182.553515:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270182.553523:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 90 pid: 48110 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553542:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 90 pid: 48110 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553563:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2be lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023cd expref: 90 pid: 48110 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553581:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270182.553631:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553640:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553647:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270182.553761:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+89:2400:x1875136253354880:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 263us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270182.553769:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:3.0:1788270182.553791:0:45762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:3.0:1788270182.553798:0:45762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+88:2400:x1875136253355008:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788270182.553806:0:45762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788270182.553811:0:45762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 88 pid: 45778 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553820:0:45762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 88 pid: 45778 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553837:0:45762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500ba400/0xc5f5d7a016e0b201 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b8656102395 expref: 88 pid: 45778 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553848:0:45762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270182.553851:0:45762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553859:0:45762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553865:0:45762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553887:0:45762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788270182.553906:0:45762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+87:2400:x1875136253355008:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 109us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270182.553912:0:45762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00010000:00010000:3.0:1788270182.553933:0:45777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.553939:0:45777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788270182.553958:0:45777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 0 00010000:00010000:3.0:1788270182.554104:0:45777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2c5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 88 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.554119:0:45777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 87 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270182.554131:0:45777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:3.0:1788270182.554143:0:45777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788270182.554146:0:45777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c14418f800, rc 0) 00000100:00100000:3.0:1788270182.554169:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+87:44424:x1875136253354752:12345-192.168.201.42@tcp:101:lfs.500 Request processed in 4468us (4803us total) trans 30064771556 rc 0/0 00000100:00100000:3.0:1788270182.554176:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 647 00000100:00100000:3.0:1788270182.574601:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.574703:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355136 00000100:00100000:2.0:1788270182.574711:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355136 00000100:00100000:2.0:1788270182.574769:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 648 00000100:00100000:2.0:1788270182.574777:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+87:44426:x1875136253355136:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788270182.574796:0:45776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788270182.574814:0:45776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b2da lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbbf3b86561023db expref: -99 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574865:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574875:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574886:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574892:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574897:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574901:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574964:0:45776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574974:0:45776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 88 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.574981:0:45776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.575011:0:45776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 88 pid: 45777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788270182.575024:0:45776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 88 pid: 45777 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270182.575062:0:45776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262707200:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788270182.575192:0:45776:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c25e4ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788270182.579865:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270182.580063:0:45779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355392 00000100:00100000:2.0:1788270182.580071:0:45779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355392 00000100:00100000:2.0:1788270182.580119:0:45779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:2.0:1788270182.580126:0:45779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+89:33917:x1875136253355392:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788270182.580324:0:45779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+90:33917:x1875136253355392:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 198us (467us total) trans 30064771557 rc 0/0 00000100:00100000:2.0:1788270182.580330:0:45779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:0.0:1788270182.580691:0:45776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:45776:1875136262707200:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788270182.580713:0:45776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788270182.582358:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270182.582694:0:48804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355520 00000100:00100000:0.0:1788270182.582701:0:48804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355520 00010000:00010000:0.0:1788270182.582732:0:48804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 90 pid: 45777 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270182.582924:0:48804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:0.0:1788270182.582935:0:48804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+90:2400:x1875136253355520:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270182.582949:0:48804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270182.582956:0:48804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 90 pid: 45777 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.582969:0:48804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 90 pid: 45777 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.582989:0:48804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f800/0xc5f5d7a016e0b2cc lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023d4 expref: 90 pid: 45777 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.583007:0:48804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.583012:0:48804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.583022:0:48804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.583029:0:48804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270182.589777:0:48804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788270182.589862:0:48804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+89:2400:x1875136253355520:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 6922us (7500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270182.589875:0:48804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00010000:00010000:0.0:1788270182.592803:0:45776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592815:0:45776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788270182.592902:0:45776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x33:0x0]: returning size 0 00000004:00200000:0.0:1788270182.592906:0:45776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788270182.592922:0:45776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592935:0:45776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592943:0:45776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592948:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 4/1,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592952:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592956:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592960:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270182.592963:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592967:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592978:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270182.592980:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270182.592983:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592987:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f000/0xc5f5d7a016e0b2e1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.592998:0:45776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593001:0:45776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593004:0:45776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593008:0:45776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270182.593010:0:45776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593013:0:45776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593017:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:0.0:1788270182.593018:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270182.593020:0:45776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593023:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f200/0xc5f5d7a016e0b2e8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593102:0:45776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f400/0xc5f5d7a016e0b2da lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023db expref: 89 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593113:0:45776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c143b9e800/0xc5f5d7a016e0b2ef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b86561023db expref: 88 pid: 45776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270182.593119:0:45776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270182.593120:0:45776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788270182.593122:0:45776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c143b9e800, rc 0) 00000100:00100000:0.0:1788270182.593191:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+88:44426:x1875136253355136:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 18414us (18596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270182.593200:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 648 00010000:00010000:0.0:1788270182.852297:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270183.100597:0:51654:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270183.100607:0:51654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270183.100642:0:51654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270183.100647:0:51654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270183.108320:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262707328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270183.108395:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270183.108609:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262707328 00000100:00100000:1.0:1788270183.108617:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262707328 00000100:00080000:2.0:1788270183.108657:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270183.108677:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788270183.108686:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262707328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270183.108712:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839606784 avail 3608084480 00000100:00100000:1.0:1788270183.108755:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262707328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270183.108762:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788270183.108791:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262707328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270183.622438:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270183.622472:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262707456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270183.622541:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270183.622689:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262707456 00000100:00100000:3.0:1788270183.622698:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262707456 00000100:00100000:3.0:1788270183.622751:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788270183.622760:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262707456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270183.622794:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270183.622852:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262707456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270183.622860:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788270183.622902:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262707456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270183.876448:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270184.540216:0:51706:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270184.540226:0:51706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270184.540259:0:51706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270184.540263:0:51706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270184.900260:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788270185.159339:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771150 is committed 00000001:00080000:1.0:1788270185.159352:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771149 is committed 00000001:00080000:2.0:1788270185.159599:0:45756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771557 is committed 00000004:00080000:2.0:1788270185.159631:0:45756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00010000:00010000:0.0:1788270185.159809:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159822:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159831:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159837:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fe00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.159842:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159849:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159872:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff98c1429f7200) 00010000:00010000:0.0:1788270185.159874:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270185.159879:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159885:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fe00/0xc5f5d7a016e0b113 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159917:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159924:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159929:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159934:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb200 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.159937:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159943:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159951:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff98c1429f2d00) 00010000:00010000:0.0:1788270185.159953:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788270185.159956:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159961:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb200/0xc5f5d7a016e0b1a6 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159976:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159983:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159987:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.159992:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bbc00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.159995:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160000:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160007:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:0.0:1788270185.160010:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270185.160012:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160018:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bbc00/0xc5f5d7a016e0b1d7 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160027:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160033:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160099:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160106:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1500bb600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.160109:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160115:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160125:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0xde1ac1b8 (ffff98c1429f2300) 00010000:00010000:0.0:1788270185.160128:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270185.160130:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160136:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1500bb600/0xc5f5d7a016e0b1fa lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x2e:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160154:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160160:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160166:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160170:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418fa00 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.160173:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160178:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160190:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270185.160192:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270185.160194:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160200:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418fa00/0xc5f5d7a016e0b240 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 45776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160210:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160216:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160221:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160226:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241542000 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.160229:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160235:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160242:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270185.160244:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270185.160246:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160252:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241542000/0xc5f5d7a016e0b263 lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160267:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160273:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160278:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160282:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c14418f600 already unused, calling callback (ffffffffc1aac4f0) 00010000:00010000:0.0:1788270185.160285:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160291:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160299:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x33:0x0].0x0 (ffff98c1429f2600) 00010000:00010000:0.0:1788270185.160301:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788270185.160304:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 2/0,0 mode: --/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.160309:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c14418f600/0xc5f5d7a016e0b28d lrc: 0/0,0 mode: --/TXN res: [0x2000032e1:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 48110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788270185.160395:0:45756:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c246ed8000 refcount 2 committed 0 result 0 batchid 25769803852 00000020:00080000:2.0:1788270185.160400:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c25e977d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c246ed8e40 00000020:00080000:2.0:1788270185.160404:0:45756:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c25e977b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c27696f200 00000020:00080000:3.0:1788270185.160523:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803852 committed batchid 25769803851 00000020:00080000:3.0:1788270185.160596:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803851 00000100:00100000:2.0:1788270185.160652:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270185.160671:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262707584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788270185.160733:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270185.160881:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262707584 00000100:00100000:1.0:1788270185.160889:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262707584 00000100:00100000:1.0:1788270185.160952:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788270185.160961:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262707584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788270185.160985:0:47281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:205 count 1 00010000:00010000:1.0:1788270185.161006:0:47281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.161025:0:47281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 10 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.161034:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788270185.161061:0:47281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788270185.161066:0:47281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.161107:0:47281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 10 pid: 47283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.161120:0:47281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 10 pid: 47283 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788270185.161132:0:47281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:47281:1875136262707712:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788270185.161182:0:47281:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c27b53cf00 going to sleep for 11 seconds 00000100:00080000:2.0:1788270185.161274:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270185.165247:0:47281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:47281:1875136262707712:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788270185.165277:0:47281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788270185.166569:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270185.166654:0:45761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355648 00000100:00100000:0.0:1788270185.166662:0:45761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355648 00010000:00010000:0.0:1788270185.166723:0:45761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 11 pid: 47283 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788270185.166764:0:45761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:0.0:1788270185.166775:0:45761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+11:2401:x1875136253355648:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788270185.166789:0:45761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788270185.166796:0:45761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 11 pid: 47283 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.166809:0:45761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 11 pid: 47283 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.166834:0:45761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6bd7cb7/0xc5f5d7a016e0b1c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.42@tcp remote: 0xbbbf3b865610238e expref: 11 pid: 47283 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.166853:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270185.166857:0:45761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788270185.166863:0:45761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.166873:0:45761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788270185.166914:0:45761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788270185.166967:0:45761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253355648:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 193us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270185.166986:0:45761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00010000:00010000:1.0:1788270185.166996:0:47281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.167007:0:47281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.167015:0:47281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.167020:0:47281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788270185.167165:0:47281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788270185.167173:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270185.167343:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262707584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6382us (6609us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788270185.167352:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788270185.167428:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771150 gen 2 00000004:00080000:2.0:1788270185.167434:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771150 committed transno 30064771150 00000100:00100000:2.0:1788270185.167457:0:3609:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c1534d3100 x1875136262707584/t30064771151(30064771151) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788270201 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788270185.167474:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1534d3100/2, rc 0, transno 30064771151 00000100:00100000:2.0:1788270185.167478:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262707584:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788270185.169223:0:45765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788270185.169235:0:45765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270185.170165:0:45765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c150168e00 already unused, calling callback (ffffffffc0e7f230) 00010000:00010000:3.0:1788270185.170171:0:45765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270185.170182:0:45765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270185.170202:0:45765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270185.170209:0:45765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046700543/0xc5f5d7a016e0b2f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 47281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788270185.170230:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270185.170232:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270185.170234:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270185.668434:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262707840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270185.668509:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270185.668849:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262707840 00000100:00100000:2.0:1788270185.668858:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262707840 00000100:00100000:2.0:1788270185.668912:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788270185.668928:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262707840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270185.668964:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270185.669014:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262707840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270185.669022:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788270185.669094:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262707840:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270185.924907:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270185.988954:0:51757:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270185.988963:0:51757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270185.988997:0:51757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270185.989003:0:51757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270185.989947:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270185.990171:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270185.990198:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270185.990226:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355904 00000100:00100000:3.0:1788270185.990227:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270185.990236:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355904 00000100:00100000:3.0:1788270185.990247:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270185.990264:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270185.990285:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253355776 00000100:00100000:3.0:1788270185.990288:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253355776 00000100:00100000:2.0:1788270185.990356:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:2.0:1788270185.990369:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253355776:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270185.990416:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356032 00000100:00100000:3.0:1788270185.990420:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356032 00000100:00100000:2.0:1788270185.990442:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253355776:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270185.990452:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:1.0:1788270185.992145:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356288 00000100:00100000:1.0:1788270185.992156:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356288 00000100:00100000:1.0:1788270185.992244:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356416 00000100:00100000:1.0:1788270185.992248:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356416 00000100:00100000:1.0:1788270185.992269:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:1.0:1788270185.992278:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253356288:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270185.992337:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253356288:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 61us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270185.992345:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:1.0:1788270185.992364:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 265 00000100:00100000:1.0:1788270185.992370:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253356416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270185.992391:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253356416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270185.992397:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 265 00000100:00100000:3.0:1788270185.992449:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:3.0:1788270185.992456:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253356032:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270185.992483:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253356032:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270185.992490:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00080000:2.0:1788270185.992541:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270185.992545:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270185.993152:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356160 00000100:00100000:2.0:1788270185.993158:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356160 00000100:00100000:2.0:1788270185.993196:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788270185.993204:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253356160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270185.993243:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253356160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270185.993250:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00080000:2.0:1788270185.993265:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270185.994010:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:0.0:1788270185.994020:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253355904:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270185.994105:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253355904:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 87us (3933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270185.994112:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:1.0:1788270186.180357:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262708096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270186.180426:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270186.180431:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262707968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270186.180470:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270186.180626:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262708224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270186.180677:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270186.181243:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262708736:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.181270:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270186.181288:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262709248:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.181310:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270186.181324:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788270186.181329:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262708608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.181344:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270186.181357:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262709120:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.181373:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270186.181870:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708736 00000100:00100000:0.0:1788270186.181877:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708736 00000100:00100000:0.0:1788270186.181921:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788270186.181931:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262708736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.181993:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262708736:12345-0@lo:400:kworker.0 Request processed in 64us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182001:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788270186.182021:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709248 00000100:00100000:0.0:1788270186.182024:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709248 00000100:00100000:0.0:1788270186.182085:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788270186.182093:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262709248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182108:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708096 00000100:00100000:1.0:1788270186.182114:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708096 00000100:00100000:0.0:1788270186.182123:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262709248:12345-0@lo:400:kworker.0 Request processed in 31us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182129:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788270186.182139:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708608 00000100:00100000:0.0:1788270186.182142:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708608 00000100:00100000:1.0:1788270186.182157:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262707968 00000100:00100000:1.0:1788270186.182161:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262707968 00000100:00100000:0.0:1788270186.182164:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709120 00000100:00100000:0.0:1788270186.182169:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709120 00000100:00100000:1.0:1788270186.182182:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708224 00000100:00100000:0.0:1788270186.182191:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788270186.182196:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262708608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182220:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262708608:12345-0@lo:400:kworker.0 Request processed in 24us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182225:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788270186.182234:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788270186.182239:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262709120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182258:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262709120:12345-0@lo:400:kworker.0 Request processed in 19us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182263:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788270186.182276:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708224 00000100:00080000:0.0:1788270186.182279:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270186.182284:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270186.182286:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270186.182305:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788270186.182314:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262708096:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270186.182323:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262708608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182336:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262709120:0@lo:400:kworker.0 00002000:00000024:1.0:1788270186.182337:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270186.182346:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262708736:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182357:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262709248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182381:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262708096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270186.182387:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788270186.182404:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788270186.182413:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262707968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270186.182422:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270186.182427:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262708352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182460:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262707968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182465:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270186.182476:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788270186.182496:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788270186.182502:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262708864:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182506:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262708224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270186.182522:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270186.182544:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270186.182572:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262708224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182572:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262709376:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182584:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788270186.182600:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270186.182624:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262708224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270186.182624:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788270186.182634:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262708480:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182656:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270186.182661:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708352 00000100:00100000:1.0:1788270186.182665:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708352 00000100:00100000:1.0:1788270186.182691:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788270186.182692:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262708992:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182699:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262708352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182718:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270186.182742:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262708352:12345-0@lo:400:kworker.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182743:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262709504:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182755:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788270186.182771:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270186.182798:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262707968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270186.182799:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262708352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182828:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262708096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270186.182834:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708864 00000100:00100000:0.0:1788270186.182838:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708864 00000100:00100000:1.0:1788270186.182853:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708480 00000100:00100000:1.0:1788270186.182857:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708480 00000100:00100000:0.0:1788270186.182877:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788270186.182885:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262708864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.182891:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788270186.182902:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262708480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.182928:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262708864:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.182936:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788270186.182943:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3607:x1875136262708480:12345-0@lo:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270186.182950:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788270186.182958:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709376 00000100:00100000:0.0:1788270186.182963:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709376 00000100:00100000:1.0:1788270186.182978:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262708992 00000100:00100000:0.0:1788270186.182983:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709504 00000100:00100000:1.0:1788270186.182984:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262708992 00000100:00100000:0.0:1788270186.182988:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709504 00000100:00100000:1.0:1788270186.183012:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788270186.183020:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262709376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.183448:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262709376:12345-0@lo:400:kworker.0 Request processed in 428us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.184222:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788270186.184236:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262708992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.184278:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262708992:12345-0@lo:400:kworker.0 Request processed in 48us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.184284:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788270186.184301:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788270186.184307:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262709504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.184335:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262709504:12345-0@lo:400:kworker.0 Request processed in 29us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270186.184341:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:0.0:1788270186.184358:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270186.184362:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270186.184363:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270186.184385:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262708480:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.184397:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262708992:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.184406:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262709504:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.184416:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262708864:0@lo:400:kworker.0 00000100:00100000:0.0:1788270186.184424:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262709376:0@lo:400:kworker.0 00000100:00100000:1.0:1788270186.185147:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00010000:3.0:1788270186.949907:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270187.516620:0:51808:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270187.516627:0:51808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270187.516654:0:51808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270187.516659:0:51808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270187.975157:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270188.228864:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262709632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270188.230989:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270188.231254:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709632 00000100:00100000:1.0:1788270188.231262:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709632 00000100:00100000:1.0:1788270188.231363:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788270188.231374:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262709632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270188.231404:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270188.231525:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262709632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270188.231533:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788270188.231577:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270188.231638:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262709632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270188.740640:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270188.740719:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262709760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270188.740812:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270188.740865:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709760 00000100:00100000:1.0:1788270188.740874:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709760 00000100:00100000:1.0:1788270188.740936:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788270188.740947:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262709760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270188.740979:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270188.741069:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262709760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270188.741077:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788270188.741111:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262709760:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270188.996615:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270188.998329:0:51859:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270188.998336:0:51859:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270188.998360:0:51859:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270188.998365:0:51859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:3.0:1788270189.252232:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788270189.252242:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270189.252849:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:3.0:1788270189.252861:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788270190.020343:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270190.020351:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270190.020368:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270190.020375:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270190.020492:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270190.493492:0:51911:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270190.493500:0:51911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270190.493537:0:51911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270190.493542:0:51911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270190.788463:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262709888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270190.788543:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270190.792107:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262709888 00000100:00100000:1.0:1788270190.792122:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262709888 00000100:00100000:1.0:1788270190.792191:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788270190.792201:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262709888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270190.792251:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270190.792383:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262709888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270190.792391:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788270190.792428:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262709888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270191.044565:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270191.107377:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107434:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107465:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107498:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107515:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107538:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107560:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270191.107589:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356928 00000100:00100000:1.0:1788270191.107599:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356928 00000100:00100000:0.0:1788270191.107639:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356672 00000100:00100000:0.0:1788270191.107645:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356672 00000100:00100000:1.0:1788270191.107664:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357056 00000100:00100000:1.0:1788270191.107669:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357056 00000100:00100000:0.0:1788270191.107683:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356800 00000100:00100000:0.0:1788270191.107689:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356800 00000100:00100000:1.0:1788270191.107702:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:0.0:1788270191.107709:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357184 00000100:00100000:0.0:1788270191.107714:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357184 00000100:00100000:1.0:1788270191.107715:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253356928:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270191.107730:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357312 00000100:00100000:0.0:1788270191.107734:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357312 00000100:00100000:0.0:1788270191.107750:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:0.0:1788270191.107758:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253356672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270191.107789:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253356928:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.107797:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253356672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.107798:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:0.0:1788270191.107809:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:1.0:1788270191.107823:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788270191.107830:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 275 00000100:00100000:1.0:1788270191.107835:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253357056:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270191.107862:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253357056:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.107868:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:2.0:1788270191.107938:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253356544 00000100:00100000:2.0:1788270191.107943:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253356544 00000100:00100000:0.0:1788270191.107963:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253356800:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270191.107978:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:2.0:1788270191.107999:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253356544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270191.108007:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253356800:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 47us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.108114:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:1.0:1788270191.108124:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253357184:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270191.108188:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253356544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 202us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270191.108195:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:2.0:1788270191.108251:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:2.0:1788270191.108258:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253357312:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270191.108304:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 275 00000100:00080000:0.0:1788270191.108322:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270191.108325:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270191.108326:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270191.108328:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270191.111028:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253357184:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2894us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.111058:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:2.0:1788270191.111194:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253357312:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2935us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270191.111202:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:0.0:1788270191.300436:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262710144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270191.300513:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300714:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262710656:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.300741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300759:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262711168:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.300777:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300791:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262711680:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.300809:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300826:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788270191.300832:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262710272:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.300856:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300874:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262710784:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.300895:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300910:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262711296:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.300927:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.300955:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710272 00000100:00100000:0.0:1788270191.300962:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710272 00000100:00100000:0.0:1788270191.301012:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788270191.301022:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262710272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301101:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262710272:12345-0@lo:400:kworker.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.301109:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788270191.301148:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710656 00000100:00100000:0.0:1788270191.301152:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710656 00000100:00100000:0.0:1788270191.301187:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711168 00000100:00100000:0.0:1788270191.301191:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711168 00000100:00100000:0.0:1788270191.301212:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711680 00000100:00100000:0.0:1788270191.301216:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711680 00000100:00100000:0.0:1788270191.301241:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711296 00000100:00100000:0.0:1788270191.301244:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711296 00000100:00100000:1.0:1788270191.301254:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262711808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270191.301262:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788270191.301270:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262710656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270191.301292:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270191.301322:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262710656:12345-0@lo:400:kworker.0 Request processed in 51us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.301330:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788270191.301343:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710784 00000100:00100000:0.0:1788270191.301348:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788270191.301349:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710784 00000100:00100000:0.0:1788270191.301356:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262711168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270191.301386:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788270191.301391:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262711168:12345-0@lo:400:kworker.0 Request processed in 36us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.301398:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262710784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301402:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788270191.301418:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788270191.301426:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262711680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270191.301449:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262710784:12345-0@lo:400:kworker.0 Request processed in 54us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.301466:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262711680:12345-0@lo:400:kworker.0 Request processed in 42us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.301475:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788270191.301485:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788270191.301490:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262711296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301515:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262711296:12345-0@lo:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.301521:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1788270191.301544:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270191.301552:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270191.301582:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262710272:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301596:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262710784:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301605:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262711296:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301613:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262710656:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301621:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262711168:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301630:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262711680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270191.301700:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710144 00000100:00100000:2.0:1788270191.301705:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710144 00000100:00100000:3.0:1788270191.301751:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711808 00000100:00100000:3.0:1788270191.301756:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711808 00000100:00100000:2.0:1788270191.301756:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788270191.301769:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262710144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270191.301785:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788270191.301787:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270191.301793:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270191.301794:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262711808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270191.301794:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00002000:00000024:3.0:1788270191.301816:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270191.301831:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262710016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270191.301844:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262710144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270191.301851:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788270191.301869:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270191.301883:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262711808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270191.301891:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788270191.301896:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262710528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270191.301903:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262710400:0@lo:400:kworker.0 00000100:00100000:3.0:1788270191.301905:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710016 00000100:00100000:3.0:1788270191.301918:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710016 00000100:00100000:0.0:1788270191.301924:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270191.301943:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270191.301950:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788270191.301951:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262711040:0@lo:400:kworker.0 00000100:00100000:3.0:1788270191.301957:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262710016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270191.301967:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270191.301971:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262710912:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.301994:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270191.302027:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788270191.302069:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710400 00000100:00100000:1.0:1788270191.302212:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710400 00000100:00100000:1.0:1788270191.302241:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788270191.302248:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262710400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270191.302705:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262710016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 748us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270191.302712:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788270191.302713:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262711552:0@lo:400:kworker.0 00000100:00080000:3.0:1788270191.302731:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270191.302743:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270191.302754:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710528 00000100:00100000:3.0:1788270191.302758:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710528 00000100:00100000:3.0:1788270191.302780:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711040 00000100:00100000:3.0:1788270191.302781:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711040 00000100:00100000:0.0:1788270191.302791:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262710016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270191.302796:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788270191.302802:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262710528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.302827:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711552 00000100:00100000:0.0:1788270191.302832:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711552 00000100:00100000:3.0:1788270191.302840:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262710528:12345-0@lo:400:kworker.0 Request processed in 37us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270191.302855:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788270191.302871:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788270191.302879:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262711040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270191.302904:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262711040:12345-0@lo:400:kworker.0 Request processed in 28us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270191.302964:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788270191.302969:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788270191.302978:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262711552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.303034:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262711552:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270191.303060:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788270191.303100:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262710144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270191.303115:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262710400:12345-0@lo:400:kworker.0 Request processed in 865us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.303127:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788270191.303130:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262710528:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.303143:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262711040:0@lo:400:kworker.0 00000100:00100000:0.0:1788270191.303155:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262711552:0@lo:400:kworker.0 00000100:00100000:3.0:1788270191.303301:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262711808:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788270191.303322:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270191.304394:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270191.304430:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262711424:0@lo:400:kworker.0 00000100:00100000:3.0:1788270191.304540:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262710912 00000100:00100000:3.0:1788270191.304546:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262710912 00000100:00100000:3.0:1788270191.304584:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788270191.304590:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262710912:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788270191.304617:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270191.304638:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262710912:12345-0@lo:400:kworker.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270191.304645:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788270191.304748:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270191.304791:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262710400:0@lo:400:kworker.0 00000100:00100000:2.0:1788270191.304802:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262710912:0@lo:400:kworker.0 00000100:00100000:1.0:1788270191.305213:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711424 00000100:00100000:1.0:1788270191.305218:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711424 00000100:00100000:1.0:1788270191.305265:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788270191.305273:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262711424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270191.305323:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262711424:12345-0@lo:400:kworker.0 Request processed in 50us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270191.305331:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788270191.305352:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262711424:0@lo:400:kworker.0 00000100:00080000:3.0:1788270191.305535:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1788270191.306288:0:47278:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771151 is committed 00000020:00080000:3.0:1788270191.306349:0:45756:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803852 batchid updated 00000020:00080000:0.0:1788270191.306422:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803852 00000020:00080000:0.0:1788270191.306433:0:45816:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803852 00000040:00080000:2.0:1788270192.026742:0:51962:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270192.026751:0:51962:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270192.026785:0:51962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270192.026792:0:51962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270192.069173:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270193.092248:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270193.349165:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262711936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270193.349235:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270193.349426:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262711936 00000100:00100000:3.0:1788270193.349485:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262711936 00000100:00100000:3.0:1788270193.349537:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788270193.349547:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262711936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270193.349573:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270193.349610:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262711936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270193.349617:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788270193.349636:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270193.349666:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262711936:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788270193.592275:0:52013:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270193.592282:0:52013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270193.592316:0:52013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270193.592322:0:52013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270193.860251:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262712064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270193.860332:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270193.860783:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712064 00000100:00100000:1.0:1788270193.860790:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712064 00000100:00100000:1.0:1788270193.860835:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788270193.860846:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262712064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270193.860879:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270193.860962:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262712064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270193.860971:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788270193.860988:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262712064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270194.116299:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270195.108020:0:52064:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270195.108034:0:52064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270195.108111:0:52064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270195.108118:0:52064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270195.140901:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270195.908392:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262712192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270195.908505:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270195.908889:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712192 00000100:00100000:1.0:1788270195.908924:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712192 00000100:00100000:1.0:1788270195.908989:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788270195.909006:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262712192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270195.909085:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270195.909154:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262712192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270195.909163:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788270195.909199:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262712192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270196.166385:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270196.227066:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270196.227151:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270196.227182:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270196.227239:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357824 00000100:00100000:1.0:1788270196.227253:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357824 00000100:00100000:1.0:1788270196.227332:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788270196.227343:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253357824:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270196.227430:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253357824:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.227438:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00080000:1.0:1788270196.227580:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270196.228724:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357568 00000100:00100000:2.0:1788270196.228736:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357568 00000100:00100000:1.0:1788270196.228811:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358080 00000100:00100000:1.0:1788270196.228816:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358080 00000100:00100000:1.0:1788270196.228857:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:1.0:1788270196.228868:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253357568:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270196.228956:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253357568:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.228965:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:1.0:1788270196.228987:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 285 00000100:00100000:1.0:1788270196.228995:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253358080:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270196.229025:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253358080:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.229031:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 285 00000100:00080000:1.0:1788270196.229182:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270196.230107:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270196.230206:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270196.230237:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270196.230262:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270196.230290:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357696 00000100:00100000:3.0:1788270196.230297:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357696 00000100:00100000:3.0:1788270196.230342:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358208 00000100:00100000:3.0:1788270196.230345:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358208 00000100:00100000:3.0:1788270196.230367:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 286 00000100:00100000:3.0:1788270196.230377:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253357696:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270196.230453:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253357696:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270196.230461:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 286 00000100:00100000:3.0:1788270196.230477:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 287 00000100:00100000:3.0:1788270196.230483:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253358208:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270196.230508:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253358208:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270196.230514:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 287 00000100:00100000:3.0:1788270196.230534:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357952 00000100:00100000:3.0:1788270196.230539:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357952 00000100:00100000:3.0:1788270196.230567:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:3.0:1788270196.230575:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253357952:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270196.230600:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253357952:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270196.230608:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00080000:3.0:1788270196.230633:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270196.230639:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270196.236159:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253357440 00000100:00100000:1.0:1788270196.236175:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253357440 00000100:00100000:1.0:1788270196.236338:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:1.0:1788270196.236352:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253357440:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270196.236439:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253357440:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (6337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.236446:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:2.0:1788270196.420228:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262712320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270196.420313:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270196.420392:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712320 00000100:00100000:2.0:1788270196.420398:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712320 00000100:00100000:2.0:1788270196.420449:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788270196.420456:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262712320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270196.420482:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270196.420523:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262712320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270196.420533:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788270196.420554:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270196.420579:0:3610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771151 gen 2 00000004:00080000:2.0:1788270196.420584:0:3610:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1534d3100, transno 30064771151 00000100:00100000:2.0:1788270196.420596:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262712320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270196.422250:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262712448:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.422297:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.422328:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262712960:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.422351:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.422368:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262713472:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.422391:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.422415:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788270196.422422:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262712576:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.422442:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.422459:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262713088:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.422477:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.422498:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262713600:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.422517:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270196.422588:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713088 00000100:00100000:2.0:1788270196.422594:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713088 00000100:00100000:2.0:1788270196.422632:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788270196.422637:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262713088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270196.422670:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262713088:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270196.422677:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788270196.422694:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270196.423027:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712448 00000100:00100000:1.0:1788270196.423032:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712448 00000100:00100000:1.0:1788270196.423078:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788270196.423085:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262712448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.423118:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262712448:12345-0@lo:400:kworker.0 Request processed in 35us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.423124:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788270196.423148:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712960 00000100:00100000:1.0:1788270196.423151:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712960 00000100:00100000:1.0:1788270196.423177:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712576 00000100:00100000:1.0:1788270196.423180:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712576 00000100:00100000:1.0:1788270196.423193:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788270196.423200:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262712960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270196.423209:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788270196.423221:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262712576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.423233:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262712960:12345-0@lo:400:kworker.0 Request processed in 33us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.423239:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788270196.423258:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713472 00000100:00100000:1.0:1788270196.423261:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713472 00000100:00100000:2.0:1788270196.423278:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262712576:12345-0@lo:400:kworker.0 Request processed in 59us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270196.423286:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788270196.423292:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713600 00000100:00100000:1.0:1788270196.423295:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713600 00000100:00100000:1.0:1788270196.423318:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788270196.423323:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262713472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.423348:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262713472:12345-0@lo:400:kworker.0 Request processed in 26us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.423354:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788270196.423363:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788270196.423368:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262713600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.423387:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262713600:12345-0@lo:400:kworker.0 Request processed in 19us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.423392:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788270196.423488:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262712704:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.423514:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270196.423551:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712704 00000100:00100000:2.0:1788270196.423556:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712704 00000100:00100000:2.0:1788270196.423591:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788270196.423598:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262712704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270196.423643:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262712704:12345-0@lo:400:kworker.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270196.423650:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788270196.424789:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270196.424803:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262713984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270196.424841:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270196.424875:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713984 00000100:00100000:3.0:1788270196.424880:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713984 00000100:00100000:1.0:1788270196.424992:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262712704:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.424999:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262713216:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425024:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.425057:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262713728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425079:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.425104:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788270196.425111:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262712832:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425131:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.425150:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262713344:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425166:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.425180:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262713856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425200:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.425221:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713728 00000100:00100000:1.0:1788270196.425225:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713728 00000100:00100000:1.0:1788270196.425253:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262712832 00000100:00100000:1.0:1788270196.425255:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262712832 00000100:00100000:1.0:1788270196.425267:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713344 00000100:00100000:1.0:1788270196.425269:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713344 00000100:00100000:1.0:1788270196.425277:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713856 00000100:00100000:1.0:1788270196.425279:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713856 00000100:00100000:1.0:1788270196.425291:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788270196.425298:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262713728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425336:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262713728:12345-0@lo:400:kworker.0 Request processed in 39us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.425342:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788270196.425354:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788270196.425360:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262712832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425382:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262712832:12345-0@lo:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.425388:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788270196.425400:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788270196.425406:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262713344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425428:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262713344:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.425433:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788270196.425443:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788270196.425449:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262713856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425472:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262713856:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270196.425479:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1788270196.425502:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270196.425507:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270196.425509:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270196.425547:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262712832:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425558:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262713344:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425567:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262713856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425576:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262713728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425607:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262712576:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425618:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262713088:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425630:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262713600:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425640:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262712448:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425651:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262712960:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.425661:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262713472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270196.426771:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788270196.426782:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262713984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270196.426809:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270196.426858:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262713984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270196.426864:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788270196.426887:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262713216 00000100:00100000:3.0:1788270196.426910:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262713216 00000100:00100000:3.0:1788270196.426946:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788270196.426954:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262713216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270196.426991:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262713216:12345-0@lo:400:kworker.0 Request processed in 38us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270196.426997:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788270196.427033:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262713216:0@lo:400:kworker.0 00000100:00100000:1.0:1788270196.427175:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262714112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270196.427209:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270196.427255:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262713984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270196.427328:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714112 00000100:00100000:2.0:1788270196.427332:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714112 00000100:00100000:2.0:1788270196.428919:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788270196.428933:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262714112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270196.428955:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270196.429023:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262714112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270196.429031:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788270196.429136:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262714112:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788270196.602718:0:52115:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270196.602726:0:52115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270196.602759:0:52115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270196.602764:0:52115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270197.188311:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270198.193936:0:52167:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270198.193946:0:52167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270198.193984:0:52167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270198.193990:0:52167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270198.213629:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270198.468599:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270198.468626:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262714240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270198.468712:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270198.468881:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714240 00000100:00100000:3.0:1788270198.468890:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714240 00000100:00100000:3.0:1788270198.468957:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788270198.468968:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262714240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270198.468997:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270198.469064:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262714240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270198.469072:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788270198.469116:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262714240:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788270198.469244:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270198.980525:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262714368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270198.980604:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270198.980740:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714368 00000100:00100000:3.0:1788270198.980748:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714368 00000100:00100000:3.0:1788270198.980804:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788270198.980815:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262714368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270198.980879:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270198.980938:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262714368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270198.980946:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788270198.980980:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262714368:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270199.236330:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270199.492279:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270199.492293:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270199.492909:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:2.0:1788270199.492923:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:1.0:1788270199.772769:0:52218:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270199.772779:0:52218:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270199.772821:0:52218:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270199.772828:0:52218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270200.260378:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270200.260926:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270200.260935:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270200.260963:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270200.260972:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270201.028877:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270201.028905:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262714496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270201.029025:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270201.029129:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714496 00000100:00100000:0.0:1788270201.029139:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714496 00000100:00100000:0.0:1788270201.029187:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788270201.029195:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262714496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270201.029249:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270201.029406:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262714496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 212us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270201.029412:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788270201.029470:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262714496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270201.285282:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270201.316970:0:52269:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270201.316978:0:52269:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270201.317024:0:52269:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270201.317030:0:52269:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270201.347756:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270201.347799:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270201.347844:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270201.347868:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270201.347887:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270201.347903:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270201.347915:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358336 00000100:00100000:1.0:1788270201.347929:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358336 00000100:00100000:3.0:1788270201.347934:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270201.347960:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358848 00000100:00100000:3.0:1788270201.347964:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358848 00000100:00100000:1.0:1788270201.347988:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:3.0:1788270201.348000:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358720 00000100:00100000:1.0:1788270201.348000:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253358336:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270201.348003:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358720 00000100:00100000:3.0:1788270201.348020:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788270201.348027:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253358848:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270201.348087:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253358848:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 59us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.348094:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253358336:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.348100:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788270201.348107:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:3.0:1788270201.348124:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:3.0:1788270201.348133:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253358720:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270201.348143:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358592 00000100:00100000:1.0:1788270201.348147:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358592 00000100:00100000:3.0:1788270201.348163:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253358720:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.348171:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359104 00000100:00100000:3.0:1788270201.348172:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:1.0:1788270201.348174:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359104 00000100:00100000:1.0:1788270201.348189:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358464 00000100:00100000:1.0:1788270201.348191:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358464 00000100:00080000:3.0:1788270201.348201:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270201.348202:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253358976 00000100:00100000:1.0:1788270201.348205:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253358976 00000100:00080000:3.0:1788270201.348207:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270201.348211:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270201.348214:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270201.348218:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270201.348224:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 294 00000100:00100000:1.0:1788270201.348232:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253358592:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270201.348271:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253358592:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.348279:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 294 00000100:00100000:1.0:1788270201.348295:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 295 00000100:00100000:1.0:1788270201.348302:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253359104:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270201.348340:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253359104:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.348347:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 295 00000100:00100000:1.0:1788270201.348762:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 296 00000100:00100000:1.0:1788270201.348769:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253358464:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270201.348795:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253358464:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.348799:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 296 00000100:00100000:1.0:1788270201.348823:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:1.0:1788270201.348831:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253358976:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270201.348856:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253358976:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.348862:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:2.0:1788270201.540649:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270201.540673:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262714624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270201.540741:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541056:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262714752:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541091:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541115:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262715264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541138:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541155:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262715776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541176:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541196:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788270201.541202:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262714880:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541223:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541240:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262715392:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541260:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541275:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262715904:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541294:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541317:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262715136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541339:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541355:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262715648:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541374:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541389:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262716160:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541407:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541424:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788270201.541430:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262715008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.541452:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541469:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262715520:0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.541484:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262716288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270201.541489:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541503:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262716032:0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.541507:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270201.541522:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270201.541537:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714624 00000100:00100000:1.0:1788270201.541541:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714752 00000100:00100000:3.0:1788270201.541545:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714624 00000100:00100000:1.0:1788270201.541545:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714752 00000100:00100000:3.0:1788270201.541580:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716288 00000100:00100000:1.0:1788270201.541584:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788270201.541592:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262714752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.541595:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716288 00000100:00100000:3.0:1788270201.541611:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788270201.541616:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262714624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270201.541638:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270201.541638:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262714752:12345-0@lo:400:kworker.0 Request processed in 46us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.541644:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788270201.541667:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262714624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.541673:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788270201.541673:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715776 00000100:00100000:1.0:1788270201.541676:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715776 00000100:00100000:3.0:1788270201.541684:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788270201.541689:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262716288:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270201.541694:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715904 00000100:00100000:1.0:1788270201.541696:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715904 00002000:00000024:3.0:1788270201.541704:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270201.541707:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715136 00000100:00100000:1.0:1788270201.541709:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715136 00000100:00100000:1.0:1788270201.541718:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715648 00000100:00100000:1.0:1788270201.541720:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715648 00000100:00100000:3.0:1788270201.541728:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262716288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.541730:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716160 00000100:00100000:1.0:1788270201.541732:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716160 00000100:00100000:3.0:1788270201.541734:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788270201.541742:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716032 00000100:00100000:1.0:1788270201.541744:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716032 00000100:00080000:3.0:1788270201.541748:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270201.541752:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270201.541755:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270201.541757:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270201.541758:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788270201.541764:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262715776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.541784:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715264 00000100:00100000:3.0:1788270201.541787:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715264 00000100:00100000:1.0:1788270201.541791:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262715776:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.541797:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788270201.541822:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262714880 00000100:00100000:1.0:1788270201.541824:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788270201.541825:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262714880 00000100:00100000:3.0:1788270201.541837:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788270201.541844:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262715264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.541875:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262715264:12345-0@lo:400:kworker.0 Request processed in 31us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.541881:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788270201.541893:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788270201.541900:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262714880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.541925:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262714880:12345-0@lo:400:kworker.0 Request processed in 27us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.541934:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788270201.541963:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715392 00000100:00100000:3.0:1788270201.541967:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715392 00000100:00100000:3.0:1788270201.541994:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715008 00000100:00100000:3.0:1788270201.541996:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715008 00000100:00100000:3.0:1788270201.542011:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262715520 00000100:00100000:3.0:1788270201.542014:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262715520 00000100:00100000:3.0:1788270201.542025:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788270201.542031:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262715392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.542077:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262715392:12345-0@lo:400:kworker.0 Request processed in 45us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.542083:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788270201.542085:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788270201.542093:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788270201.542093:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262715136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.542098:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262715008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.542123:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262715008:12345-0@lo:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.542129:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788270201.542153:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788270201.542160:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262715520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.542180:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262716416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270201.542211:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270201.542239:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716416 00000100:00100000:2.0:1788270201.542242:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716416 00000100:00100000:2.0:1788270201.542263:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788270201.542269:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262716416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270201.542283:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270201.542312:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262716416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270201.542318:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788270201.542356:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262716416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270201.542389:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262714624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788270201.542411:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270201.542414:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270201.542459:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262716288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270201.542470:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262714880:0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.542479:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262715392:0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.542488:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262714752:0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.542496:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262715264:0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.542504:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262715776:0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.542543:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788270201.542551:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262715648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.542903:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262715904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270201.542943:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262715904:12345-0@lo:400:kworker.0 Request processed in 45us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.542950:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788270201.542969:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788270201.542974:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262716160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270201.545082:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262715136:12345-0@lo:400:kworker.0 Request processed in 2983us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270201.545100:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788270201.545133:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788270201.545147:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262716032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270201.545204:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262716032:12345-0@lo:400:kworker.0 Request processed in 64us (3679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270201.545210:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788270201.545283:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262715008:0@lo:400:kworker.0 00000100:00100000:3.0:1788270201.545317:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262715520:12345-0@lo:400:kworker.0 Request processed in 3156us (3824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270201.545325:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788270201.545391:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262715904:0@lo:400:kworker.0 00000100:00100000:2.0:1788270201.548970:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262715648:12345-0@lo:400:kworker.0 Request processed in 6409us (7584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270201.548986:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788270201.549137:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262716160:12345-0@lo:400:kworker.0 Request processed in 6161us (7727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270201.549145:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788270201.549506:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262715520:0@lo:400:kworker.0 00000100:00100000:0.0:1788270201.549522:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262716032:0@lo:400:kworker.0 00000100:00100000:0.0:1788270201.549533:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262715136:0@lo:400:kworker.0 00000100:00100000:0.0:1788270201.549543:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262715648:0@lo:400:kworker.0 00000100:00100000:0.0:1788270201.549553:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262716160:0@lo:400:kworker.0 00010000:00010000:1.0:1788270202.308825:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270202.778862:0:52320:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270202.778871:0:52320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270202.778903:0:52320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270202.778909:0:52320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270203.333092:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270203.588513:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270203.588538:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262716544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270203.588608:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270203.588798:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716544 00000100:00100000:3.0:1788270203.588807:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716544 00000100:00100000:3.0:1788270203.589716:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788270203.589731:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262716544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270203.589777:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270203.589851:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262716544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270203.589859:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788270203.589917:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262716544:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270203.590798:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270204.100865:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262716672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270204.100934:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270204.101072:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716672 00000100:00100000:3.0:1788270204.101080:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716672 00000100:00100000:3.0:1788270204.101126:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788270204.101135:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262716672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270204.101170:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270204.101235:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262716672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270204.101243:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788270204.101874:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262716672:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788270204.224950:0:52372:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270204.224959:0:52372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270204.224993:0:52372:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270204.224999:0:52372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270204.356218:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270205.380265:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270205.722369:0:52423:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270205.722381:0:52423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270205.722416:0:52423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270205.722421:0:52423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270206.149121:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262716800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270206.149231:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.149372:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716800 00000100:00100000:0.0:1788270206.149383:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716800 00000100:00100000:0.0:1788270206.149467:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788270206.149478:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262716800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270206.149524:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270206.150123:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262716800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 644us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.150133:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788270206.150443:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262716800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270206.404375:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270206.467231:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270206.467287:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270206.467315:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270206.467353:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270206.467372:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270206.467395:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270206.467469:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270206.467470:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359232 00000100:00100000:1.0:1788270206.467482:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359232 00000100:00100000:3.0:1788270206.467491:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359360 00000100:00100000:3.0:1788270206.467493:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359360 00000100:00100000:3.0:1788270206.467538:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359488 00000100:00100000:3.0:1788270206.467542:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359488 00000100:00100000:1.0:1788270206.467544:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:3.0:1788270206.467554:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360000 00000100:00100000:3.0:1788270206.467555:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360000 00000100:00100000:1.0:1788270206.467556:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253359232:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270206.467566:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359872 00000100:00100000:3.0:1788270206.467568:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359872 00000100:00100000:3.0:1788270206.467581:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 304 00000100:00100000:3.0:1788270206.467586:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253359360:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270206.467648:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253359232:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270206.467655:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:3.0:1788270206.467660:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253359360:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 75us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.467666:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 304 00000100:00100000:3.0:1788270206.467678:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 305 00000100:00100000:3.0:1788270206.467684:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253359488:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270206.467694:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 306 00000100:00100000:1.0:1788270206.467701:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253360000:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270206.467706:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253359488:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.467712:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 305 00000100:00100000:3.0:1788270206.467736:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 307 00000100:00100000:1.0:1788270206.467737:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253360000:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.467742:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253359872:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270206.467743:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 306 00000100:00100000:3.0:1788270206.467771:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253359872:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.467777:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 307 00000100:00080000:1.0:1788270206.467783:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270206.467788:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270206.468308:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359744 00000100:00100000:2.0:1788270206.468313:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359744 00000100:00100000:2.0:1788270206.468355:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253359616 00000100:00100000:2.0:1788270206.468359:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253359616 00000100:00100000:2.0:1788270206.468427:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788270206.468433:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:2.0:1788270206.468438:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253359744:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270206.468444:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253359616:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270206.468480:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253359616:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.468488:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00080000:1.0:1788270206.468490:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270206.468493:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270206.471060:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253359744:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2593us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270206.471075:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788270206.661087:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270206.661121:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270206.661122:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262717184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270206.661134:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262716928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270206.661277:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270206.661435:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262717440:0@lo:400:kworker.0 00000100:00100000:2.0:1788270206.661502:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262717568:0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.661705:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270206.661755:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262717056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270206.661776:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262717952:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.661786:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270206.661814:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270206.661818:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262717696:0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.661843:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262718464:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.661853:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.661872:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270206.661881:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262718208:0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.661889:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.661912:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262717312:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.661920:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270206.661950:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262718720:0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.661954:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718464 00000100:00100000:0.0:1788270206.661961:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270206.661967:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718464 00000100:00100000:3.0:1788270206.661985:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.661997:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262717824:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.662031:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717440 00000100:00100000:0.0:1788270206.662034:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270206.662060:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717440 00000100:00100000:1.0:1788270206.662075:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718720 00000100:00100000:1.0:1788270206.662079:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718720 00000100:00100000:0.0:1788270206.662101:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262718336:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.662102:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717952 00000100:00100000:1.0:1788270206.662106:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717824 00000100:00100000:3.0:1788270206.662108:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717952 00000100:00100000:1.0:1788270206.662111:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717824 00000100:00100000:0.0:1788270206.662137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270206.662140:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788270206.662144:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788270206.662153:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262718464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.662159:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262717440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.662159:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262718848:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.662192:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.662233:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717184 00000100:00100000:3.0:1788270206.662236:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262717440:12345-0@lo:400:kworker.0 Request processed in 81us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270206.662239:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262718464:12345-0@lo:400:kworker.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.662239:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717184 00000100:00100000:3.0:1788270206.662255:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788270206.662256:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788270206.662271:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717056 00000100:00100000:0.0:1788270206.662277:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717056 00000100:00100000:1.0:1788270206.662287:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718336 00000100:00100000:3.0:1788270206.662289:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270206.662293:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718336 00000100:00100000:0.0:1788270206.662297:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262716928 00000100:00100000:3.0:1788270206.662301:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262717952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.662303:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262716928 00000100:00100000:1.0:1788270206.662314:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718848 00000100:00100000:1.0:1788270206.662319:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718848 00000100:00100000:0.0:1788270206.662335:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788270206.662343:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262717952:12345-0@lo:400:kworker.0 Request processed in 44us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270206.662344:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788270206.662349:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262717184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270206.662358:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270206.662358:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262718720:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788270206.662382:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270206.662388:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788270206.662398:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262718720:12345-0@lo:400:kworker.0 Request processed in 44us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.662403:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262717056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270206.662408:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00002000:00000024:3.0:1788270206.662422:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270206.662423:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788270206.662431:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262717824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.662486:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262717184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.662495:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788270206.662500:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262717056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.662508:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788270206.662514:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788270206.662523:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262716928:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270206.662535:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717696 00000100:00100000:3.0:1788270206.662540:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717696 00002000:00000024:0.0:1788270206.662541:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270206.662568:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718208 00000100:00100000:3.0:1788270206.662572:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718208 00000100:00100000:3.0:1788270206.662590:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788270206.662599:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262717696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.662627:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262717824:12345-0@lo:400:kworker.0 Request processed in 195us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270206.662636:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788270206.662652:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262717696:12345-0@lo:400:kworker.0 Request processed in 54us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.662660:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788270206.662665:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262716928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.662674:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788270206.662678:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788270206.662686:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262718208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.662706:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788270206.662728:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262718336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.662818:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788270206.662826:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262718848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.662974:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262718336:12345-0@lo:400:kworker.0 Request processed in 260us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.662981:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788270206.663079:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262718208:12345-0@lo:400:kworker.0 Request processed in 393us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.663083:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262717824:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663093:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788270206.663098:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.663104:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262718336:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663120:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717568 00000100:00100000:3.0:1788270206.663125:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717568 00000100:00100000:0.0:1788270206.663133:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262716928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270206.663136:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262718080:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663149:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788270206.663158:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262717568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270206.663186:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788270206.663197:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270206.663204:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270206.663206:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270206.663209:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270206.663235:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262717440:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663246:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262717952:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663257:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262718464:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663291:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262717696:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663303:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262718208:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663314:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262718720:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663326:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262717184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270206.663341:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262717056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270206.663352:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262717568:12345-0@lo:400:kworker.0 Request processed in 195us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270206.663354:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262718592:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663368:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788270206.663391:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718080 00000100:00100000:2.0:1788270206.663392:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270206.663398:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718080 00000100:00100000:3.0:1788270206.663431:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262717312 00000100:00100000:3.0:1788270206.663437:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262717312 00000100:00100000:3.0:1788270206.663467:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788270206.663475:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262717312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663512:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262717312:12345-0@lo:400:kworker.0 Request processed in 39us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.663519:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788270206.663546:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718592 00000100:00100000:3.0:1788270206.663550:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718592 00000100:00100000:2.0:1788270206.663557:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262717568:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663579:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788270206.663588:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262718592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270206.663614:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262717312:0@lo:400:kworker.0 00000100:00100000:3.0:1788270206.663635:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262718592:12345-0@lo:400:kworker.0 Request processed in 46us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270206.663643:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788270206.663649:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262718592:0@lo:400:kworker.0 00000100:00100000:0.0:1788270206.663728:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788270206.663737:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262718080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788270206.665415:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270206.665428:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270206.665808:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262718080:12345-0@lo:400:kworker.0 Request processed in 2068us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270206.665821:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788270206.666068:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262718080:0@lo:400:kworker.0 00000100:00100000:1.0:1788270206.666350:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262718848:12345-0@lo:400:kworker.0 Request processed in 3522us (4155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270206.666361:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788270206.666523:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262718848:0@lo:400:kworker.0 00000040:00080000:0.0:1788270207.334593:0:52474:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270207.334607:0:52474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270207.334644:0:52474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270207.334649:0:52474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270207.428307:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270208.452793:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270208.708602:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262718976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270208.708671:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270208.709356:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262718976 00000100:00100000:1.0:1788270208.709365:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262718976 00000100:00100000:1.0:1788270208.709419:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788270208.709429:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262718976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270208.709457:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270208.709501:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262718976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270208.709508:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788270208.709731:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270208.709769:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262718976:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788270208.874326:0:52525:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270208.874336:0:52525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270208.874372:0:52525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270208.874379:0:52525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270209.221064:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270209.221224:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262719104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270209.221292:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270209.221503:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719104 00000100:00100000:3.0:1788270209.221511:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719104 00000100:00100000:3.0:1788270209.221560:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788270209.221570:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262719104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270209.221600:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270209.221665:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262719104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270209.221697:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788270209.221749:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262719104:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270209.476201:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270209.733962:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270209.733972:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270209.734509:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270209.734518:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788270210.398269:0:52576:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270210.398279:0:52576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270210.398319:0:52576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270210.398329:0:52576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270210.500768:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270210.500772:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270210.500779:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270210.500798:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270210.500804:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270211.268303:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262719232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270211.268383:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270211.268662:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719232 00000100:00100000:2.0:1788270211.268671:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719232 00000100:00100000:2.0:1788270211.268713:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788270211.268720:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262719232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270211.268747:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270211.268793:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262719232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270211.268797:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788270211.268930:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262719232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270211.524250:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270211.586742:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270211.586802:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270211.586834:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270211.586859:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270211.586867:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360128 00000100:00100000:2.0:1788270211.586883:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360128 00000100:00100000:3.0:1788270211.586913:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270211.586937:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360512 00000100:00100000:3.0:1788270211.586940:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360512 00000100:00100000:2.0:1788270211.586949:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:2.0:1788270211.586960:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253360128:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270211.586986:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:3.0:1788270211.586993:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253360512:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270211.587128:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360256 00000100:00100000:0.0:1788270211.587134:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360256 00000100:00100000:0.0:1788270211.587170:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360384 00000100:00100000:0.0:1788270211.587173:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360384 00000100:00100000:0.0:1788270211.587192:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360768 00000100:00100000:0.0:1788270211.587193:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360768 00000100:00100000:0.0:1788270211.587208:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 314 00000100:00100000:0.0:1788270211.587214:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253360256:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270211.587308:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253360128:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 349us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270211.587316:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:2.0:1788270211.587369:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 315 00000100:00100000:2.0:1788270211.587377:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253360384:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270211.587464:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 316 00000100:00100000:1.0:1788270211.587475:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253360768:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270211.588874:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253360512:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1873us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.588874:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253360256:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1651us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.588887:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:0.0:1788270211.588887:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 314 00000100:00080000:3.0:1788270211.588923:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270211.588929:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270211.588932:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270211.589287:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253360384:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1909us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270211.589296:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 315 00000100:00100000:3.0:1788270211.591479:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270211.591689:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360640 00000100:00100000:2.0:1788270211.591701:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360640 00000100:00100000:2.0:1788270211.591776:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:2.0:1788270211.591789:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253360640:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270211.591869:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253360640:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 84us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270211.591878:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00080000:0.0:1788270211.592579:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270211.592789:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270211.592868:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253360896 00000100:00100000:0.0:1788270211.592874:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253360896 00000100:00100000:1.0:1788270211.592985:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253360768:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 5510us (6070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270211.592997:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 316 00000100:00100000:0.0:1788270211.593020:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 317 00000100:00100000:0.0:1788270211.593192:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253360896:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270211.593251:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253360896:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.593259:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 317 00000100:00080000:3.0:1788270211.593810:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270211.780247:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262719360:0@lo:400:kworker.0 00000100:00100000:1.0:1788270211.780318:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262719744:0@lo:400:kworker.0 00000100:00100000:2.0:1788270211.780333:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270211.780349:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.780416:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262719488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780443:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262719616:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780449:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.780468:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262720000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780471:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.780487:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270211.780487:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262720128:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780515:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262720512:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780518:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270211.780533:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262720640:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270211.780549:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.780557:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788270211.780563:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262719872:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780579:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719360 00000100:00100000:3.0:1788270211.780583:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270211.780586:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719360 00000100:00100000:3.0:1788270211.780597:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262720384:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780614:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.780642:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780654:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788270211.780659:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270211.780662:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262719360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780705:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719488 00000100:00100000:0.0:1788270211.780707:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262719360:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.780708:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719488 00000100:00100000:0.0:1788270211.780713:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788270211.780731:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720000 00000100:00100000:3.0:1788270211.780734:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720000 00000100:00100000:3.0:1788270211.780747:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788270211.780752:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262719488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780773:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720512 00000100:00100000:0.0:1788270211.780776:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720512 00000100:00100000:3.0:1788270211.780784:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262719488:12345-0@lo:400:kworker.0 Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.780790:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788270211.780802:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720640 00000100:00100000:3.0:1788270211.780803:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788270211.780804:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720640 00000100:00100000:3.0:1788270211.780808:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262720000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780816:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719872 00000100:00100000:0.0:1788270211.780818:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719872 00000100:00100000:0.0:1788270211.780827:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720384 00000100:00100000:0.0:1788270211.780829:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720384 00000100:00100000:3.0:1788270211.780832:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262720000:12345-0@lo:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.780838:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788270211.780839:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720896 00000100:00100000:0.0:1788270211.780841:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720896 00000100:00100000:3.0:1788270211.780854:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719744 00000100:00100000:0.0:1788270211.780854:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788270211.780857:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719744 00000100:00100000:0.0:1788270211.780859:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262720512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780877:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262719616 00000100:00100000:3.0:1788270211.780879:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262719616 00000100:00100000:0.0:1788270211.780885:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262720512:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.780892:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788270211.780897:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720128 00000100:00100000:3.0:1788270211.780899:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720128 00000100:00100000:0.0:1788270211.780903:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788270211.780908:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780911:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788270211.780916:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262719744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780931:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262720640:12345-0@lo:400:kworker.0 Request processed in 22us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.780936:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788270211.780939:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262719744:12345-0@lo:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.780945:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788270211.780947:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788270211.780952:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262719872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.780954:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788270211.780959:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262719616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780973:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262719872:12345-0@lo:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.780978:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262719616:12345-0@lo:400:kworker.0 Request processed in 20us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.780979:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788270211.780983:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788270211.780990:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788270211.780991:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788270211.780995:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262720128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.780995:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262720384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.781017:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262720128:12345-0@lo:400:kworker.0 Request processed in 20us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.781017:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262720384:12345-0@lo:400:kworker.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.781023:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788270211.781023:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788270211.781033:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788270211.781057:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262720896:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788270211.781082:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270211.781083:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262720896:12345-0@lo:400:kworker.0 Request processed in 45us (422us total) trans 0 rc 0/0 00000100:00080000:3.0:1788270211.781085:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270211.781088:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270211.781088:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:3.0:1788270211.781090:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270211.781105:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262721024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270211.781105:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262721152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270211.781127:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.781160:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270211.781160:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262719616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781170:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262720128:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781179:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262720640:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.781180:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262719872:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.781189:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262720384:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781196:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270211.781197:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781201:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262721280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270211.781205:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262719488:0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.781212:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262720000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781219:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.781221:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262720512:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781240:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721152 00000100:00100000:0.0:1788270211.781244:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721152 00000100:00100000:0.0:1788270211.781259:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721024 00000100:00100000:0.0:1788270211.781262:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721024 00000100:00100000:0.0:1788270211.781284:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721280 00000100:00100000:0.0:1788270211.781287:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721280 00000100:00100000:0.0:1788270211.781296:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788270211.781297:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262719360:0@lo:400:kworker.0 00000100:00100000:0.0:1788270211.781302:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262721152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270211.781322:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270211.781366:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262721152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.781372:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788270211.781383:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788270211.781388:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262721024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270211.781396:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270211.781421:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262721024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.781426:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788270211.781436:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788270211.781441:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262721280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270211.781454:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270211.781475:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262721280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270211.781481:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788270211.781513:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262721280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270211.781525:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262721152:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788270211.781675:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270211.781697:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262721024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270211.783270:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262719744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270211.783293:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262720256:0@lo:400:kworker.0 00000100:00100000:1.0:1788270211.783351:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270211.783380:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262720768:0@lo:400:kworker.0 00000100:00100000:1.0:1788270211.783409:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270211.783507:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720256 00000100:00100000:3.0:1788270211.783515:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720256 00000100:00100000:3.0:1788270211.783614:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788270211.783644:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262720256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270211.783742:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262720256:12345-0@lo:400:kworker.0 Request processed in 120us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270211.783749:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788270211.783831:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262720256:0@lo:400:kworker.0 00000100:00100000:2.0:1788270211.783899:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262720768 00000100:00100000:2.0:1788270211.783903:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262720768 00000100:00100000:2.0:1788270211.783955:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788270211.783963:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262720768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270211.784004:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262720768:12345-0@lo:400:kworker.0 Request processed in 42us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270211.784010:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1788270211.784118:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270211.784136:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262720768:0@lo:400:kworker.0 00000040:00080000:2.0:1788270211.929606:0:52628:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270211.929616:0:52628:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270211.930095:0:52628:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270211.930103:0:52628:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270212.548293:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270213.451213:0:52679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270213.451222:0:52679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270213.451260:0:52679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:0.0:1788270213.451266:0:52679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270213.572259:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270213.828889:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270213.828914:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262721408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270213.828982:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270213.829241:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721408 00000100:00100000:1.0:1788270213.829250:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721408 00000100:00100000:1.0:1788270213.829313:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788270213.829323:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262721408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270213.829351:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270213.829397:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262721408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270213.829403:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788270213.829443:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262721408:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788270213.829544:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270214.340299:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262721536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270214.340370:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270214.340421:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721536 00000100:00100000:0.0:1788270214.340430:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721536 00000100:00100000:0.0:1788270214.340483:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788270214.340489:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262721536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270214.340515:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270214.340716:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262721536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270214.340932:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262721536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 441us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270214.340938:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00010000:2.0:1788270214.596179:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270214.924695:0:52730:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270214.924705:0:52730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270214.924740:0:52730:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270214.924746:0:52730:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270215.620212:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270216.372894:0:52781:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270216.372904:0:52781:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270216.372942:0:52781:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270216.372949:0:52781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270216.388242:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270216.388266:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262721664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270216.388337:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270216.388413:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721664 00000100:00100000:2.0:1788270216.388422:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721664 00000100:00100000:2.0:1788270216.388526:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788270216.388537:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262721664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270216.388580:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270216.388642:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262721664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270216.388649:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788270216.388721:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262721664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270216.644278:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270216.705431:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270216.705490:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270216.705515:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270216.705578:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361408 00000100:00100000:0.0:1788270216.705599:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361408 00000100:00100000:2.0:1788270216.705614:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270216.705633:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270216.705648:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361152 00000100:00100000:3.0:1788270216.705651:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361152 00000100:00100000:3.0:1788270216.705684:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361664 00000100:00100000:3.0:1788270216.705686:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361664 00000100:00100000:1.0:1788270216.705702:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 324 00000100:00100000:0.0:1788270216.705748:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:2.0:1788270216.705749:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270216.705764:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253361408:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270216.705790:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270216.705815:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361024 00000100:00100000:2.0:1788270216.705820:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361024 00000100:00100000:2.0:1788270216.705854:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:0.0:1788270216.705854:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253361408:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270216.705867:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253361024:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270216.705868:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:2.0:1788270216.705895:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253361024:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270216.705899:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361536 00000100:00100000:2.0:1788270216.705903:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:0.0:1788270216.705906:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361536 00000100:00100000:2.0:1788270216.705932:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361280 00000100:00100000:2.0:1788270216.705936:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361280 00000100:00100000:0.0:1788270216.705941:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:0.0:1788270216.705950:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253361536:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270216.705974:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361792 00000100:00100000:3.0:1788270216.705979:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361792 00000100:00100000:0.0:1788270216.705985:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253361536:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270216.705994:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:3.0:1788270216.706003:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 325 00000100:00100000:3.0:1788270216.706010:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253361664:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:0.0:1788270216.706013:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270216.706019:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270216.706022:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270216.706024:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270216.706064:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253361664:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270216.706072:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 326 00000100:00100000:0.0:1788270216.706218:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253361792:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270216.706222:0:45777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1788270216.706231:0:45777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:2.0:1788270216.706246:0:48110:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1788270216.706251:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253361792:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270216.706257:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 327 00000100:00100000:0.0:1788270216.706265:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 326 00000100:00100000:2.0:1788270216.706270:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253361280:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270216.706303:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253361280:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 38us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270216.706310:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 327 00000100:00100000:3.0:1788270216.706494:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 325 00000100:00100000:1.0:1788270216.706500:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253361152:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270216.706551:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253361152:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 839us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.706558:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 324 00000100:00100000:2.0:1788270216.900233:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262722048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270216.900253:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270216.900269:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262721920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270216.900308:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.900361:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722048 00000100:00100000:0.0:1788270216.900369:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722048 00000100:00100000:2.0:1788270216.900376:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262721792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270216.900392:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270216.900423:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.900435:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721920 00000100:00100000:0.0:1788270216.900440:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721920 00000100:00100000:3.0:1788270216.900449:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262721792 00000100:00100000:3.0:1788270216.900454:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262721792 00000100:00100000:0.0:1788270216.900467:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788270216.900480:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262722048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270216.900485:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788270216.900494:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262721920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270216.900511:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00002000:00000024:3.0:1788270216.900513:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270216.900586:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262722048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270216.900599:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262721920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270216.900599:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788270216.900610:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788270216.900622:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788270216.900632:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262721792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270216.900643:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270216.900658:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262721920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270216.900679:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262721792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270216.900686:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1788270216.900690:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270216.900696:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270216.901737:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262722176:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.901777:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.901784:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262722432:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.901810:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262722688:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.901811:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.901828:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262722944:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.901834:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.901845:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270216.901850:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262723200:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.901859:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788270216.901864:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262722304:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.901866:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270216.901882:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788270216.901882:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270216.901886:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262722560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.901894:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262722816:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.901906:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.901910:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270216.901921:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262723072:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.901932:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722432 00000100:00100000:0.0:1788270216.901937:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722432 00000100:00100000:1.0:1788270216.901939:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270216.901967:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788270216.901974:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262722432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.902012:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262722432:12345-0@lo:400:kworker.0 Request processed in 39us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270216.902019:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788270216.902090:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722688 00000100:00100000:3.0:1788270216.902094:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722688 00000100:00100000:3.0:1788270216.902115:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722944 00000100:00100000:3.0:1788270216.902117:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722944 00000100:00100000:1.0:1788270216.902118:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722176 00000100:00100000:1.0:1788270216.902121:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722176 00000100:00100000:3.0:1788270216.902135:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723200 00000100:00100000:3.0:1788270216.902137:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723200 00000100:00100000:1.0:1788270216.902146:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788270216.902148:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722304 00000100:00100000:3.0:1788270216.902150:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722304 00000100:00100000:1.0:1788270216.902152:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262722176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270216.902158:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722816 00000100:00100000:3.0:1788270216.902160:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722816 00000100:00100000:3.0:1788270216.902170:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723072 00000100:00100000:3.0:1788270216.902173:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723072 00000100:00100000:3.0:1788270216.902186:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788270216.902186:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262722176:12345-0@lo:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270216.902191:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262722688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.902191:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270216.902218:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788270216.902219:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262722688:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.902225:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262722944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270216.902228:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788270216.902240:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788270216.902246:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262723200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.902249:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262722944:12345-0@lo:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.902254:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788270216.902267:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788270216.902268:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262723200:12345-0@lo:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.902272:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262722304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270216.902273:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788270216.902283:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788270216.902289:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262722816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.902293:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262722304:12345-0@lo:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.902299:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788270216.902309:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262722816:12345-0@lo:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.902309:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788270216.902314:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788270216.902315:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262723072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788270216.902327:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270216.902330:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270216.902337:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262723072:12345-0@lo:400:kworker.0 Request processed in 23us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270216.902342:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788270216.902351:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262722560 00000100:00100000:3.0:1788270216.902354:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262722560 00000100:00100000:3.0:1788270216.902386:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788270216.902392:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262722560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270216.902422:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262722560:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270216.902427:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788270216.902443:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270216.903647:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262722560:0@lo:400:kworker.0 00000100:00100000:2.0:1788270216.903661:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262722048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270216.903667:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262723072:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.903686:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262722688:0@lo:400:kworker.0 00000100:00100000:2.0:1788270216.903688:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262721792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270216.903700:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262723200:0@lo:400:kworker.0 00000100:00100000:1.0:1788270216.903714:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262722176:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.903966:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262722304:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.903978:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262722816:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.903988:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262722432:0@lo:400:kworker.0 00000100:00100000:0.0:1788270216.903996:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262722944:0@lo:400:kworker.0 00010000:00010000:2.0:1788270217.668238:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270217.806550:0:52833:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270217.806560:0:52833:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270217.806591:0:52833:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:2.0:1788270217.806596:0:52833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270218.692210:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270218.948326:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262723328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270218.948412:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270218.948524:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723328 00000100:00100000:2.0:1788270218.948532:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723328 00000100:00100000:2.0:1788270218.948598:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788270218.948609:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262723328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270218.948640:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270218.948696:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262723328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270218.948704:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788270218.948787:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262723328:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788270218.948855:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788270219.216006:0:52885:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270219.216014:0:52885:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270219.216052:0:52885:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:1.0:1788270219.216058:0:52885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270219.460438:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270219.460460:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262723456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270219.460554:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270219.460881:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723456 00000100:00100000:2.0:1788270219.460889:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723456 00000100:00100000:2.0:1788270219.460976:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788270219.460987:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262723456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270219.461019:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270219.461101:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262723456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270219.461109:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788270219.461180:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262723456:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270219.717727:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270219.972176:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270219.972183:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270219.972961:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270219.973028:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788270220.648102:0:52936:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270220.648109:0:52936:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270220.648146:0:52936:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 5 00000040:00080000:3.0:1788270220.648153:0:52936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270220.740284:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270220.742257:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270220.742264:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270220.742349:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:0.0:1788270220.742357:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270221.508374:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262723584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270221.508447:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270221.509016:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723584 00000100:00100000:0.0:1788270221.509025:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723584 00000100:00100000:0.0:1788270221.509096:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788270221.509106:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262723584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270221.509136:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270221.509257:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262723584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270221.509264:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788270221.511708:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262723584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270221.764288:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270221.825473:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270221.825515:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270221.825532:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362048 00000100:00100000:3.0:1788270221.825543:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362048 00000100:00100000:2.0:1788270221.825560:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270221.825584:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362304 00000100:00100000:1.0:1788270221.825590:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362304 00000100:00100000:2.0:1788270221.825595:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270221.825612:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362560 00000100:00100000:3.0:1788270221.825618:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362560 00000100:00100000:2.0:1788270221.825623:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270221.825650:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362176 00000100:00100000:2.0:1788270221.825654:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270221.825654:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 155 00000100:00100000:3.0:1788270221.825656:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362176 00000100:00100000:1.0:1788270221.825672:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253362304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270221.825687:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 334 00000100:00100000:2.0:1788270221.825690:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270221.825699:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253362048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270221.825707:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253361920 00000100:00100000:2.0:1788270221.825720:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253361920 00000100:00100000:3.0:1788270221.825746:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253362048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270221.825748:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253362304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270221.825757:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 334 00000100:00100000:2.0:1788270221.825762:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 222 00000100:00100000:1.0:1788270221.825763:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 155 00000100:00100000:2.0:1788270221.825776:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253361920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270221.825778:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362688 00000100:00100000:3.0:1788270221.825783:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362688 00000100:00100000:1.0:1788270221.825786:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362432 00000100:00100000:1.0:1788270221.825790:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362432 00000100:00100000:2.0:1788270221.825804:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253361920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270221.825815:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 335 00000100:00100000:2.0:1788270221.825815:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 222 00000100:00100000:1.0:1788270221.825821:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 156 00000100:00100000:3.0:1788270221.825832:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253362560:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270221.825833:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253362432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270221.825848:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 336 00000100:00100000:2.0:1788270221.825856:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253362176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270221.825870:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253362432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270221.825878:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 156 00000100:00100000:3.0:1788270221.825879:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253362560:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270221.825891:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253362176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270221.825892:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 335 00000100:00100000:1.0:1788270221.825901:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 337 00000100:00100000:2.0:1788270221.825907:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 336 00000100:00100000:1.0:1788270221.825913:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253362688:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788270221.825920:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270221.825927:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270221.825930:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270221.825934:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270221.825949:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253362688:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270221.825957:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 337 00000100:00100000:2.0:1788270222.020268:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262723712:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020268:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262724096:0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.020341:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270222.020386:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262724224:0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.020417:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270222.020442:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262724736:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020570:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020594:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262724608:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020618:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020637:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262725120:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020702:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262723840:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020728:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020747:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262724352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020769:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020784:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262724864:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020817:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020836:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262725376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270222.020859:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020878:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788270222.020899:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262723968:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020922:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020956:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262724480:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.020981:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.020999:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262724992:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.021021:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.021056:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262725504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270222.021078:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.021106:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724096 00000100:00100000:1.0:1788270222.021113:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724096 00000100:00100000:1.0:1788270222.021165:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724608 00000100:00100000:1.0:1788270222.021169:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724608 00000100:00100000:1.0:1788270222.021186:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725120 00000100:00100000:1.0:1788270222.021189:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725120 00000100:00100000:1.0:1788270222.021217:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724864 00000100:00100000:1.0:1788270222.021220:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724864 00000100:00100000:1.0:1788270222.021244:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724992 00000100:00100000:0.0:1788270222.021245:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725376 00000100:00100000:1.0:1788270222.021248:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724992 00000100:00100000:0.0:1788270222.021252:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725376 00000100:00100000:1.0:1788270222.021272:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788270222.021282:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262724096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.021292:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725504 00000100:00100000:0.0:1788270222.021297:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725504 00000100:00100000:0.0:1788270222.021321:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788270222.021330:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262725376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270222.021340:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262724096:12345-0@lo:400:kworker.0 Request processed in 60us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.021350:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00002000:00000024:0.0:1788270222.021354:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270222.021370:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788270222.021378:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262724608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.021401:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262725376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270222.021409:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788270222.021420:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262724608:12345-0@lo:400:kworker.0 Request processed in 43us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270222.021429:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788270222.021430:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788270222.021442:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25eb1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262725504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270222.021460:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788270222.021470:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262725120:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788270222.021471:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000040:00080000:3.0:1788270222.021496:0:52988:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270222.021502:0:52988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788270222.021517:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25eb1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262725504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.021520:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262725120:12345-0@lo:400:kworker.0 Request processed in 51us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270222.021535:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788270222.021538:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000040:00080000:3.0:1788270222.021546:0:52988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:3.0:1788270222.021553:0:52988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270222.021559:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788270222.021569:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262724864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.021604:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262724864:12345-0@lo:400:kworker.0 Request processed in 37us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.021612:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788270222.021630:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788270222.021638:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262724992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.021672:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262724992:12345-0@lo:400:kworker.0 Request processed in 36us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.021679:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788270222.021703:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723840 00000100:00100000:1.0:1788270222.021707:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723840 00000100:00100000:1.0:1788270222.021736:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724352 00000100:00100000:1.0:1788270222.021739:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724352 00000100:00100000:1.0:1788270222.021764:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723968 00000100:00100000:1.0:1788270222.021767:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723968 00000100:00100000:1.0:1788270222.021782:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724480 00000100:00100000:1.0:1788270222.021785:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724480 00000100:00100000:1.0:1788270222.021804:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788270222.021813:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262723840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.021831:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788270222.021842:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262724352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.021848:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262723840:12345-0@lo:400:kworker.0 Request processed in 36us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.021856:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788270222.021872:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788270222.021881:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262724352:12345-0@lo:400:kworker.0 Request processed in 40us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.021882:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262723968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.021896:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788270222.021917:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788270222.021926:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262723968:12345-0@lo:400:kworker.0 Request processed in 45us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270222.021927:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262724480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.021940:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788270222.021975:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262724480:12345-0@lo:400:kworker.0 Request processed in 50us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270222.021982:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788270222.021983:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270222.021989:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270222.021993:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270222.021996:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270222.022055:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262724096:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022073:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262723968:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.022075:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262724608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022096:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262724480:0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.022099:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262725120:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022117:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262724992:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022135:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262725504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270222.022145:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262723840:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022152:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262724352:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022159:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262724864:0@lo:400:kworker.0 00000100:00100000:0.0:1788270222.022166:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262725376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270222.022545:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.022563:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724736 00000100:00100000:1.0:1788270222.022568:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724736 00000100:00100000:2.0:1788270222.022572:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262725248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270222.022599:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270222.022610:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788270222.022617:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262724736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.022645:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262723712 00000100:00100000:2.0:1788270222.022652:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262723712 00000100:00100000:1.0:1788270222.022653:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262724736:12345-0@lo:400:kworker.0 Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.022668:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788270222.022687:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788270222.022697:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262723712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270222.022702:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262724736:0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.022737:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262723712:12345-0@lo:400:kworker.0 Request processed in 41us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.022744:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262723712:0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.022746:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788270222.022786:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262724224 00000100:00100000:2.0:1788270222.022790:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262724224 00000100:00100000:2.0:1788270222.022816:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788270222.022824:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262724224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.022873:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262724224:12345-0@lo:400:kworker.0 Request processed in 50us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270222.022896:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262724224:0@lo:400:kworker.0 00000100:00100000:2.0:1788270222.022940:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788270222.022968:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725248 00000100:00100000:2.0:1788270222.022972:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725248 00000100:00100000:2.0:1788270222.022999:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788270222.023007:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262725248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270222.023020:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270222.023082:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262725248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270222.023090:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788270222.023124:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262725248:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788270222.025535:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788270222.788246:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270223.448171:0:53039:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270223.448179:0:53039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270223.448209:0:53039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:1.0:1788270223.448215:0:53039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270223.815495:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270224.068297:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270224.068322:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262725632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270224.068380:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270224.068476:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725632 00000100:00100000:0.0:1788270224.068485:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725632 00000100:00100000:0.0:1788270224.068560:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788270224.068571:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262725632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270224.068603:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270224.068728:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262725632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270224.068736:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788270224.068985:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270224.070573:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262725632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270224.581192:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262725760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270224.581263:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270224.581388:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725760 00000100:00100000:1.0:1788270224.581406:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725760 00000100:00100000:1.0:1788270224.581459:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788270224.581468:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262725760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270224.581501:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270224.581545:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262725760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270224.581553:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788270224.581631:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262725760:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270224.836159:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270224.921082:0:53090:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270224.921092:0:53090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270224.921121:0:53090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:0.0:1788270224.921127:0:53090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270225.861030:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270226.353786:0:53142:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270226.353793:0:53142:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270226.353812:0:53142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:1.0:1788270226.353816:0:53142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270226.628277:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262725888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270226.628348:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270226.628411:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262725888 00000100:00100000:1.0:1788270226.628419:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262725888 00000100:00100000:1.0:1788270226.628465:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788270226.628475:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262725888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270226.628509:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270226.628563:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262725888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270226.628570:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788270226.628663:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262725888:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270226.888016:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270226.946712:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270226.946789:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270226.946816:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270226.946847:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363072 00000100:00100000:2.0:1788270226.946854:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270226.946858:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363072 00000100:00100000:2.0:1788270226.946882:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270226.946905:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270226.946921:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363584 00000100:00100000:1.0:1788270226.946925:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363584 00000100:00100000:2.0:1788270226.946937:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270226.947003:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363328 00000100:00100000:0.0:1788270226.947009:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363328 00000100:00100000:0.0:1788270226.947081:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363200 00000100:00100000:0.0:1788270226.947085:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363200 00000100:00100000:0.0:1788270226.947111:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:0.0:1788270226.947122:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253363328:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270226.947206:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253363328:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 85us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270226.947214:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:0.0:1788270226.947231:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:0.0:1788270226.947237:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253363200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270226.947259:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253363200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270226.947266:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:1.0:1788270226.947319:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362944 00000100:00100000:1.0:1788270226.947324:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362944 00000100:00100000:1.0:1788270226.947366:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363456 00000100:00100000:1.0:1788270226.947370:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363456 00000100:00100000:1.0:1788270226.947390:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 344 00000100:00100000:1.0:1788270226.947397:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253363072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270226.947430:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253363072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270226.947437:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 344 00000100:00100000:1.0:1788270226.947454:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 345 00000100:00100000:1.0:1788270226.947460:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253363584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270226.947484:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 346 00000100:00100000:1.0:1788270226.947492:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253363584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270226.947499:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253362944:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270226.947505:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 345 00000100:00100000:1.0:1788270226.947523:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 347 00000100:00100000:1.0:1788270226.947532:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253363456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270226.947538:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253362944:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 43us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270226.947547:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 346 00000100:00100000:1.0:1788270226.947567:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253363456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270226.947575:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 347 00000100:00080000:2.0:1788270226.947594:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270226.947599:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270226.947602:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270226.947604:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270226.947725:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253362816 00000100:00100000:3.0:1788270226.947729:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253362816 00000100:00100000:3.0:1788270226.947765:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:3.0:1788270226.947772:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253362816:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270226.947803:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253362816:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270226.947810:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:1.0:1788270227.140215:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262726016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270227.140225:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262726144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270227.140237:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262726272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270227.140488:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270227.140516:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262726400:0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.140554:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262726656:0@lo:400:kworker.0 00000100:00100000:3.0:1788270227.140562:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270227.140593:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262726912:0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.140600:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270227.140630:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270227.140642:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262727168:0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.140651:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270227.140659:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262727424:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.140660:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726912 00000100:00100000:2.0:1788270227.140670:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726912 00000100:00100000:0.0:1788270227.140682:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270227.140694:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262726528:0@lo:400:kworker.0 00000100:00100000:3.0:1788270227.140701:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270227.140719:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262727680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.140729:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788270227.140834:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270227.140855:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262726912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.140857:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262727040:0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.140887:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270227.140912:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262727552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.140924:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262726912:12345-0@lo:400:kworker.0 Request processed in 183us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270227.140933:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788270227.140944:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270227.140965:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262726912:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.140968:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726656 00000100:00100000:2.0:1788270227.140973:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726656 00000100:00100000:1.0:1788270227.140976:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726400 00000100:00100000:0.0:1788270227.140977:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788270227.140984:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726400 00000100:00100000:0.0:1788270227.140986:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262726784:0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141009:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270227.141015:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727168 00000100:00100000:2.0:1788270227.141020:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727168 00000100:00100000:3.0:1788270227.141029:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727424 00000100:00100000:0.0:1788270227.141031:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262727296:0@lo:400:kworker.0 00000100:00100000:3.0:1788270227.141035:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727424 00000100:00100000:1.0:1788270227.141036:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788270227.141071:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262726400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141075:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726528 00000100:00100000:0.0:1788270227.141079:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270227.141080:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726528 00000100:00100000:0.0:1788270227.141103:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262727808:0@lo:400:kworker.0 00000100:00100000:3.0:1788270227.141107:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727680 00000100:00100000:2.0:1788270227.141107:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727040 00000100:00100000:2.0:1788270227.141112:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727040 00000100:00100000:3.0:1788270227.141113:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727680 00000100:00100000:2.0:1788270227.141132:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788270227.141137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270227.141144:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262726656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.141149:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262726400:12345-0@lo:400:kworker.0 Request processed in 80us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270227.141150:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726784 00000100:00100000:3.0:1788270227.141155:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726784 00000100:00100000:1.0:1788270227.141159:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788270227.141168:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726144 00000100:00100000:0.0:1788270227.141173:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726144 00000100:00100000:3.0:1788270227.141179:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727296 00000100:00100000:3.0:1788270227.141184:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727296 00000100:00100000:1.0:1788270227.141203:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788270227.141209:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727808 00000100:00100000:0.0:1788270227.141211:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726016 00000100:00100000:3.0:1788270227.141213:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727808 00000100:00100000:2.0:1788270227.141216:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262726656:12345-0@lo:400:kworker.0 Request processed in 72us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270227.141217:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262727168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141218:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726016 00000100:00100000:2.0:1788270227.141230:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788270227.141241:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788270227.141246:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788270227.141253:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262727424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141257:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262726144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270227.141260:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788270227.141267:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262727168:12345-0@lo:400:kworker.0 Request processed in 54us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270227.141275:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262726528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.141278:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00002000:00000024:0.0:1788270227.141295:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270227.141308:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262727424:12345-0@lo:400:kworker.0 Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270227.141308:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788270227.141319:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788270227.141325:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262727040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141326:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262726528:12345-0@lo:400:kworker.0 Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270227.141340:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788270227.141345:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788270227.141347:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262726144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270227.141367:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788270227.141370:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262727680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141384:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788270227.141389:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262727040:12345-0@lo:400:kworker.0 Request processed in 67us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270227.141398:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262726016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270227.141400:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788270227.141414:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262727680:12345-0@lo:400:kworker.0 Request processed in 60us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270227.141414:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00002000:00000024:2.0:1788270227.141416:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270227.141429:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788270227.141435:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262726784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.141441:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788270227.141453:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262727296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270227.141454:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788270227.141466:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262727808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141479:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262726784:12345-0@lo:400:kworker.0 Request processed in 49us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270227.141486:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788270227.141504:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262727296:12345-0@lo:400:kworker.0 Request processed in 54us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270227.141516:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788270227.141517:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262727808:12345-0@lo:400:kworker.0 Request processed in 48us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270227.141518:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262726016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270227.141519:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270227.141538:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788270227.141538:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788270227.141538:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727552 00000100:00100000:1.0:1788270227.141544:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727552 00000100:00100000:0.0:1788270227.141557:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262726016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270227.141577:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270227.141582:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262726528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141585:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788270227.141595:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262727552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141597:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262727040:0@lo:400:kworker.0 00000100:00100000:1.0:1788270227.141628:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262726400:0@lo:400:kworker.0 00000100:00080000:3.0:1788270227.141631:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270227.141635:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262727552:12345-0@lo:400:kworker.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00080000:3.0:1788270227.141640:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270227.141640:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262726272 00000100:00100000:2.0:1788270227.141644:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:3.0:1788270227.141646:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270227.141647:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262726272 00000100:00100000:1.0:1788270227.141649:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262727424:0@lo:400:kworker.0 00000100:00080000:3.0:1788270227.141651:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270227.141683:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788270227.141687:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262726784:0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141693:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262726272:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270227.141703:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262727552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141706:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262727296:0@lo:400:kworker.0 00002000:00000024:0.0:1788270227.141706:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270227.141727:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262727808:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141740:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262726656:0@lo:400:kworker.0 00000100:00100000:0.0:1788270227.141747:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262726272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270227.141752:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788270227.141756:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262727168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141770:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262727680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270227.141786:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262726144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270227.141838:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262726272:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788270227.871430:0:53193:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270227.871440:0:53193:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270227.871470:0:53193:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:2.0:1788270227.871480:0:53193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270227.909616:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270228.932556:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270229.188798:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262727936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270229.188854:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270229.188884:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262727936 00000100:00100000:3.0:1788270229.188894:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262727936 00000100:00080000:0.0:1788270229.188950:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270229.188969:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788270229.188981:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262727936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270229.189015:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270229.189096:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262727936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270229.189105:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788270229.189137:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262727936:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788270229.189205:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270229.189209:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270229.189836:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270229.189845:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:0.0:1788270229.335814:0:53244:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270229.335823:0:53244:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270229.335852:0:53244:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:0.0:1788270229.335857:0:53244:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270229.700286:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270229.700376:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262728064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270229.700457:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270229.700800:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728064 00000100:00100000:1.0:1788270229.700808:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728064 00000100:00100000:2.0:1788270229.700886:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788270229.700900:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262728064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270229.700933:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270229.701005:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262728064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270229.701012:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788270229.701156:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262728064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270229.956331:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270230.767508:0:53295:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270230.767518:0:53295:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270230.767548:0:53295:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:2.0:1788270230.767556:0:53295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270230.980228:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270230.980572:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270230.980579:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270230.980616:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:3.0:1788270230.980626:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270231.748673:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262728192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270231.748782:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270231.749460:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728192 00000100:00100000:3.0:1788270231.749469:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728192 00000100:00100000:3.0:1788270231.749536:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788270231.749546:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262728192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270231.749660:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270231.749760:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262728192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270231.749768:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788270231.749952:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262728192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270232.010727:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270232.066333:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270232.066369:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270232.066390:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270232.066417:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270232.066444:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270232.066474:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363840 00000100:00100000:0.0:1788270232.066484:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363840 00000100:00100000:0.0:1788270232.066540:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364352 00000100:00100000:0.0:1788270232.066544:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364352 00000100:00100000:0.0:1788270232.066569:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363968 00000100:00100000:0.0:1788270232.066572:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363968 00000100:00100000:0.0:1788270232.066597:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 354 00000100:00100000:0.0:1788270232.066607:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253363840:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270232.066683:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253363840:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270232.066690:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 354 00000100:00100000:3.0:1788270232.066718:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 355 00000100:00100000:3.0:1788270232.066729:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253364352:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270232.066791:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253364352:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 64us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270232.067463:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 356 00000100:00100000:3.0:1788270232.067472:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 355 00000100:00100000:0.0:1788270232.067476:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253363968:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270232.067514:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253363968:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270232.067520:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 356 00000100:00080000:0.0:1788270232.067537:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270232.067541:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270232.067551:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253363712 00000100:00100000:3.0:1788270232.067557:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253363712 00000100:00100000:0.0:1788270232.067590:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270232.067599:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:3.0:1788270232.067608:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253363712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270232.067656:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253363712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 50us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.067665:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:0.0:1788270232.067715:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270232.067716:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364096 00000100:00100000:3.0:1788270232.067721:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364096 00000100:00100000:3.0:1788270232.067759:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364224 00000100:00100000:3.0:1788270232.067763:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364224 00000100:00100000:3.0:1788270232.067792:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:3.0:1788270232.067800:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253364096:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270232.067836:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253364096:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.067843:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:3.0:1788270232.067856:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788270232.067865:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253364224:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270232.067962:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253364224:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 98us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.067969:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:0.0:1788270232.068331:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364480 00000100:00100000:0.0:1788270232.068336:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364480 00000100:00100000:0.0:1788270232.068376:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 357 00000100:00100000:0.0:1788270232.068382:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253364480:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270232.068403:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253364480:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270232.068410:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 357 00000100:00080000:0.0:1788270232.068422:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270232.068424:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270232.068425:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788270232.231700:0:53346:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270232.231710:0:53346:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270232.231740:0:53346:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:1.0:1788270232.231747:0:53346:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270232.260391:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270232.260414:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262728704:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260432:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262728832:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260499:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.260585:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262729344:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260626:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.260647:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262728448:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260657:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262729856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.260694:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.260699:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.260736:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788270232.260736:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262728960:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260757:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262729216:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.260781:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.260789:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.260810:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262729472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260816:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262729728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.260841:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.260861:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728832 00000100:00100000:3.0:1788270232.260868:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728832 00000100:00100000:1.0:1788270232.260887:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262729984:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.260910:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.260929:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788270232.260935:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262728576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270232.260936:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729344 00000100:00100000:3.0:1788270232.260941:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729344 00000100:00100000:1.0:1788270232.260964:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.260965:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729216 00000100:00100000:3.0:1788270232.260969:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729216 00000100:00100000:1.0:1788270232.260985:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262729088:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.260993:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788270232.261003:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262728832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261021:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.261056:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262729600:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.261088:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262728832:12345-0@lo:400:kworker.0 Request processed in 85us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270232.261090:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.261102:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788270232.261120:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270232.261122:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788270232.261132:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262730112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270232.261133:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262729344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261167:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270232.261185:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262729344:12345-0@lo:400:kworker.0 Request processed in 54us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261192:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788270232.261202:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728448 00000100:00100000:1.0:1788270232.261206:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728448 00000100:00100000:3.0:1788270232.261210:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788270232.261221:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262729216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261237:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788270232.261244:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262728448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.261260:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262729216:12345-0@lo:400:kworker.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261280:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788270232.261299:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262728448:12345-0@lo:400:kworker.0 Request processed in 55us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261302:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729856 00000100:00100000:3.0:1788270232.261307:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729856 00000100:00100000:1.0:1788270232.261311:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788270232.261345:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728960 00000100:00100000:3.0:1788270232.261350:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728960 00000100:00100000:1.0:1788270232.261350:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729472 00000100:00100000:1.0:1788270232.261357:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729472 00000100:00100000:3.0:1788270232.261369:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729984 00000100:00100000:3.0:1788270232.261373:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729984 00000100:00100000:1.0:1788270232.261393:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729600 00000100:00100000:3.0:1788270232.261399:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788270232.261399:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729600 00000100:00100000:2.0:1788270232.261405:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262728448:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.261415:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262729856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261433:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788270232.261449:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.261464:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262729856:12345-0@lo:400:kworker.0 Request processed in 54us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261472:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788270232.261487:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788270232.261493:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262728960:12345-0@lo:400:kworker.0 Request processed in 52us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261498:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262729472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261504:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788270232.261518:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788270232.261523:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262729984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.261547:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262729472:12345-0@lo:400:kworker.0 Request processed in 52us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261553:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788270232.261562:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262728960:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261570:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262729984:12345-0@lo:400:kworker.0 Request processed in 44us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261575:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788270232.261580:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262729472:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261585:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788270232.261588:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262729600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270232.261600:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262729984:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261626:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728576 00000100:00100000:3.0:1788270232.261631:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262729600:12345-0@lo:400:kworker.0 Request processed in 46us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270232.261632:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728576 00000100:00100000:2.0:1788270232.261637:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262729600:0@lo:400:kworker.0 00000100:00100000:3.0:1788270232.261643:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788270232.261665:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730112 00000100:00100000:1.0:1788270232.261668:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730112 00000100:00080000:3.0:1788270232.261675:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270232.261679:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270232.261681:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1788270232.261683:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270232.261687:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262728576:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788270232.261688:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788270232.261708:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270232.261714:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.261750:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262728576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270232.261755:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262728320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270232.261758:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788270232.261770:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788270232.261776:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262730112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270232.261783:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270232.261791:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.261811:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262730112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270232.261816:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788270232.261824:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728320 00000100:00100000:1.0:1788270232.261826:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728320 00000100:00100000:1.0:1788270232.261845:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788270232.261849:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262728320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270232.261858:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270232.261876:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262728320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270232.261879:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788270232.261892:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729088 00000100:00100000:1.0:1788270232.261894:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729088 00000100:00100000:1.0:1788270232.261908:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788270232.261911:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262729088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261930:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262729088:12345-0@lo:400:kworker.0 Request processed in 18us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270232.261933:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788270232.261963:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270232.261987:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262729344:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.261999:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262729856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.262008:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262728832:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.262025:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262729216:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.262064:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262729728 00000100:00100000:1.0:1788270232.262068:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262729728 00000100:00100000:1.0:1788270232.262098:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788270232.262105:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262729728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.262137:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262729728:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270232.262141:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788270232.262161:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262729728:0@lo:400:kworker.0 00000100:00100000:1.0:1788270232.262177:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262730112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270232.262184:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262728576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270232.262189:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262729088:0@lo:400:kworker.0 00000100:00100000:2.0:1788270232.262403:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262728704 00000100:00100000:2.0:1788270232.262408:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262728704 00000100:00080000:3.0:1788270232.262409:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270232.262415:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270232.262442:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262728320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270232.262449:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788270232.262461:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262728704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270232.262507:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262728704:12345-0@lo:400:kworker.0 Request processed in 50us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270232.262514:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788270232.262543:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262728704:0@lo:400:kworker.0 00010000:00010000:3.0:1788270233.029019:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270233.686546:0:53398:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270233.686555:0:53398:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270233.686584:0:53398:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:3.0:1788270233.686590:0:53398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270234.052220:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270234.308745:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262730240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270234.308832:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270234.308942:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730240 00000100:00100000:0.0:1788270234.308950:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730240 00000100:00100000:0.0:1788270234.309018:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788270234.309029:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262730240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270234.309074:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270234.309120:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262730240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270234.309128:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788270234.309174:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262730240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788270234.309450:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270234.820218:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270234.820380:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262730368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270234.820478:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270234.820791:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730368 00000100:00100000:2.0:1788270234.820800:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730368 00000100:00100000:2.0:1788270234.820868:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788270234.820879:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262730368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270234.820913:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270234.820958:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262730368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270234.820965:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788270234.821093:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262730368:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270235.077989:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270235.145889:0:53449:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270235.145900:0:53449:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270235.145927:0:53449:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:3.0:1788270235.145932:0:53449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270236.100342:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270236.634722:0:53500:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270236.634730:0:53500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270236.634760:0:53500:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:2.0:1788270236.634767:0:53500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270236.868960:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262730496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270236.869063:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270236.871273:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730496 00000100:00100000:3.0:1788270236.871286:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730496 00000100:00100000:3.0:1788270236.871357:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788270236.871367:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262730496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270236.871403:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270236.871489:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262730496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270236.871497:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788270236.871664:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262730496:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270237.124234:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270237.185708:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270237.185808:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270237.185927:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364736 00000100:00100000:1.0:1788270237.185937:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364736 00000100:00100000:1.0:1788270237.186009:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 364 00000100:00100000:1.0:1788270237.186020:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253364736:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270237.186085:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364608 00000100:00100000:3.0:1788270237.186090:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364608 00000100:00100000:1.0:1788270237.186120:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253364736:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 102us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270237.186128:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:1.0:1788270237.186140:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 364 00000100:00100000:3.0:1788270237.186142:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253364608:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270237.186174:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253364608:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270237.186246:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00080000:0.0:1788270237.186405:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270237.186923:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270237.186952:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270237.186989:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364992 00000100:00100000:0.0:1788270237.186995:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364992 00000100:00100000:3.0:1788270237.187032:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270237.187117:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:0.0:1788270237.187125:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253364992:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270237.187175:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253364992:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270237.187197:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:3.0:1788270237.187242:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270237.187262:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365120 00000100:00100000:3.0:1788270237.187266:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365120 00000100:00100000:1.0:1788270237.187294:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365248 00000100:00100000:1.0:1788270237.187298:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365248 00000100:00100000:0.0:1788270237.187334:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270237.187359:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253364864 00000100:00100000:0.0:1788270237.187362:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253364864 00000100:00080000:2.0:1788270237.187474:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270237.187479:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270237.187481:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270237.187484:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270237.187513:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365376 00000100:00100000:2.0:1788270237.187517:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365376 00000100:00100000:2.0:1788270237.187557:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 365 00000100:00100000:2.0:1788270237.187564:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253365376:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270237.187602:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:3.0:1788270237.187615:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253365120:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270237.187616:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253365376:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270237.187634:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 365 00000100:00100000:3.0:1788270237.187648:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253365120:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 38us (405us total) trans 0 rc 0/0 00000100:00080000:2.0:1788270237.187654:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270237.187659:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:1.0:1788270237.187953:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 366 00000100:00100000:1.0:1788270237.187963:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253365248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270237.187978:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 367 00000100:00100000:0.0:1788270237.187988:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253364864:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270237.188002:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253365248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.188010:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 366 00000100:00100000:0.0:1788270237.188022:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253364864:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270237.188031:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 367 00000100:00100000:1.0:1788270237.380417:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262730880:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380487:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.380542:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262731392:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380570:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.380585:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262731904:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380607:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.380630:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788270237.380636:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262730752:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380669:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.380690:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262731264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380710:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.380723:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262731776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380740:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.380766:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730880 00000100:00100000:1.0:1788270237.380773:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730880 00000100:00100000:1.0:1788270237.380818:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731392 00000100:00100000:1.0:1788270237.380821:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731392 00000100:00100000:1.0:1788270237.380839:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788270237.380846:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262730880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380892:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262730880:12345-0@lo:400:kworker.0 Request processed in 46us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.380899:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788270237.380912:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788270237.380918:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262731392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.380940:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262731392:12345-0@lo:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.380946:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788270237.380961:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731904 00000100:00100000:1.0:1788270237.380964:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731904 00000100:00100000:1.0:1788270237.380985:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731776 00000100:00100000:1.0:1788270237.380987:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731776 00000100:00100000:1.0:1788270237.381000:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788270237.381006:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262731904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.381032:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262731904:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.381059:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788270237.381070:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788270237.381076:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262731776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.381100:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262731776:12345-0@lo:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.381105:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788270237.381122:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262731008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.381208:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.381225:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262731520:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.381245:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.381260:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262732032:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.382478:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.382512:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788270237.382521:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262730624:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.382548:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.382575:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262731136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.382594:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.382607:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262731648:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.382625:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.382641:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262732160:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.382659:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270237.382696:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262732288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270237.382702:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730624 00000100:00100000:1.0:1788270237.382709:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730624 00000100:00100000:0.0:1788270237.382722:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270237.382755:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788270237.382766:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262730624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.382773:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732288 00000100:00100000:0.0:1788270237.382777:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732288 00000100:00100000:0.0:1788270237.382804:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788270237.382810:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262732288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270237.382817:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262730624:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.382825:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00002000:00000024:0.0:1788270237.382829:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270237.382859:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731008 00000100:00100000:1.0:1788270237.382864:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731008 00000100:00100000:0.0:1788270237.382864:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262732288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270237.382871:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788270237.382888:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731520 00000100:00100000:1.0:1788270237.382891:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731520 00000100:00100000:1.0:1788270237.382909:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788270237.382912:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262732288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270237.382932:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262731008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.382944:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732032 00000100:00100000:0.0:1788270237.382949:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732032 00000100:00100000:1.0:1788270237.382966:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262731008:12345-0@lo:400:kworker.0 Request processed in 35us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270237.382973:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731136 00000100:00100000:1.0:1788270237.382974:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788270237.382979:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731136 00000100:00100000:1.0:1788270237.382992:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788270237.382999:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731648 00000100:00100000:1.0:1788270237.383002:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262731520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.383004:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731648 00000100:00100000:0.0:1788270237.383021:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732160 00000100:00100000:0.0:1788270237.383024:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732160 00000100:00100000:0.0:1788270237.383054:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788270237.383057:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262731520:12345-0@lo:400:kworker.0 Request processed in 39us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270237.383062:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262732032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.383072:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788270237.383095:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262732032:12345-0@lo:400:kworker.0 Request processed in 34us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.383098:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788270237.383106:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788270237.383111:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262731136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.383121:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788270237.383129:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262731648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.383149:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262731136:12345-0@lo:400:kworker.0 Request processed in 41us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270237.383157:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788270237.383170:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262731648:12345-0@lo:400:kworker.0 Request processed in 41us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270237.383371:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262730752 00000100:00100000:2.0:1788270237.383376:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262730752 00000100:00100000:2.0:1788270237.383403:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262731264 00000100:00100000:2.0:1788270237.383406:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262731264 00000100:00100000:2.0:1788270237.383420:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788270237.383426:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270237.383462:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262730752:12345-0@lo:400:kworker.0 Request processed in 37us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270237.383468:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788270237.383482:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788270237.383489:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262731264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270237.383514:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262731264:12345-0@lo:400:kworker.0 Request processed in 26us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270237.383519:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:2.0:1788270237.383539:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270237.383543:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270237.383546:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270237.383548:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270237.383662:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270237.383672:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262732544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270237.383698:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270237.383737:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732544 00000100:00100000:2.0:1788270237.383741:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732544 00000100:00100000:2.0:1788270237.383763:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788270237.383769:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262732544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270237.383779:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270237.383807:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262732544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270237.383814:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788270237.383840:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262732544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270237.384228:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788270237.384239:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262732160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.384291:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262732160:12345-0@lo:400:kworker.0 Request processed in 54us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270237.385267:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788270237.385299:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270237.385313:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262732416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270237.385346:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270237.385381:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732416 00000100:00100000:3.0:1788270237.385386:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732416 00000100:00100000:3.0:1788270237.385414:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788270237.385421:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262732416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270237.385441:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270237.385471:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262732416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270237.385477:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788270237.385507:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262732416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270237.385591:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262730752:0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.385605:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262731264:0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.385619:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262731776:0@lo:400:kworker.0 00000100:00100000:3.0:1788270237.385631:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262730624:0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.385635:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262730880:0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.385654:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262731392:0@lo:400:kworker.0 00000100:00100000:0.0:1788270237.385664:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262731904:0@lo:400:kworker.0 00000100:00100000:1.0:1788270237.385755:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788270237.385800:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262731136:0@lo:400:kworker.0 00000100:00100000:3.0:1788270237.385817:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262731648:0@lo:400:kworker.0 00000100:00100000:3.0:1788270237.385827:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262732160:0@lo:400:kworker.0 00000100:00100000:3.0:1788270237.385837:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262731008:0@lo:400:kworker.0 00000100:00100000:3.0:1788270237.385846:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262731520:0@lo:400:kworker.0 00000100:00100000:3.0:1788270237.385856:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262732032:0@lo:400:kworker.0 00000040:00080000:2.0:1788270238.073784:0:53551:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270238.073794:0:53551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270238.073823:0:53551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:2.0:1788270238.073829:0:53551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270238.149882:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270239.173561:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270239.432420:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262732672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270239.432491:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270239.432548:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732672 00000100:00100000:0.0:1788270239.432556:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732672 00000100:00100000:0.0:1788270239.432604:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788270239.432613:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262732672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270239.432642:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270239.432683:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262732672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270239.432690:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788270239.432709:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270239.432739:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262732672:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788270239.432978:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270239.432983:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270239.433621:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:2.0:1788270239.433630:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:1.0:1788270239.579428:0:53602:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270239.579435:0:53602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270239.579455:0:53602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 3 00000040:00080000:1.0:1788270239.579458:0:53602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270239.940249:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270239.940274:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262732800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270239.940346:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270239.940392:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732800 00000100:00100000:2.0:1788270239.940402:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732800 00000100:00100000:2.0:1788270239.940459:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788270239.940469:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24676a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262732800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270239.940504:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270239.940554:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24676a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262732800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270239.940562:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788270239.940822:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262732800:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788270240.196248:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270240.196257:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270240.196339:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:1.0:1788270240.196347:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270240.196520:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270241.034379:0:53654:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270241.034387:0:53654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270241.034417:0:53654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:0.0:1788270241.034423:0:53654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270241.220360:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270241.988265:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270241.988450:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262732928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270241.988544:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270241.988651:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262732928 00000100:00100000:3.0:1788270241.988658:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262732928 00000100:00100000:3.0:1788270241.988710:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788270241.988720:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262732928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270241.988751:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270241.988789:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262732928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270241.988793:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788270241.989122:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262732928:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270242.245424:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270242.305697:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270242.305761:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365504 00000100:00100000:1.0:1788270242.305771:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365504 00000100:00100000:3.0:1788270242.305801:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270242.305826:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:3.0:1788270242.305834:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270242.305840:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253365504:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270242.305866:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270242.305903:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365888 00000100:00100000:2.0:1788270242.305909:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365888 00000100:00100000:3.0:1788270242.305917:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270242.305925:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253365504:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270242.305935:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:2.0:1788270242.305954:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366016 00000100:00100000:2.0:1788270242.305957:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366016 00000100:00100000:2.0:1788270242.305976:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 179 00000100:00100000:2.0:1788270242.305983:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253365888:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270242.306025:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253365888:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.306036:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 179 00000100:00100000:3.0:1788270242.306061:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270242.306085:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00100000:2.0:1788270242.306108:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253366016:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270242.306127:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365632 00000100:00100000:3.0:1788270242.306133:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365632 00000100:00100000:1.0:1788270242.306144:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270242.306146:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253366016:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.306152:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00080000:2.0:1788270242.306174:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270242.306176:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253365760 00000100:00100000:3.0:1788270242.306181:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253365760 00000100:00080000:2.0:1788270242.306190:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270242.306195:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270242.306199:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270242.306211:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366272 00000100:00100000:3.0:1788270242.306215:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366272 00000100:00100000:1.0:1788270242.306226:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366144 00000100:00100000:1.0:1788270242.306233:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366144 00000100:00100000:2.0:1788270242.306234:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 374 00000100:00100000:2.0:1788270242.306247:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253365632:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270242.306254:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 375 00000100:00100000:3.0:1788270242.306267:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253365760:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270242.306274:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 376 00000100:00100000:1.0:1788270242.306285:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253366272:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270242.306290:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253365632:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270242.306307:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253365760:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.306316:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 374 00000100:00100000:3.0:1788270242.306330:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 375 00000100:00100000:1.0:1788270242.306332:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253366272:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.306340:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 377 00000100:00100000:1.0:1788270242.306348:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 376 00000100:00100000:2.0:1788270242.306354:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253366144:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788270242.306363:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270242.306368:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270242.306403:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253366144:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.306411:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 377 00000040:00080000:2.0:1788270242.474730:0:53705:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270242.474738:0:53705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270242.474763:0:53705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:2.0:1788270242.474769:0:53705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270242.500160:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788270242.500183:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26bf2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262733184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270242.500253:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270242.500305:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733184 00000100:00100000:2.0:1788270242.500308:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270242.500314:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733184 00000100:00100000:2.0:1788270242.500330:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270242.500373:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733056 00000100:00100000:2.0:1788270242.500378:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733056 00000100:00100000:0.0:1788270242.500382:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788270242.500395:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262733184:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270242.500411:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788270242.500420:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262733056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270242.500425:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00002000:00000024:2.0:1788270242.500444:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270242.500478:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262733184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270242.500486:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788270242.500507:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270242.500563:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270242.500578:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262733312:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.500588:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262733056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.500593:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788270242.500614:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262733440:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.500621:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270242.500658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270242.500674:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733312 00000100:00100000:1.0:1788270242.500680:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733312 00000100:00100000:2.0:1788270242.500690:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733440 00000100:00100000:2.0:1788270242.500695:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733440 00000100:00100000:1.0:1788270242.500716:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788270242.500725:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788270242.500730:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262733312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.500736:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262733440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270242.500832:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262733568:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.502486:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262733440:12345-0@lo:400:kworker.0 Request processed in 1747us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270242.502486:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262733312:12345-0@lo:400:kworker.0 Request processed in 1753us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270242.502497:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270242.502510:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788270242.502510:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788270242.502533:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262734080:0@lo:400:kworker.0 00000100:00100000:0.0:1788270242.502566:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270242.502568:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262733696:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.502572:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262733952:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.502617:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270242.502618:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270242.502634:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262734464:0@lo:400:kworker.0 00000100:00100000:0.0:1788270242.502643:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a61b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262734592:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.502650:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270242.502680:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262733440:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.502705:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733568 00000100:00100000:2.0:1788270242.502709:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733568 00000100:00100000:2.0:1788270242.502748:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733952 00000100:00100000:2.0:1788270242.502751:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733952 00000100:00100000:0.0:1788270242.502766:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270242.502771:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788270242.502777:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262733568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270242.502813:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788270242.502817:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262733568:12345-0@lo:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.502823:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788270242.502827:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262733952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.502842:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734080 00000100:00100000:2.0:1788270242.502846:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734080 00000100:00100000:2.0:1788270242.502868:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733696 00000100:00100000:2.0:1788270242.502871:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733696 00000100:00100000:0.0:1788270242.502879:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262733952:12345-0@lo:400:kworker.0 Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.502889:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734464 00000100:00100000:0.0:1788270242.502889:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788270242.502892:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734464 00000100:00100000:2.0:1788270242.502905:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734592 00000100:00100000:2.0:1788270242.502908:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734592 00000100:00100000:2.0:1788270242.502926:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788270242.502930:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262734080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270242.502940:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788270242.502952:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262733696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.503886:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262734208:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.503894:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262734080:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.503901:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788270242.503917:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788270242.503927:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262734464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.503932:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270242.503958:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262734720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270242.503963:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262734464:12345-0@lo:400:kworker.0 Request processed in 41us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.503968:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788270242.503976:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734208 00000100:00100000:2.0:1788270242.503979:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734208 00000100:00100000:1.0:1788270242.503992:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270242.504000:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262733696:12345-0@lo:400:kworker.0 Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270242.504009:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788270242.504028:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788270242.504052:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262734592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504130:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262733312:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.504157:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788270242.504161:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262733696:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.504168:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262734208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504173:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788270242.504184:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262733824:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.504209:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262734208:12345-0@lo:400:kworker.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270242.504219:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788270242.504222:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270242.504251:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262734336:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270242.504306:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262734208:0@lo:400:kworker.0 00000100:00100000:2.0:1788270242.504323:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26bf2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262733184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270242.504335:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734336 00000100:00100000:2.0:1788270242.504338:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270242.504341:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734336 00000100:00100000:1.0:1788270242.504377:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788270242.504385:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262734336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504428:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262734336:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270242.504435:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788270242.504467:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262733824 00000100:00100000:1.0:1788270242.504472:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262733824 00000100:00100000:2.0:1788270242.504480:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262734336:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504503:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788270242.504511:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262733824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504553:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262733824:12345-0@lo:400:kworker.0 Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270242.504561:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788270242.504572:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262733824:0@lo:400:kworker.0 00000100:00080000:1.0:1788270242.504610:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270242.504615:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270242.504618:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270242.504663:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262733568:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504674:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262734080:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504684:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a61b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262734592:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504720:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262733952:0@lo:400:kworker.0 00000100:00100000:1.0:1788270242.504729:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262734464:0@lo:400:kworker.0 00000100:00100000:0.0:1788270242.505411:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262734592:12345-0@lo:400:kworker.0 Request processed in 1374us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270242.505418:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788270242.507787:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734720 00000100:00100000:3.0:1788270242.507799:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734720 00000100:00100000:3.0:1788270242.507894:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788270242.507904:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262734720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270242.507933:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270242.508011:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262734720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270242.508018:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788270242.508082:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262734720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788270243.269241:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270243.899868:0:53756:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270243.899878:0:53756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270243.899904:0:53756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:2.0:1788270243.899910:0:53756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270244.292270:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270244.551003:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262734848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270244.551111:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270244.551348:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734848 00000100:00100000:2.0:1788270244.551357:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734848 00000100:00080000:1.0:1788270244.551417:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270244.551598:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788270244.551809:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262734848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270244.551840:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270244.551950:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262734848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 343us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270244.551957:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788270244.552695:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262734848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270245.060221:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262734976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270245.060298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270245.060480:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262734976 00000100:00100000:1.0:1788270245.060489:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262734976 00000100:00100000:1.0:1788270245.060544:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788270245.060553:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262734976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270245.060584:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270245.060644:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262734976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270245.060650:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788270245.060876:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262734976:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270245.319436:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270245.341443:0:53807:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270245.341454:0:53807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270245.341481:0:53807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:0.0:1788270245.341488:0:53807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270246.340222:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270246.744788:0:53858:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270246.744800:0:53858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270246.744825:0:53858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:3.0:1788270246.744832:0:53858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270247.108905:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270247.108928:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262735104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270247.108997:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270247.109621:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735104 00000100:00100000:3.0:1788270247.109631:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735104 00000100:00100000:3.0:1788270247.109686:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788270247.109697:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262735104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270247.109778:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270247.109852:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262735104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270247.109861:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788270247.109891:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262735104:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270247.367300:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270247.426321:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270247.426423:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270247.426463:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270247.426500:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270247.426552:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366784 00000100:00100000:0.0:1788270247.426561:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366784 00000100:00100000:0.0:1788270247.426625:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 183 00000100:00100000:0.0:1788270247.426636:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253366784:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270247.426704:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253366784:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.426712:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 183 00000100:00080000:0.0:1788270247.426750:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270247.426911:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366400 00000100:00100000:1.0:1788270247.426915:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366400 00000100:00100000:1.0:1788270247.426956:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 232 00000100:00100000:1.0:1788270247.426963:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253366400:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270247.426996:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253366400:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270247.427013:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 232 00000100:00100000:3.0:1788270247.427893:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270247.427955:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366528 00000100:00100000:2.0:1788270247.427961:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366528 00000100:00100000:2.0:1788270247.428027:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366656 00000100:00100000:2.0:1788270247.428031:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366656 00000100:00100000:2.0:1788270247.428073:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 384 00000100:00100000:2.0:1788270247.428085:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253366528:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270247.428147:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253366528:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 64us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270247.428154:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 384 00000100:00100000:2.0:1788270247.428169:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 385 00000100:00100000:2.0:1788270247.428176:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253366656:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270247.428198:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253366656:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270247.428204:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 385 00000100:00080000:0.0:1788270247.428349:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270247.428353:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270247.428829:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270247.428856:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270247.428918:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253366912 00000100:00100000:0.0:1788270247.428923:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253366912 00000100:00100000:0.0:1788270247.428964:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:0.0:1788270247.428972:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253366912:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270247.429020:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253366912:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 50us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.429027:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:0.0:1788270247.429068:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367040 00000100:00100000:0.0:1788270247.429071:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367040 00000100:00100000:0.0:1788270247.429088:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367168 00000100:00100000:0.0:1788270247.429090:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367168 00000100:00100000:0.0:1788270247.429104:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 386 00000100:00100000:0.0:1788270247.429110:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253367040:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270247.429132:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253367040:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.429139:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 386 00000100:00100000:0.0:1788270247.429149:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 387 00000100:00100000:0.0:1788270247.429154:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253367168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270247.429171:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253367168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 17us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.429177:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 387 00000100:00080000:3.0:1788270247.429292:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270247.429296:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270247.429298:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270247.620326:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262735232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270247.620402:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270247.620413:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262735360:0@lo:400:kworker.0 00000100:00100000:2.0:1788270247.620457:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270247.620463:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262735872:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.620488:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270247.620513:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262736384:0@lo:400:kworker.0 00000100:00100000:2.0:1788270247.620514:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262735744:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.620539:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270247.620558:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735232 00000100:00100000:3.0:1788270247.620559:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262736896:0@lo:400:kworker.0 00000100:00100000:2.0:1788270247.620564:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270247.620568:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735232 00000100:00100000:2.0:1788270247.620594:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262736256:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.620595:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270247.620629:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788270247.620634:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270247.620650:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735872 00000100:00100000:1.0:1788270247.620653:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788270247.620655:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735872 00000100:00100000:2.0:1788270247.620655:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262736768:0@lo:400:kworker.0 00000100:00100000:1.0:1788270247.620669:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262735232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270247.620684:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736384 00000100:00100000:2.0:1788270247.620686:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270247.620688:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736384 00002000:00000024:1.0:1788270247.620701:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270247.620706:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736896 00000100:00100000:3.0:1788270247.620709:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736896 00000100:00100000:3.0:1788270247.620723:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736768 00000100:00100000:3.0:1788270247.620725:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736768 00000100:00100000:3.0:1788270247.620744:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788270247.620748:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735360 00000100:00100000:3.0:1788270247.620754:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262735872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270247.620754:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735360 00000100:00100000:1.0:1788270247.620764:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262735232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270247.620773:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788270247.620793:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788270247.620802:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262735872:12345-0@lo:400:kworker.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270247.620804:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262735360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270247.620809:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788270247.620822:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262736384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270247.620862:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262736384:12345-0@lo:400:kworker.0 Request processed in 42us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.620886:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735744 00000100:00100000:0.0:1788270247.620890:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735744 00000100:00100000:0.0:1788270247.620913:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736256 00000100:00100000:0.0:1788270247.620915:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736256 00000100:00100000:0.0:1788270247.620931:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788270247.620943:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262735744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.620979:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262735744:12345-0@lo:400:kworker.0 Request processed in 37us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.620992:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788270247.621018:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788270247.621024:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262736256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621066:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262736256:12345-0@lo:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.621071:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788270247.621100:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262735616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621121:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270247.621150:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262736128:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270247.621187:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262736640:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.621206:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788270247.621211:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270247.621217:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788270247.621225:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736640 00000100:00100000:3.0:1788270247.621229:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736640 00000100:00100000:0.0:1788270247.621229:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262737152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270247.621245:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788270247.621259:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262736896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621260:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270247.621283:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788270247.621291:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262735488:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.621297:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788270247.621304:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262736768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621319:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270247.621338:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262736768:12345-0@lo:400:kworker.0 Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.621345:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262736000:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.621346:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788270247.621359:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788270247.621365:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262736640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621376:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270247.621400:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262736512:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.621401:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262736640:12345-0@lo:400:kworker.0 Request processed in 34us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270247.621413:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788270247.621428:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788270247.621433:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270247.621438:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270247.621440:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270247.621450:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262737024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270247.621451:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735488 00000100:00100000:3.0:1788270247.621456:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735488 00000100:00100000:0.0:1788270247.621476:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270247.621480:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736000 00000100:00100000:3.0:1788270247.621482:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736000 00000100:00100000:3.0:1788270247.621501:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788270247.621508:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262735488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621514:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262736640:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621541:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737152 00000100:00100000:0.0:1788270247.621546:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737152 00000100:00100000:3.0:1788270247.621554:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262735488:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270247.621562:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788270247.621571:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737024 00000100:00100000:0.0:1788270247.621576:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737024 00000100:00100000:3.0:1788270247.621580:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788270247.621589:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262736000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.621594:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788270247.621605:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262737152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270247.621623:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270247.621625:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262736000:12345-0@lo:400:kworker.0 Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270247.621633:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788270247.622709:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262735872:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.623594:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262737152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1985us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.623604:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788270247.623627:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788270247.623638:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262737024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270247.623656:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270247.623696:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262737024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.623779:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788270247.623809:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262735616 00000100:00100000:0.0:1788270247.623814:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262735616 00000100:00100000:0.0:1788270247.623842:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736128 00000100:00100000:0.0:1788270247.623845:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736128 00000100:00100000:0.0:1788270247.623871:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788270247.623877:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262735616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.623974:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262735616:12345-0@lo:400:kworker.0 Request processed in 96us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.623981:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788270247.623994:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788270247.624031:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262736128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.624081:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262736128:12345-0@lo:400:kworker.0 Request processed in 52us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270247.624086:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1788270247.624106:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270247.624796:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262736896:12345-0@lo:400:kworker.0 Request processed in 3540us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270247.624799:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262735360:12345-0@lo:400:kworker.0 Request processed in 3996us (4338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270247.624809:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788270247.624811:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788270247.624830:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262736512 00000100:00100000:1.0:1788270247.624836:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262736512 00000100:00080000:0.0:1788270247.624879:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270247.624903:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788270247.624912:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262736512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270247.624953:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262736512:12345-0@lo:400:kworker.0 Request processed in 43us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270247.625012:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788270247.625107:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262735488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625125:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262736000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625135:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262736512:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625155:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262737024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270247.625166:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262735616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625175:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262736128:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625189:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262737152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270247.625248:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262735360:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625259:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262735744:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625268:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262736256:0@lo:400:kworker.0 00000100:00100000:0.0:1788270247.625278:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262736768:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.629097:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262736384:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.629121:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262736896:0@lo:400:kworker.0 00000100:00100000:3.0:1788270247.629143:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262735232:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788270248.195287:0:53910:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270248.195296:0:53910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270248.195316:0:53910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:0.0:1788270248.195320:0:53910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270248.389729:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270249.415612:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270249.668242:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270249.668253:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270249.668831:0:53961:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270249.668835:0:53961:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270249.668853:0:53961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 13 count 2 00000040:00080000:1.0:1788270249.668857:0:53961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:2.0:1788270249.669003:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:2.0:1788270249.669012:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788270249.671121:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262737280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270249.671188:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270249.671229:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737280 00000100:00100000:1.0:1788270249.671247:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737280 00000100:00100000:1.0:1788270249.671421:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788270249.671432:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262737280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270249.671471:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00080000:0.0:1788270249.671505:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270249.671536:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262737280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270249.671546:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788270249.671578:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262737280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270250.180472:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270250.180497:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262737408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270250.180596:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270250.180801:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737408 00000100:00100000:3.0:1788270250.180809:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737408 00000100:00100000:3.0:1788270250.180880:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788270250.180890:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262737408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270250.180925:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270250.180990:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262737408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270250.180998:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788270250.181069:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262737408:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788270250.436254:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270250.436265:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270250.436351:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 12 count 1 00000040:00080000:0.0:1788270250.436359:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270250.437452:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270251.068331:0:54012:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270251.068341:0:54012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270251.068869:0:54012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270251.068876:0:54012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270251.460873:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270252.228356:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262737536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270252.228429:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270252.228773:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737536 00000100:00100000:0.0:1788270252.228782:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737536 00000100:00100000:0.0:1788270252.228851:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788270252.228863:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262737536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270252.228896:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270252.228963:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262737536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270252.228971:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788270252.229090:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262737536:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270252.490963:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270252.509030:0:54063:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270252.509053:0:54063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270252.509724:0:54063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270252.509734:0:54063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270252.545790:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270252.545841:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270252.545957:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367424 00000100:00100000:1.0:1788270252.545957:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367680 00000100:00100000:3.0:1788270252.545967:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367424 00000100:00100000:1.0:1788270252.545967:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367680 00000100:00080000:2.0:1788270252.546010:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270252.546031:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 189 00000100:00100000:1.0:1788270252.546059:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253367680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270252.546099:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 394 00000100:00100000:3.0:1788270252.546110:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253367424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270252.546129:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270252.546129:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253367680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.546137:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 189 00000100:00100000:3.0:1788270252.546149:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253367424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.546182:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367936 00000100:00100000:1.0:1788270252.546187:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367936 00000100:00100000:3.0:1788270252.546274:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 394 00000100:00100000:2.0:1788270252.546294:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270252.546299:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 395 00000100:00100000:3.0:1788270252.546309:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253367936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:1.0:1788270252.546337:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270252.546349:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253367936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270252.546358:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 395 00000100:00100000:1.0:1788270252.546358:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367296 00000100:00100000:1.0:1788270252.546363:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367296 00000100:00100000:2.0:1788270252.546376:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270252.546392:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:1.0:1788270252.546400:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253367296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270252.546402:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367552 00000100:00100000:2.0:1788270252.546405:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367552 00000100:00100000:1.0:1788270252.546426:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253367296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.546433:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:2.0:1788270252.546439:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 396 00000100:00100000:2.0:1788270252.546449:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253367552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:1.0:1788270252.546487:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270252.546499:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253367552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 53us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270252.546506:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 396 00000100:00100000:3.0:1788270252.546583:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270252.546619:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270252.546687:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368064 00000100:00100000:1.0:1788270252.546691:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368064 00000100:00100000:1.0:1788270252.546831:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 397 00000100:00100000:1.0:1788270252.546838:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253368064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270252.546871:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253368064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.546878:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 397 00000100:00100000:2.0:1788270252.546995:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253367808 00000100:00100000:2.0:1788270252.547000:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253367808 00000100:00100000:2.0:1788270252.550171:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:2.0:1788270252.550184:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253367808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270252.550247:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253367808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270252.550253:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00080000:3.0:1788270252.554574:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270252.554648:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270252.740235:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c265e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262737664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270252.740235:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262737920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270252.740254:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262738048:0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.740321:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270252.740327:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270252.740330:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262737792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270252.740371:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270252.740392:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737920 00000100:00100000:3.0:1788270252.740396:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262738432:0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.740401:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737920 00000100:00100000:0.0:1788270252.740405:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262738560:0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.740409:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262738304:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.740426:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270252.740457:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737792 00000100:00100000:0.0:1788270252.740457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270252.740459:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262738944:0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.740459:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270252.740462:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737792 00000100:00100000:1.0:1788270252.740486:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788270252.740495:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262739072:0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.740496:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262737920:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270252.740500:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262738816:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.740502:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788270252.740529:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270252.740690:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262739456:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.740715:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270252.740747:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788270252.740755:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262737792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270252.740770:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270252.740810:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270252.740819:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262737920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270252.740819:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270252.740825:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262737792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.740834:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788270252.740840:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262739328:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.740846:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788270252.740862:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262739584:0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.740875:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270252.740876:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738432 00000100:00100000:3.0:1788270252.740881:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738432 00000100:00100000:1.0:1788270252.740886:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738560 00000100:00100000:1.0:1788270252.740891:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738560 00000100:00100000:0.0:1788270252.740900:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270252.740929:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738304 00000100:00100000:3.0:1788270252.740934:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738304 00000100:00100000:1.0:1788270252.740944:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739456 00000100:00100000:2.0:1788270252.740948:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262737920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270252.740948:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788270252.740950:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739456 00000100:00100000:3.0:1788270252.740953:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738944 00000100:00100000:3.0:1788270252.740958:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738944 00000100:00100000:0.0:1788270252.740960:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262738688:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.740988:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738816 00000100:00100000:1.0:1788270252.740988:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739072 00000100:00100000:2.0:1788270252.740993:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738048 00000100:00100000:1.0:1788270252.740994:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739072 00000100:00100000:3.0:1788270252.740995:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738816 00000100:00100000:2.0:1788270252.740999:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738048 00000100:00100000:0.0:1788270252.741000:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270252.741028:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262739200:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741029:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788270252.741064:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788270252.741065:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262738432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741068:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739328 00000100:00100000:2.0:1788270252.741078:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262738048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741080:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739328 00000100:00100000:0.0:1788270252.741087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270252.741114:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739584 00000100:00100000:3.0:1788270252.741116:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262738432:12345-0@lo:400:kworker.0 Request processed in 76us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.741120:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739584 00000100:00100000:0.0:1788270252.741122:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739200 00000100:00100000:3.0:1788270252.741125:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788270252.741129:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739200 00000100:00100000:3.0:1788270252.741143:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788270252.741148:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262738048:12345-0@lo:400:kworker.0 Request processed in 73us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.741152:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788270252.741154:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262738304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.741166:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788270252.741170:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262738560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741174:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788270252.741187:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262739456:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788270252.741204:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270252.741210:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270252.741215:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270252.741220:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262738304:12345-0@lo:400:kworker.0 Request processed in 68us (764us total) trans 0 rc 0/0 00000100:00080000:2.0:1788270252.741220:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270252.741232:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788270252.741232:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262738560:12345-0@lo:400:kworker.0 Request processed in 67us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270252.741240:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262739456:12345-0@lo:400:kworker.0 Request processed in 54us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270252.741243:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788270252.741250:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788270252.741254:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788270252.741258:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262738944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741259:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788270252.741275:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788270252.741286:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262739072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741299:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788270252.741308:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262738944:12345-0@lo:400:kworker.0 Request processed in 53us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270252.741312:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262739328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.741325:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788270252.741330:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262738816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741330:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262739072:12345-0@lo:400:kworker.0 Request processed in 44us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.741345:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788270252.741361:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788270252.741366:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262739328:12345-0@lo:400:kworker.0 Request processed in 56us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.741373:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788270252.741377:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262739584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741382:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262738816:12345-0@lo:400:kworker.0 Request processed in 55us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270252.741383:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1788270252.741389:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262739200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741398:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788270252.741420:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738688 00000100:00100000:0.0:1788270252.741426:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738688 00000100:00100000:2.0:1788270252.741433:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262739584:12345-0@lo:400:kworker.0 Request processed in 60us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270252.741444:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788270252.741444:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262739200:12345-0@lo:400:kworker.0 Request processed in 58us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270252.741452:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262739456:0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741458:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788270252.741466:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788270252.741477:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262737792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270252.741482:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270252.741482:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262738688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741500:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262738432:0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.741515:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262738176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741520:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262738944:0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741530:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262739200:0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741541:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262738688:12345-0@lo:400:kworker.0 Request processed in 67us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270252.741549:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262738560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741553:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788270252.741575:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262738304:0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741578:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262739072:0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741595:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262738816:0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741595:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262737664 00000100:00100000:1.0:1788270252.741600:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262739584:0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741602:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262737664 00000100:00100000:3.0:1788270252.741615:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262739328:0@lo:400:kworker.0 00000100:00100000:1.0:1788270252.741622:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262738048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270252.741634:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788270252.741643:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262737664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270252.741654:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270252.741668:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262738688:0@lo:400:kworker.0 00000100:00100000:2.0:1788270252.741670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270252.741700:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262737664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270252.741707:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788270252.741708:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262738176 00000100:00100000:3.0:1788270252.741714:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262738176 00000100:00100000:2.0:1788270252.741717:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c265e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262737664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270252.741748:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788270252.741756:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262738176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270252.741802:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262738176:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270252.741808:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788270252.743159:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262738176:0@lo:400:kworker.0 00010000:00010000:3.0:1788270253.508279:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270253.979819:0:54114:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270253.979830:0:54114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270253.982240:0:54114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270253.982256:0:54114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270254.533588:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270254.791217:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262739712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270254.791296:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270254.791407:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739712 00000100:00100000:3.0:1788270254.791417:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739712 00000100:00100000:3.0:1788270254.791491:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788270254.791502:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262739712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270254.791530:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270254.791575:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262739712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270254.791582:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788270254.791727:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270254.791761:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262739712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270255.300260:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262739840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270255.300322:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270255.300520:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739840 00000100:00100000:0.0:1788270255.300528:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739840 00000100:00100000:0.0:1788270255.300578:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788270255.300588:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262739840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270255.300621:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270255.300674:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262739840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270255.300681:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788270255.300722:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262739840:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788270255.420275:0:54166:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270255.420398:0:54166:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270255.420890:0:54166:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270255.420897:0:54166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270255.556174:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270256.580348:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270256.876415:0:54217:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270256.876425:0:54217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270256.876933:0:54217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270256.876943:0:54217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270257.348316:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262739968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270257.348392:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270257.348666:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262739968 00000100:00100000:3.0:1788270257.348675:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262739968 00000100:00100000:3.0:1788270257.348749:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788270257.348761:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262739968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270257.348794:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270257.348934:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262739968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270257.348942:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788270257.349070:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262739968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270257.604831:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270257.670124:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270257.670161:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270257.670199:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270257.670209:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368192 00000100:00100000:1.0:1788270257.670220:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368192 00000100:00100000:0.0:1788270257.670242:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368320 00000100:00100000:2.0:1788270257.670245:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270257.670249:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368320 00000100:00100000:1.0:1788270257.670282:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:1.0:1788270257.670299:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253368192:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270257.670300:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270257.670305:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368832 00000100:00100000:0.0:1788270257.670311:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368832 00000100:00100000:0.0:1788270257.670339:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368448 00000100:00100000:0.0:1788270257.670344:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368448 00000100:00100000:2.0:1788270257.670349:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270257.670371:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368576 00000100:00100000:3.0:1788270257.670379:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368576 00000100:00100000:1.0:1788270257.670380:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253368192:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.670380:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 404 00000100:00100000:1.0:1788270257.670396:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:0.0:1788270257.670398:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253368320:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270257.670421:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368704 00000100:00100000:3.0:1788270257.670425:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368704 00000100:00100000:1.0:1788270257.670440:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 405 00000100:00100000:0.0:1788270257.670446:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253368320:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.670454:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253368832:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270257.670462:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 404 00000100:00100000:0.0:1788270257.670484:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 406 00000100:00100000:0.0:1788270257.670493:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253368448:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270257.670508:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253368832:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270257.670510:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270257.670522:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 405 00000100:00100000:0.0:1788270257.670528:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253368448:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.670537:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 406 00000100:00100000:1.0:1788270257.670545:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253368960 00000100:00100000:1.0:1788270257.670550:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253368960 00000100:00080000:0.0:1788270257.670566:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270257.670572:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270257.670576:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270257.670581:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270257.670586:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 407 00000100:00100000:1.0:1788270257.670596:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253368960:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270257.670630:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:1.0:1788270257.670631:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253368960:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.670641:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 407 00000100:00100000:3.0:1788270257.670649:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253368576:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270257.670684:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:2.0:1788270257.670699:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253368704:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270257.670749:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253368704:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 56us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270257.670756:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:3.0:1788270257.670987:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253368576:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 344us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270257.671621:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:0.0:1788270257.860350:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270257.860449:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262740352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.860522:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262740096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270257.860601:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262740480:0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.864579:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270257.864635:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.864684:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.864738:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262740608:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.864784:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.864806:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262741120:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.864838:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.864862:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262741632:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.864888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.864913:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788270257.864920:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262740736:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.864954:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.864971:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262741248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.864990:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.865007:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262741760:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.865024:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270257.865076:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740224 00000100:00100000:1.0:1788270257.865084:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740224 00000100:00100000:0.0:1788270257.865125:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740096 00000100:00100000:0.0:1788270257.865130:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740096 00000100:00100000:1.0:1788270257.865146:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788270257.865157:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262740224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270257.865197:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270257.865240:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262740224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.865248:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788270257.865258:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788270257.865269:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262740096:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270257.865275:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740608 00000100:00100000:1.0:1788270257.865280:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740608 00002000:00000024:0.0:1788270257.865288:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270257.865320:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741120 00000100:00100000:1.0:1788270257.865325:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741120 00000100:00100000:0.0:1788270257.865335:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875136262740096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.865344:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788270257.865352:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788270257.865361:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262740608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865376:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788270257.865387:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262741120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.865400:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262740608:12345-0@lo:400:kworker.0 Request processed in 39us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.865408:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788270257.865431:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262741120:12345-0@lo:400:kworker.0 Request processed in 45us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.865432:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741632 00000100:00100000:1.0:1788270257.865437:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741632 00000100:00100000:0.0:1788270257.865442:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788270257.865467:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740736 00000100:00100000:1.0:1788270257.865471:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740736 00000100:00100000:0.0:1788270257.865472:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741248 00000100:00100000:0.0:1788270257.865478:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741248 00000100:00100000:1.0:1788270257.865492:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741760 00000100:00100000:1.0:1788270257.865498:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741760 00000100:00100000:0.0:1788270257.865505:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788270257.865515:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262741632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.865524:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1788270257.865535:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262740736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865555:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262741632:12345-0@lo:400:kworker.0 Request processed in 41us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.865562:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1788270257.865577:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262740736:12345-0@lo:400:kworker.0 Request processed in 44us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.865583:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1788270257.865591:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788270257.865596:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262741248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.865611:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1788270257.865620:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262741760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865637:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262741248:12345-0@lo:400:kworker.0 Request processed in 44us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.865645:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1788270257.865658:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262741760:12345-0@lo:400:kworker.0 Request processed in 38us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.865667:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00080000:0.0:1788270257.865678:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270257.865683:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270257.865686:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270257.865689:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270257.865722:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262740736:0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865733:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270257.865740:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262741248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.865753:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262741760:0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.865769:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262740096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270257.865780:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740352 00000100:00100000:1.0:1788270257.865782:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262740608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865786:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740352 00000100:00100000:1.0:1788270257.865812:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262741120:0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865830:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788270257.865834:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262741632:0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865842:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262740352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.865883:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262740352:12345-0@lo:400:kworker.0 Request processed in 46us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.865891:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788270257.866258:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262740352:0@lo:400:kworker.0 00000100:00100000:2.0:1788270257.866259:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270257.866272:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262740864:0@lo:400:kworker.0 00000100:00100000:2.0:1788270257.866290:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262740992:0@lo:400:kworker.0 00000100:00100000:3.0:1788270257.866306:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270257.866339:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270257.866341:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262741376:0@lo:400:kworker.0 00000100:00100000:2.0:1788270257.866369:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740480 00000100:00100000:3.0:1788270257.866373:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270257.866386:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740480 00000100:00100000:3.0:1788270257.866407:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262741888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270257.866413:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740992 00000100:00100000:2.0:1788270257.866418:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740992 00000100:00100000:3.0:1788270257.866435:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270257.866471:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741376 00000100:00100000:3.0:1788270257.866476:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741376 00000100:00100000:2.0:1788270257.866479:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788270257.866490:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262740480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270257.866510:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1788270257.866521:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262741376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270257.866529:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262740480:12345-0@lo:400:kworker.0 Request processed in 40us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270257.866543:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788270257.866566:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262741376:12345-0@lo:400:kworker.0 Request processed in 46us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270257.866566:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788270257.866578:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788270257.866580:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262740992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270257.866602:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741888 00000100:00100000:3.0:1788270257.866606:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741888 00000100:00100000:2.0:1788270257.866619:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262740992:12345-0@lo:400:kworker.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270257.866627:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788270257.866632:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788270257.866642:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262741888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270257.866655:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00080000:0.0:1788270257.866658:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270257.866663:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270257.866667:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262740992:0@lo:400:kworker.0 00000100:00100000:2.0:1788270257.866677:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262741504:0@lo:400:kworker.0 00000100:00100000:3.0:1788270257.866690:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262741888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270257.866702:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788270257.866707:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270257.866738:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262741888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270257.866756:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262740480:0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.866801:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262741504 00000100:00100000:0.0:1788270257.866806:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262741504 00000100:00100000:1.0:1788270257.866844:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262740864 00000100:00100000:1.0:1788270257.866849:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262740864 00000100:00100000:0.0:1788270257.866867:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788270257.866877:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262741504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270257.866884:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788270257.866894:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262740864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270257.866921:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262741504:12345-0@lo:400:kworker.0 Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270257.866929:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1788270257.867000:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262740864:12345-0@lo:400:kworker.0 Request processed in 109us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270257.867006:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788270257.867058:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262741376:0@lo:400:kworker.0 00000100:00100000:3.0:1788270257.867080:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262740864:0@lo:400:kworker.0 00000100:00080000:2.0:1788270257.867938:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270257.867961:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262741504:0@lo:400:kworker.0 00000040:00080000:2.0:1788270258.380741:0:54268:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270258.380750:0:54268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270258.381558:0:54268:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270258.381570:0:54268:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270258.628259:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270259.653289:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270259.818442:0:54319:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270259.818451:0:54319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270259.819804:0:54319:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270259.819815:0:54319:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:1.0:1788270259.908190:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270259.908197:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788270259.908408:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262742016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270259.908501:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788270259.908689:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270259.908698:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788270259.908831:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742016 00000100:00100000:2.0:1788270259.908841:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742016 00000100:00100000:2.0:1788270259.908907:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788270259.908919:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262742016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270259.908949:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00080000:3.0:1788270259.908950:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270259.909010:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262742016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270259.909019:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788270259.910888:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262742016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270260.421697:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270260.421720:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262742144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270260.421914:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270260.421964:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742144 00000100:00100000:3.0:1788270260.421970:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742144 00000100:00100000:3.0:1788270260.422013:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788270260.422020:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262742144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270260.422061:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270260.422111:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262742144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270260.422118:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788270260.422175:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262742144:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270260.676205:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270260.676235:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270260.676241:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270260.676703:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270260.676712:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:0.0:1788270261.215614:0:54371:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270261.215624:0:54371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270261.216391:0:54371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270261.216401:0:54371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270261.700195:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270262.469769:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262742272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270262.469839:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270262.469891:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742272 00000100:00100000:1.0:1788270262.469899:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742272 00000100:00100000:1.0:1788270262.469947:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788270262.469958:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262742272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270262.469990:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270262.470075:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262742272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.470081:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262742272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270262.470087:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000040:00080000:2.0:1788270262.610683:0:54423:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270262.610693:0:54423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270262.611318:0:54423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270262.611332:0:54423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270262.727061:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270262.788367:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.788533:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369088 00000100:00100000:2.0:1788270262.788547:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369088 00000100:00100000:2.0:1788270262.788621:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:2.0:1788270262.788631:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253369088:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270262.788711:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253369088:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.788737:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:2.0:1788270262.788827:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.788984:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.789010:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.789033:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.789078:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.789103:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270262.789128:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369216 00000100:00100000:2.0:1788270262.789132:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369216 00000100:00100000:2.0:1788270262.789175:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369728 00000100:00100000:2.0:1788270262.789181:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369728 00000100:00100000:2.0:1788270262.789203:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369344 00000100:00100000:2.0:1788270262.789206:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369344 00000100:00100000:2.0:1788270262.789219:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369856 00000100:00100000:2.0:1788270262.789221:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369856 00000100:00100000:2.0:1788270262.789237:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 414 00000100:00100000:2.0:1788270262.789244:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253369216:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270262.789289:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253369216:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.789296:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 414 00000100:00100000:2.0:1788270262.789310:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 415 00000100:00100000:2.0:1788270262.789317:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253369728:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270262.789345:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253369728:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.789352:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 415 00000100:00100000:2.0:1788270262.789362:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 416 00000100:00100000:2.0:1788270262.789366:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253369344:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270262.789409:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253369344:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 43us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.789414:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 416 00000100:00100000:2.0:1788270262.789422:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 417 00000100:00100000:2.0:1788270262.789426:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253369856:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270262.789441:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253369856:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 15us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.789444:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 417 00000100:00100000:2.0:1788270262.790764:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369472 00000100:00100000:2.0:1788270262.790780:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369472 00000100:00100000:2.0:1788270262.790861:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369600 00000100:00100000:2.0:1788270262.790865:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369600 00000100:00100000:2.0:1788270262.790904:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 201 00000100:00100000:2.0:1788270262.790919:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253369472:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270262.790938:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:0.0:1788270262.790960:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253369600:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270262.790997:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253369472:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.791009:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 201 00000100:00100000:0.0:1788270262.791022:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253369600:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 71us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.791032:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00080000:2.0:1788270262.791075:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270262.791081:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270262.791083:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270262.791087:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270262.980388:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270262.980421:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262742400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270262.980511:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.980874:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742400 00000100:00100000:0.0:1788270262.980884:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742400 00000100:00100000:0.0:1788270262.980954:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788270262.980964:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262742400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270262.981000:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00080000:2.0:1788270262.981281:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270262.981328:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262742656:0@lo:400:kworker.0 00000100:00100000:3.0:1788270262.981460:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262742528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270262.982869:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262742784:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.982968:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262742400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1996us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270262.982969:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.982990:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788270262.983031:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262743296:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983082:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742784 00000100:00100000:0.0:1788270262.983092:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742784 00000100:00100000:1.0:1788270262.983096:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270262.983151:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262743808:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983161:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743296 00000100:00100000:0.0:1788270262.983166:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743296 00000100:00100000:1.0:1788270262.983183:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.983226:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788270262.983237:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743808 00000100:00100000:0.0:1788270262.983238:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262742784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270262.983248:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743808 00000100:00100000:1.0:1788270262.983311:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788270262.983331:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262743808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983331:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262742784:12345-0@lo:400:kworker.0 Request processed in 88us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.983352:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788270262.983371:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788270262.983381:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262743296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270262.983411:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262743808:12345-0@lo:400:kworker.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270262.983423:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1788270262.983438:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262743296:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.983446:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788270262.983477:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262742784:0@lo:400:kworker.0 00000100:00100000:1.0:1788270262.983493:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262743296:0@lo:400:kworker.0 00000100:00080000:0.0:1788270262.983498:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270262.983506:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270262.983507:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262743808:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983555:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262742912:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983594:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.983631:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262743424:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983654:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.983675:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262743936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270262.983699:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.983721:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270262.983738:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262744064:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983764:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.983830:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742912 00000100:00100000:0.0:1788270262.983834:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742912 00000100:00100000:0.0:1788270262.983863:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743424 00000100:00100000:0.0:1788270262.983866:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743424 00000100:00100000:0.0:1788270262.983879:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744064 00000100:00100000:0.0:1788270262.983881:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744064 00000100:00100000:0.0:1788270262.983901:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1788270262.983906:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262742912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983941:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262742912:12345-0@lo:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.983947:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1788270262.983959:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1788270262.983964:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262743424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.983987:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262743424:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.983992:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1788270262.984002:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1788270262.984007:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262744064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.984030:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262744064:12345-0@lo:400:kworker.0 Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.984036:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00080000:0.0:1788270262.984068:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270262.984092:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262744064:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.984101:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262742912:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.984110:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262743424:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.984145:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743936 00000100:00100000:0.0:1788270262.984148:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743936 00000100:00100000:0.0:1788270262.984179:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788270262.984187:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262743936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270262.984212:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270262.984258:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262743936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.984271:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788270262.984321:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262743936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270262.984693:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270262.984739:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262743168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270262.984768:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270262.984799:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262743680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270262.984822:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270262.984854:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743680 00000100:00100000:2.0:1788270262.984859:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743680 00000100:00100000:2.0:1788270262.984894:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788270262.984902:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262743680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270262.984941:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262743680:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.984948:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788270262.984974:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262743680:0@lo:400:kworker.0 00000100:00100000:1.0:1788270262.985140:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743168 00000100:00100000:1.0:1788270262.985144:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743168 00000100:00100000:1.0:1788270262.985185:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788270262.985192:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262743168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270262.985228:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262743168:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270262.985234:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788270262.985302:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262743168:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.986363:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742656 00000100:00100000:0.0:1788270262.986373:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742656 00000100:00100000:0.0:1788270262.986419:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788270262.986425:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262742656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.986509:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262742656:12345-0@lo:400:kworker.0 Request processed in 84us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.986517:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1788270262.986558:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270262.986564:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270262.986762:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262742656:0@lo:400:kworker.0 00000100:00100000:3.0:1788270262.986940:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270262.986985:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262743040:0@lo:400:kworker.0 00000100:00100000:3.0:1788270262.987021:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270262.987100:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262742528 00000100:00100000:0.0:1788270262.987104:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262742528 00000100:00100000:3.0:1788270262.987190:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262743552:0@lo:400:kworker.0 00000100:00100000:3.0:1788270262.987227:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270262.987245:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743040 00000100:00100000:2.0:1788270262.987256:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743040 00000100:00100000:3.0:1788270262.987266:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262742400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270262.987303:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262743552 00000100:00100000:3.0:1788270262.987308:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262743552 00000100:00100000:2.0:1788270262.987314:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788270262.987327:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262743040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270262.987370:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1788270262.987380:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262743552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270262.987404:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262743040:12345-0@lo:400:kworker.0 Request processed in 80us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270262.987414:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788270262.987433:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262743552:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270262.987440:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00080000:2.0:1788270262.987468:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270262.987477:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262743040:0@lo:400:kworker.0 00000100:00100000:3.0:1788270262.987491:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262743552:0@lo:400:kworker.0 00000100:00100000:0.0:1788270262.987623:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788270262.987629:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262742528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270262.987642:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270262.987685:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262742528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270262.987691:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788270262.987742:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c248218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262742528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788270263.752635:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270264.181225:0:54474:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270264.181237:0:54474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270264.181853:0:54474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270264.181864:0:54474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270264.775857:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270265.028879:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270265.031771:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262744192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270265.031883:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270265.032080:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744192 00000100:00100000:0.0:1788270265.032091:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744192 00000100:00100000:0.0:1788270265.032234:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788270265.032247:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262744192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270265.032288:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270265.032352:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262744192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270265.032360:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788270265.032461:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262744192:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788270265.033665:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270265.540306:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262744320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270265.540379:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270265.540550:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744320 00000100:00100000:0.0:1788270265.540573:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744320 00000100:00100000:0.0:1788270265.540661:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788270265.540674:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262744320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270265.540739:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270265.540850:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262744320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270265.540861:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788270265.540897:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262744320:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788270265.753612:0:54525:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270265.753627:0:54525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270265.754249:0:54525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270265.754262:0:54525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270265.797082:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270266.821721:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270267.153581:0:54576:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270267.153591:0:54576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270267.154103:0:54576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270267.154112:0:54576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270267.588273:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262744448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270267.588355:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270267.588534:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744448 00000100:00100000:2.0:1788270267.588552:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744448 00000100:00100000:2.0:1788270267.588613:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788270267.588622:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262744448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270267.588711:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270267.589477:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262744448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 854us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270267.589486:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788270267.589663:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262744448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270267.844183:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270267.905949:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270267.906036:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270267.906090:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270267.906133:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370112 00000100:00100000:1.0:1788270267.906143:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370112 00000100:00100000:0.0:1788270267.906167:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370240 00000100:00100000:0.0:1788270267.906174:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370240 00000100:00100000:0.0:1788270267.906219:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 424 00000100:00100000:1.0:1788270267.906235:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 425 00000100:00100000:1.0:1788270267.906246:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253370112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270267.906352:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270267.906354:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253370112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 110us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270267.906361:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 425 00000100:00080000:1.0:1788270267.906380:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270267.906384:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270267.906419:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370368 00000100:00100000:1.0:1788270267.906422:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370368 00000100:00100000:1.0:1788270267.906449:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:1.0:1788270267.906455:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253370368:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270267.906485:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270267.906485:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253370368:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270267.906492:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:1.0:1788270267.906502:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370496 00000100:00100000:1.0:1788270267.906505:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370496 00000100:00100000:1.0:1788270267.906524:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:2.0:1788270267.906531:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270267.906533:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253370496:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270267.906556:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253370496:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270267.906563:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:2.0:1788270267.906570:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270267.906601:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370624 00000100:00100000:2.0:1788270267.906605:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370624 00000100:00100000:2.0:1788270267.906633:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370752 00000100:00100000:2.0:1788270267.906637:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370752 00000100:00080000:1.0:1788270267.906652:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270267.906656:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270267.906658:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270267.906661:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270267.906678:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 426 00000100:00100000:1.0:1788270267.906685:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 427 00000100:00100000:2.0:1788270267.906687:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253370624:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270267.906695:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253370752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270267.906717:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253370624:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270267.906723:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253370752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270267.906725:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 426 00000100:00100000:1.0:1788270267.906733:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 427 00000100:00100000:0.0:1788270267.906888:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253370240:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270267.906925:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253370240:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 696us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270267.906931:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 424 00000100:00100000:3.0:1788270267.908699:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253369984 00000100:00100000:3.0:1788270267.908713:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253369984 00000100:00100000:3.0:1788270267.908905:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:3.0:1788270267.908916:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253369984:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270267.908996:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253369984:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270267.909003:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:0.0:1788270268.100391:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262744704:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100459:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100518:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262745216:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100539:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100558:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262745728:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100579:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100603:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788270268.100609:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262744832:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100630:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100661:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262745344:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100688:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100709:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262745856:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100730:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100778:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745728 00000100:00100000:0.0:1788270268.100786:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745728 00000100:00100000:3.0:1788270268.100802:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270268.100815:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262746240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270268.100838:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745856 00000100:00100000:0.0:1788270268.100843:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745856 00000100:00100000:3.0:1788270268.100855:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100869:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1788270268.100880:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262745728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.100892:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262744576:0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.100934:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.100942:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262745728:12345-0@lo:400:kworker.0 Request processed in 63us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.100951:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788270268.100967:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262745088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.100974:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1788270268.100983:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262745856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.100997:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270268.101023:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262745600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101065:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262745856:12345-0@lo:400:kworker.0 Request processed in 45us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.101075:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1788270268.101076:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.101095:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745600 00000100:00100000:0.0:1788270268.101100:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745600 00000100:00100000:3.0:1788270268.101102:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262746112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270268.101133:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.101137:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1788270268.101146:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262745600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101161:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788270268.101170:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262744960:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101185:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262745600:12345-0@lo:400:kworker.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.101193:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788270268.101201:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.101209:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744960 00000100:00100000:0.0:1788270268.101213:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744960 00000100:00100000:3.0:1788270268.101217:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262745472:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101235:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788270268.101243:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.101245:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262744960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101281:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262745984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101286:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262744960:12345-0@lo:400:kworker.0 Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.101294:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1788270268.101308:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745472 00000100:00100000:0.0:1788270268.101311:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745472 00000100:00100000:3.0:1788270268.101313:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.101334:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745984 00000100:00100000:0.0:1788270268.101338:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745984 00000100:00100000:3.0:1788270268.101349:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262745600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101357:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1788270268.101366:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262745472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101377:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262744960:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101404:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262745472:12345-0@lo:400:kworker.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270268.101409:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744576 00000100:00100000:0.0:1788270268.101413:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1788270268.101414:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744576 00000100:00100000:0.0:1788270268.101430:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1788270268.101439:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262745984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101452:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788270268.101462:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262744576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101473:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262745984:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.101480:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1788270268.101504:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746240 00000100:00100000:3.0:1788270268.101508:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262744576:12345-0@lo:400:kworker.0 Request processed in 46us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.101510:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746240 00000100:00100000:3.0:1788270268.101519:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788270268.101540:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746112 00000100:00100000:0.0:1788270268.101545:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746112 00000100:00100000:3.0:1788270268.101555:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745088 00000100:00100000:3.0:1788270268.101561:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745088 00000100:00100000:0.0:1788270268.101566:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788270268.101576:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262746240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270268.101591:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00002000:00000024:0.0:1788270268.101599:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270268.101601:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262745088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101663:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262745088:12345-0@lo:400:kworker.0 Request processed in 64us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.101668:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262746240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270268.101674:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788270268.101682:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788270268.101700:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788270268.101708:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262746112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270268.101721:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262746240:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270268.101725:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270268.101750:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262745472:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101759:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262746112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270268.101765:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262745984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101770:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788270268.101779:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262744576:0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101789:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262745088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270268.101802:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744704 00000100:00100000:3.0:1788270268.101807:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262746112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270268.101807:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744704 00000100:00100000:0.0:1788270268.101834:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745216 00000100:00100000:0.0:1788270268.101839:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745216 00000100:00100000:0.0:1788270268.101853:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262744832 00000100:00100000:0.0:1788270268.101856:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262744832 00000100:00100000:0.0:1788270268.101872:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262745344 00000100:00100000:0.0:1788270268.101876:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262745344 00000100:00100000:3.0:1788270268.101877:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262746368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270268.101906:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788270268.101908:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270268.101919:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262744704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.101939:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746368 00000100:00100000:3.0:1788270268.101944:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746368 00000100:00100000:0.0:1788270268.101962:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262744704:12345-0@lo:400:kworker.0 Request processed in 42us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270268.101969:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788270268.101974:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788270268.101979:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262746368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270268.101990:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270268.101995:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788270268.102005:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262745216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270268.102032:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788270268.102034:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262746368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270268.102065:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262744832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.102073:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788270268.102074:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262745216:12345-0@lo:400:kworker.0 Request processed in 67us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.102084:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788270268.102104:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788270268.102115:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262746368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270268.102120:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262745344:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788270268.102156:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270268.102161:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270268.102164:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270268.102166:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270268.102619:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262745856:0@lo:400:kworker.0 00000100:00100000:2.0:1788270268.102630:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262744832:12345-0@lo:400:kworker.0 Request processed in 569us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270268.102647:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262745344:12345-0@lo:400:kworker.0 Request processed in 524us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270268.102649:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262744704:0@lo:400:kworker.0 00000100:00100000:2.0:1788270268.102652:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788270268.102664:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788270268.102672:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262745216:0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.102688:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.102712:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262744832:0@lo:400:kworker.0 00000100:00100000:3.0:1788270268.102724:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262745344:0@lo:400:kworker.0 00000040:00080000:3.0:1788270268.610734:0:54627:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270268.610746:0:54627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270268.611448:0:54627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270268.611457:0:54627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270268.868307:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270269.124269:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270269.124279:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270269.124854:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270269.124866:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788270269.893213:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270270.072309:0:54679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270270.072319:0:54679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270270.072809:0:54679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270270.072816:0:54679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270270.148762:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270270.148784:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262746496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270270.148850:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270270.148886:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746496 00000100:00100000:0.0:1788270270.148895:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746496 00000100:00080000:3.0:1788270270.148940:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270270.148959:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788270270.148971:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262746496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270270.148997:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270270.149063:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262746496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270270.149072:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788270270.149104:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262746496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270270.660446:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262746624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270270.660515:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270270.660721:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746624 00000100:00100000:2.0:1788270270.660729:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746624 00000100:00100000:2.0:1788270270.660846:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788270270.660857:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262746624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270270.660889:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270270.660946:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262746624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270270.660954:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788270270.661030:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262746624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270270.916195:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270270.916342:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270270.916348:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270270.918168:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270270.918182:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:2.0:1788270271.590344:0:54730:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270271.590359:0:54730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270271.590997:0:54730:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270271.591021:0:54730:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270271.940261:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270272.708236:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262746752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270272.708325:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270272.708424:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746752 00000100:00100000:3.0:1788270272.708434:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746752 00000100:00100000:3.0:1788270272.708504:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788270272.708515:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262746752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270272.708555:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270272.708628:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262746752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270272.708635:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788270272.708665:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262746752:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270272.964268:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270273.026808:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270273.026896:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270273.026934:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270273.026951:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371136 00000100:00100000:1.0:1788270273.026965:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371136 00000100:00100000:0.0:1788270273.026981:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270273.027012:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270273.027067:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371648 00000100:00100000:0.0:1788270273.027068:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270273.027072:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371648 00000100:00100000:1.0:1788270273.027101:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371008 00000100:00100000:1.0:1788270273.027104:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371008 00000100:00100000:0.0:1788270273.027112:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270273.027131:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371520 00000100:00100000:1.0:1788270273.027136:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371520 00000100:00100000:0.0:1788270273.027148:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 434 00000100:00100000:0.0:1788270273.027166:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253371136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270273.027167:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 435 00000100:00100000:1.0:1788270273.027180:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253371648:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270273.027270:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253371136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 112us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270273.027278:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 434 00000100:00100000:0.0:1788270273.027300:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 436 00000100:00100000:0.0:1788270273.027306:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253371008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270273.027367:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253370880 00000100:00100000:3.0:1788270273.027372:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253370880 00000100:00100000:3.0:1788270273.027404:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00100000:3.0:1788270273.027411:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253370880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270273.027712:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253371648:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 533us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.027719:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 435 00000100:00100000:1.0:1788270273.027735:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 437 00000100:00100000:1.0:1788270273.027742:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253371520:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270273.027767:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253371520:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.027773:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 437 00000100:00100000:0.0:1788270273.030472:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253371008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3149us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270273.030491:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 436 00000100:00080000:2.0:1788270273.030648:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270273.030656:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270273.030677:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371392 00000100:00100000:2.0:1788270273.030687:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371392 00000100:00100000:2.0:1788270273.030849:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371264 00000100:00100000:2.0:1788270273.030853:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371264 00000100:00100000:2.0:1788270273.030876:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:2.0:1788270273.030888:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253371392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270273.030938:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:0.0:1788270273.030949:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253371264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270273.030957:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253371392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 71us (4022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.030965:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:0.0:1788270273.030988:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253371264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270273.030997:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00080000:0.0:1788270273.031024:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270273.031028:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270273.031511:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253370880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4097us (4714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.031522:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 242 00000040:00080000:1.0:1788270273.092437:0:54781:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270273.092449:0:54781:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270273.093767:0:54781:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270273.093786:0:54781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270273.220379:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262746880:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.220480:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270273.220484:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262747136:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.220535:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.220570:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262747392:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.220582:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262747648:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.220605:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270273.220617:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.220631:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262747904:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.220647:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262748160:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.220662:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270273.220683:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270273.221267:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262747264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.221367:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262747008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.221394:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.221410:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262747520:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.221425:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.221437:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262748032:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.221453:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.221485:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262746880 00000100:00100000:1.0:1788270273.221492:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262746880 00000100:00100000:1.0:1788270273.221540:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788270273.221560:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262746880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.221676:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262746880:12345-0@lo:400:kworker.0 Request processed in 127us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.222089:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788270273.222137:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747392 00000100:00100000:1.0:1788270273.222143:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747392 00000100:00100000:1.0:1788270273.222239:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788270273.222248:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262747392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.222292:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.222304:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262747392:12345-0@lo:400:kworker.0 Request processed in 56us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.222312:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788270273.222322:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262747776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.222337:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747904 00000100:00100000:1.0:1788270273.222342:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747904 00000100:00100000:2.0:1788270273.222352:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270273.222375:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262748288:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.222389:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748160 00000100:00100000:1.0:1788270273.222394:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748160 00000100:00100000:2.0:1788270273.222400:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270273.222419:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270273.222419:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748032 00000100:00100000:1.0:1788270273.222424:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748032 00000100:00100000:2.0:1788270273.222430:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262748416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270273.222444:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747264 00000100:00100000:1.0:1788270273.222448:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747264 00000100:00100000:2.0:1788270273.222463:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.222468:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747776 00000100:00100000:1.0:1788270273.222472:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747776 00000100:00100000:1.0:1788270273.222490:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748288 00000100:00100000:1.0:1788270273.222493:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748288 00000100:00100000:2.0:1788270273.222506:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747136 00000100:00100000:2.0:1788270273.222513:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747136 00000100:00100000:1.0:1788270273.222517:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788270273.222529:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262747904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.222560:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747648 00000100:00100000:2.0:1788270273.222565:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747648 00000100:00100000:1.0:1788270273.222584:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262747904:12345-0@lo:400:kworker.0 Request processed in 58us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.222586:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747008 00000100:00100000:2.0:1788270273.222591:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747008 00000100:00100000:1.0:1788270273.222595:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1788270273.222616:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262747520 00000100:00100000:1.0:1788270273.222617:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1788270273.222622:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262747520 00000100:00100000:1.0:1788270273.222630:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262748160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.222646:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788270273.222656:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262747136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.222674:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262748160:12345-0@lo:400:kworker.0 Request processed in 46us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.222696:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262747136:12345-0@lo:400:kworker.0 Request processed in 42us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.222704:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788270273.222718:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788270273.222724:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262747648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.222740:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1788270273.222758:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262747648:12345-0@lo:400:kworker.0 Request processed in 33us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.222763:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1788270273.222772:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788270273.222776:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262748032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.222789:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788270273.222797:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262747008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.222828:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262747008:12345-0@lo:400:kworker.0 Request processed in 32us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.222834:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788270273.222846:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788270273.222854:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262747520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.222885:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262748032:12345-0@lo:400:kworker.0 Request processed in 112us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.222892:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1788270273.222898:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262747520:12345-0@lo:400:kworker.0 Request processed in 44us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.222906:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788270273.222911:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1788270273.222922:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262747264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.222946:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1788270273.222956:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262747776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.222964:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262747264:12345-0@lo:400:kworker.0 Request processed in 45us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.222972:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1788270273.222989:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1788270273.222996:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262747776:12345-0@lo:400:kworker.0 Request processed in 41us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270273.222999:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262748288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.223012:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1788270273.223069:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262748288:12345-0@lo:400:kworker.0 Request processed in 72us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.223070:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748416 00000100:00100000:2.0:1788270273.223077:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748416 00000100:00100000:1.0:1788270273.223080:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1788270273.223112:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788270273.223120:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262748416:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270273.223134:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262748544:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270273.223149:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270273.223230:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270273.223275:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262747008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.223289:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262747520:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.223300:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262748032:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.223328:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270273.223334:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262748672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270273.223358:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270273.223397:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262747136:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.223415:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262747648:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.223426:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262748160:0@lo:400:kworker.0 00000100:00080000:0.0:1788270273.223451:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270273.223456:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270273.223459:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270273.223461:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270273.223473:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748544 00000100:00100000:0.0:1788270273.223477:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748544 00000100:00100000:0.0:1788270273.223494:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748672 00000100:00100000:0.0:1788270273.223497:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748672 00000100:00100000:0.0:1788270273.223513:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788270273.223520:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262748544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270273.223532:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270273.223586:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262748544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270273.223592:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788270273.223606:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788270273.223612:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262748672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270273.223628:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270273.223655:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262748672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270273.223661:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788270273.223693:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262748672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270273.223706:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262748544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270273.223779:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262747392:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.223793:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262747904:0@lo:400:kworker.0 00000100:00100000:0.0:1788270273.223804:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262746880:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.224144:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262747264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.224231:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262747776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270273.224247:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262748288:0@lo:400:kworker.0 00000100:00100000:2.0:1788270273.224331:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262748416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1210us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270273.224339:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788270273.224367:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262748416:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788270273.988243:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270274.613645:0:54832:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270274.613657:0:54832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270274.614642:0:54832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270274.614654:0:54832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270275.012333:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270275.268352:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262748800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270275.268450:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270275.268536:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748800 00000100:00100000:0.0:1788270275.268547:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748800 00000100:00100000:0.0:1788270275.268635:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788270275.268648:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262748800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270275.268685:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270275.268743:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262748800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270275.268751:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788270275.268905:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262748800:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788270275.269096:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270275.782177:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262748928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270275.782272:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270275.784068:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262748928 00000100:00100000:0.0:1788270275.784082:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262748928 00000100:00100000:0.0:1788270275.784146:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788270275.784158:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262748928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270275.784204:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270275.784269:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262748928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270275.784277:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788270275.784332:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262748928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270276.036595:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270276.123552:0:54884:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270276.123563:0:54884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270276.125108:0:54884:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270276.125128:0:54884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270277.060227:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270277.531200:0:54935:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270277.531208:0:54935:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270277.531683:0:54935:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270277.531693:0:54935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270277.828294:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270277.828390:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262749056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270277.828465:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270277.828793:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749056 00000100:00100000:1.0:1788270277.828802:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749056 00000100:00100000:1.0:1788270277.828919:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788270277.828930:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262749056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270277.828966:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270277.829022:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262749056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270277.829033:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788270277.829689:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262749056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270278.084218:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270278.145919:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270278.146202:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270278.146259:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270278.146291:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270278.146312:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372160 00000100:00100000:1.0:1788270278.146319:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270278.146328:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372160 00000100:00100000:1.0:1788270278.146348:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270278.146390:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371904 00000100:00100000:1.0:1788270278.146395:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371904 00000100:00100000:1.0:1788270278.146448:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372416 00000100:00100000:1.0:1788270278.146452:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372416 00000100:00100000:0.0:1788270278.146495:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372288 00000100:00100000:0.0:1788270278.146501:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372288 00000100:00100000:2.0:1788270278.146621:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253371776 00000100:00100000:2.0:1788270278.146626:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253371776 00000100:00100000:1.0:1788270278.146672:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372544 00000100:00100000:1.0:1788270278.146675:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372544 00000100:00100000:0.0:1788270278.146765:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:3.0:1788270278.146775:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 444 00000100:00100000:0.0:1788270278.146780:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253372160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270278.146790:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253371904:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270278.146856:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253372160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.146864:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:0.0:1788270278.146889:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:0.0:1788270278.146896:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253372288:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270278.146930:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253371904:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 143us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.146935:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253372288:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270278.146943:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 444 00000100:00100000:0.0:1788270278.146948:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:3.0:1788270278.146969:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 445 00000100:00100000:3.0:1788270278.146978:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253372416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270278.147008:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253372416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270278.147015:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 445 00000100:00100000:3.0:1788270278.147029:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 446 00000100:00100000:3.0:1788270278.147070:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253372544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270278.147079:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270278.147143:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253372544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 63us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270278.147151:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 446 00000100:00100000:3.0:1788270278.147161:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372032 00000100:00100000:3.0:1788270278.147164:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372032 00000100:00100000:3.0:1788270278.147183:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 447 00000100:00100000:3.0:1788270278.147190:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253372032:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270278.147303:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 244 00000100:00100000:2.0:1788270278.147313:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253371776:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:1.0:1788270278.147432:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270278.147437:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270278.147440:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270278.147442:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270278.147661:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253372032:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 469us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270278.147674:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 447 00000100:00100000:2.0:1788270278.147755:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253371776:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 444us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270278.147762:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 244 00000100:00100000:0.0:1788270278.340224:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270278.340238:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270278.340248:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262749312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270278.340253:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262749184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270278.340387:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270278.340397:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262749440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270278.340556:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262749696:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.340814:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.340883:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262749952:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.340915:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.340934:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262750464:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.340954:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.340971:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262750976:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341011:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341031:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788270278.341055:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262749824:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341078:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341100:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262750336:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341121:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341139:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262750848:0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341151:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341165:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270278.341188:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262749568:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341205:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749952 00000100:00100000:0.0:1788270278.341213:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749952 00000100:00100000:0.0:1788270278.341260:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750464 00000100:00100000:0.0:1788270278.341264:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750464 00000100:00100000:1.0:1788270278.341272:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341284:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749824 00000100:00100000:0.0:1788270278.341288:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749824 00000100:00100000:1.0:1788270278.341308:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262750080:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341309:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750336 00000100:00100000:0.0:1788270278.341315:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750336 00000100:00100000:0.0:1788270278.341339:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788270278.341344:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341353:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262749952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341378:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262750592:0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341414:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.341416:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262749952:12345-0@lo:400:kworker.0 Request processed in 62us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.341426:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788270278.341439:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262751104:0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341476:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270278.341519:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270278.341529:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262750464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341577:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262750464:12345-0@lo:400:kworker.0 Request processed in 50us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.341583:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270278.341602:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788270278.341609:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262749824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341633:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262749824:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.341638:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788270278.341647:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788270278.341652:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262750336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.341680:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262750336:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.341686:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788270278.341712:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749312 00000100:00100000:1.0:1788270278.341716:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749312 00000100:00100000:0.0:1788270278.341758:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262749824:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341769:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262750336:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341777:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262749952:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341786:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262750464:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341891:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749568 00000100:00100000:0.0:1788270278.341896:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749568 00000100:00100000:0.0:1788270278.341924:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788270278.341931:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262749568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.341967:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262749568:12345-0@lo:400:kworker.0 Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.341974:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788270278.341981:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749184 00000100:00100000:1.0:1788270278.341985:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749184 00000100:00100000:1.0:1788270278.342002:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788270278.342005:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270278.342007:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262749312:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788270278.342011:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270278.342022:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750976 00000100:00100000:0.0:1788270278.342026:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750976 00000100:00100000:0.0:1788270278.342080:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750848 00000100:00100000:0.0:1788270278.342084:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750848 00000100:00100000:0.0:1788270278.342101:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750080 00000100:00100000:0.0:1788270278.342104:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750080 00002000:00000024:1.0:1788270278.342113:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270278.342116:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750592 00000100:00100000:0.0:1788270278.342120:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750592 00000100:00100000:0.0:1788270278.342135:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751104 00000100:00100000:0.0:1788270278.342138:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751104 00000100:00100000:1.0:1788270278.342152:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262749312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.342158:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1788270278.342163:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788270278.342168:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262750976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.342182:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788270278.342191:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262749184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270278.342206:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262750976:12345-0@lo:400:kworker.0 Request processed in 39us (1211us total) trans 0 rc 0/0 00002000:00000024:1.0:1788270278.342208:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270278.342216:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1788270278.342230:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1788270278.342238:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262750848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.342257:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262749184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.342265:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788270278.342274:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262750848:12345-0@lo:400:kworker.0 Request processed in 35us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.342284:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1788270278.342290:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1788270278.342298:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262750080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.342302:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1788270278.342312:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262750592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.342325:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262750080:12345-0@lo:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.342330:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1788270278.342343:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1788270278.342348:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262751104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.342353:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262750592:12345-0@lo:400:kworker.0 Request processed in 41us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.342360:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00080000:0.0:1788270278.342379:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270278.342384:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270278.342387:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262751104:12345-0@lo:400:kworker.0 Request processed in 38us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.342392:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1788270278.342420:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262750848:0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.342429:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262750976:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.342446:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262749568:0@lo:400:kworker.0 00000100:00100000:1.0:1788270278.342448:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262749312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270278.342484:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262750080:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.342496:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262750592:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.342507:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262751104:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.342522:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262749184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270278.347503:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270278.347594:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749440 00000100:00100000:1.0:1788270278.347603:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749440 00000100:00100000:2.0:1788270278.347686:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270278.347693:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788270278.347702:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262749440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270278.347724:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270278.347726:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262750208:0@lo:400:kworker.0 00000100:00100000:2.0:1788270278.347777:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270278.347786:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262749440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270278.347791:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788270278.347805:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262750720:0@lo:400:kworker.0 00000100:00100000:3.0:1788270278.347849:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262749696 00000100:00100000:3.0:1788270278.347854:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262749696 00000100:00100000:3.0:1788270278.347893:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750208 00000100:00100000:3.0:1788270278.347896:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750208 00000100:00100000:3.0:1788270278.347911:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788270278.347918:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262749696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270278.347953:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262749696:12345-0@lo:400:kworker.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270278.347959:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788270278.347973:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788270278.347979:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262750208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270278.348005:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262750208:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270278.348010:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788270278.348065:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262749440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270278.348268:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270278.348298:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262750720 00000100:00100000:2.0:1788270278.348304:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14262df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262749696:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.348304:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262750720 00000100:00100000:2.0:1788270278.348319:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262750208:0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.348365:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1788270278.348374:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262750720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270278.348418:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262750720:12345-0@lo:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270278.348424:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:1.0:1788270278.348485:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270278.348825:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262750720:0@lo:400:kworker.0 00000040:00080000:0.0:1788270278.931390:0:54986:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270278.931400:0:54986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270278.931990:0:54986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270278.932000:0:54986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270279.108234:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270279.364301:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270279.364309:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270279.364722:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270279.364732:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788270280.132196:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270280.132205:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270280.132793:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270280.132803:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270280.132913:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270280.356776:0:55037:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270280.356785:0:55037:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270280.357258:0:55037:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270280.357265:0:55037:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270280.388605:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270280.388628:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262751232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270280.388694:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270280.389090:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751232 00000100:00100000:1.0:1788270280.389098:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751232 00000100:00100000:1.0:1788270280.389158:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788270280.389169:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262751232:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270280.389245:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788270280.389886:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270280.389981:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262751232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 813us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270280.389990:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788270280.390185:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262751232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270280.900220:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262751360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270280.900285:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270280.900407:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751360 00000100:00100000:2.0:1788270280.900444:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751360 00000100:00100000:2.0:1788270280.900494:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788270280.900502:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262751360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270280.900536:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270280.900576:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262751360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270280.900582:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788270280.900862:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262751360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270281.156640:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270281.790011:0:55088:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270281.790020:0:55088:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270281.790667:0:55088:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270281.790679:0:55088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270282.184601:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270282.948638:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262751488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270282.948711:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270282.948980:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751488 00000100:00100000:3.0:1788270282.948989:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751488 00000100:00100000:2.0:1788270282.949098:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788270282.949112:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262751488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270282.949142:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270282.949188:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262751488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270282.949196:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788270282.949263:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262751488:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270283.205153:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270283.263335:0:55140:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270283.263343:0:55140:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270283.263894:0:55140:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270283.263902:0:55140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270283.266978:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267028:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267089:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267109:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267130:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267152:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267189:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270283.267219:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373056 00000100:00100000:1.0:1788270283.267229:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373056 00000100:00100000:1.0:1788270283.267288:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373184 00000100:00100000:1.0:1788270283.267291:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373184 00000100:00100000:1.0:1788270283.267316:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:1.0:1788270283.267327:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253373056:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270283.267412:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253373056:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.267421:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:1.0:1788270283.267441:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:1.0:1788270283.267449:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253373184:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270283.267475:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253373184:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.267482:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:1.0:1788270283.267507:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372800 00000100:00100000:1.0:1788270283.267511:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372800 00000100:00100000:1.0:1788270283.267542:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372928 00000100:00100000:1.0:1788270283.267545:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372928 00000100:00100000:1.0:1788270283.267567:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373312 00000100:00080000:3.0:1788270283.267570:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270283.267570:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373312 00000100:00080000:3.0:1788270283.267577:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270283.267580:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270283.267583:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270283.267587:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373440 00000100:00100000:1.0:1788270283.267591:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373440 00000100:00100000:3.0:1788270283.267602:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 454 00000100:00100000:3.0:1788270283.267614:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253372800:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270283.267617:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 455 00000100:00100000:1.0:1788270283.267629:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253372928:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270283.267661:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253372800:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.267663:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253372928:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270283.267677:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 454 00000100:00100000:2.0:1788270283.267722:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253372672 00000100:00100000:2.0:1788270283.267727:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253372672 00000100:00100000:2.0:1788270283.267761:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 246 00000100:00100000:2.0:1788270283.267768:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253372672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270283.267799:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253372672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270283.267804:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 246 00000100:00100000:1.0:1788270283.268161:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 455 00000100:00100000:3.0:1788270283.268169:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 456 00000100:00100000:3.0:1788270283.268177:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253373312:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270283.268182:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 457 00000100:00100000:1.0:1788270283.268193:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253373440:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270283.268205:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253373312:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270283.268211:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 456 00000100:00080000:3.0:1788270283.268225:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270283.268227:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253373440:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.268237:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 457 00000100:00100000:1.0:1788270283.460358:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262751744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460444:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270283.460452:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262751872:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460502:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460508:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262752256:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460530:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262752384:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460545:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270283.460565:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460571:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262752768:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460588:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262752896:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460603:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270283.460623:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262752000:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460638:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262753280:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460654:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460669:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270283.460688:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262752512:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460698:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788270283.460708:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262751616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270283.460716:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270283.460749:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262753024:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460756:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460783:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262752128:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460791:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460814:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460841:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262752640:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460845:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751872 00000100:00100000:2.0:1788270283.460856:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751872 00000100:00100000:1.0:1788270283.460867:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270283.460884:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262753152:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.460904:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752384 00000100:00100000:2.0:1788270283.460909:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752384 00000100:00100000:1.0:1788270283.460910:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270283.460941:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788270283.460952:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262751872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.460957:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751744 00000100:00100000:1.0:1788270283.460962:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751744 00000100:00100000:1.0:1788270283.460999:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788270283.461008:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262751744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.461014:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262751872:12345-0@lo:400:kworker.0 Request processed in 62us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270283.461024:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788270283.461067:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788270283.461076:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262752384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.461078:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262751744:12345-0@lo:400:kworker.0 Request processed in 71us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461087:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788270283.461118:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752256 00000100:00100000:2.0:1788270283.461119:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262752384:12345-0@lo:400:kworker.0 Request processed in 43us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461121:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752256 00000100:00100000:2.0:1788270283.461130:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788270283.461148:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752768 00000100:00100000:1.0:1788270283.461152:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752768 00000100:00100000:2.0:1788270283.461157:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753280 00000100:00100000:2.0:1788270283.461162:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753280 00000100:00100000:1.0:1788270283.461170:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753024 00000100:00100000:1.0:1788270283.461175:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753024 00000100:00100000:2.0:1788270283.461193:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753152 00000100:00100000:2.0:1788270283.461198:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753152 00000100:00100000:1.0:1788270283.461203:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1788270283.461213:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262752256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.461223:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1788270283.461233:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262752768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.461253:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262752256:12345-0@lo:400:kworker.0 Request processed in 42us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461261:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1788270283.461276:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262752768:12345-0@lo:400:kworker.0 Request processed in 44us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461282:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1788270283.461289:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1788270283.461294:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262753280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.461310:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1788270283.461319:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262753024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.461333:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262753280:12345-0@lo:400:kworker.0 Request processed in 43us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461340:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1788270283.461361:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1788270283.461362:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262753024:12345-0@lo:400:kworker.0 Request processed in 42us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461383:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262753152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.461384:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1788270283.461500:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752000 00000100:00100000:1.0:1788270283.461504:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262753152:12345-0@lo:400:kworker.0 Request processed in 135us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270283.461506:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752000 00000100:00100000:1.0:1788270283.461515:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1788270283.461543:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752512 00000100:00100000:3.0:1788270283.461544:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752128 00000100:00100000:1.0:1788270283.461548:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752512 00000100:00100000:3.0:1788270283.461550:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752128 00000100:00100000:3.0:1788270283.461571:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752640 00000100:00100000:3.0:1788270283.461575:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752640 00000100:00100000:1.0:1788270283.461583:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788270283.461592:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262752000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270283.461600:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788270283.461610:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262752128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.461636:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262752000:12345-0@lo:400:kworker.0 Request processed in 46us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461644:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788270283.461658:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262752128:12345-0@lo:400:kworker.0 Request processed in 49us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.461665:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788270283.461673:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262752512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.461706:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262752512:12345-0@lo:400:kworker.0 Request processed in 34us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270283.461805:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262751616 00000100:00100000:0.0:1788270283.461809:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262751616 00000100:00100000:0.0:1788270283.461836:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788270283.461843:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262751616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270283.461862:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270283.461895:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262751616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270283.461901:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788270283.462083:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788270283.462090:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788270283.462100:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788270283.462109:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262752640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462146:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262751616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270283.462147:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262752640:12345-0@lo:400:kworker.0 Request processed in 37us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270283.462159:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788270283.462169:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262752128:0@lo:400:kworker.0 00000100:00080000:3.0:1788270283.462182:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270283.462183:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262752640:0@lo:400:kworker.0 00000100:00080000:3.0:1788270283.462187:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270283.462192:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270283.462195:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270283.462212:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262753152:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462225:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262752256:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462234:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262752768:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462244:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262753280:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462252:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262751744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462312:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270283.462339:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262752896 00000100:00100000:3.0:1788270283.462344:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262752896 00000100:00100000:1.0:1788270283.462345:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262753408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270283.462389:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1788270283.462394:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270283.462401:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262752896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270283.462429:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262751872:0@lo:400:kworker.0 00000100:00100000:3.0:1788270283.462442:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262752896:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270283.462448:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262752384:0@lo:400:kworker.0 00000100:00100000:3.0:1788270283.462453:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1788270283.462469:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262752896:0@lo:400:kworker.0 00000100:00080000:3.0:1788270283.462476:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270283.462491:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270283.462494:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753408 00000100:00100000:1.0:1788270283.462499:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262753536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270283.462500:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753408 00000100:00100000:3.0:1788270283.462530:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788270283.462536:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270283.462541:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262753408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270283.462553:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270283.462579:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753536 00000100:00100000:1.0:1788270283.462584:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753536 00000100:00100000:3.0:1788270283.462591:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262753408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270283.462599:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788270283.462614:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788270283.462623:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262753536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270283.462641:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270283.462644:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262753408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270283.462682:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262753536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270283.462689:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262753536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270283.462691:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788270283.463102:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262753024:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.463123:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262752000:0@lo:400:kworker.0 00000100:00100000:2.0:1788270283.463133:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262752512:0@lo:400:kworker.0 00010000:00010000:2.0:1788270284.228188:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270284.812584:0:55191:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270284.812593:0:55191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270284.813018:0:55191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270284.813024:0:55191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270285.252376:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270285.512670:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270285.512694:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262753664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270285.512764:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270285.512897:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753664 00000100:00100000:3.0:1788270285.512906:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753664 00000100:00100000:3.0:1788270285.513024:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788270285.513036:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262753664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270285.513088:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270285.513159:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262753664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270285.513167:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788270285.513216:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262753664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270285.513471:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270286.020660:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270286.020683:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262753792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270286.020751:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270286.020800:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753792 00000100:00100000:3.0:1788270286.020809:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753792 00000100:00100000:3.0:1788270286.020928:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788270286.020938:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262753792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270286.020971:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270286.021015:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262753792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270286.021021:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788270286.021161:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262753792:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788270286.220778:0:55242:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270286.220790:0:55242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270286.221304:0:55242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270286.221314:0:55242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270286.276371:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270287.300142:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270287.639028:0:55293:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270287.639053:0:55293:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270287.639573:0:55293:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270287.639583:0:55293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270288.068373:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262753920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270288.068533:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270288.068585:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262753920 00000100:00100000:1.0:1788270288.068594:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262753920 00000100:00100000:1.0:1788270288.068650:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788270288.068660:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262753920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270288.068692:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270288.068955:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262753920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 296us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270288.068965:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788270288.068969:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262753920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270288.325330:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270288.390617:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270288.390673:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270288.390695:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373696 00000100:00100000:1.0:1788270288.390707:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373696 00000100:00100000:3.0:1788270288.390716:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270288.390749:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270288.390773:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270288.390793:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270288.390819:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373568 00000100:00100000:2.0:1788270288.390825:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373568 00000100:00100000:2.0:1788270288.390871:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:2.0:1788270288.390881:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253373568:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270288.390976:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373824 00000100:00100000:1.0:1788270288.390981:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373824 00000100:00100000:2.0:1788270288.391084:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253373568:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 203us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270288.391093:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:3.0:1788270288.391210:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374080 00000100:00100000:3.0:1788270288.391215:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374080 00000100:00100000:3.0:1788270288.391242:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253373952 00000100:00100000:3.0:1788270288.391246:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253373952 00000100:00100000:3.0:1788270288.391268:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:3.0:1788270288.391276:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253374080:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270288.391317:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253374080:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 43us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.391324:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:3.0:1788270288.391339:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 231 00000100:00100000:3.0:1788270288.391346:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253373952:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270288.391368:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253373952:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.394069:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 231 00000100:00100000:0.0:1788270288.394200:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374336 00000100:00100000:0.0:1788270288.394208:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374336 00000100:00100000:0.0:1788270288.394310:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 464 00000100:00100000:0.0:1788270288.394320:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253373696:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270288.394379:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253373696:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 60us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270288.394385:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 464 00000100:00100000:0.0:1788270288.394399:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 465 00000100:00100000:0.0:1788270288.394405:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253373824:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270288.394429:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253373824:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270288.394435:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 465 00000100:00100000:0.0:1788270288.394446:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 466 00000100:00100000:0.0:1788270288.394452:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253374336:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270288.394471:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253374336:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 20us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270288.394476:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 466 00000100:00080000:0.0:1788270288.394491:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270288.394495:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270288.394498:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270288.394500:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270288.394825:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270288.395259:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374208 00000100:00100000:1.0:1788270288.395266:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374208 00000100:00080000:2.0:1788270288.395322:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270288.395337:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 467 00000100:00100000:1.0:1788270288.395347:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253374208:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270288.395386:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253374208:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270288.395393:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 467 00000100:00100000:1.0:1788270288.580617:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270288.580929:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270288.580941:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262754176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270288.580991:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262754048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270288.580999:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270288.581032:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.581079:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754176 00000100:00100000:3.0:1788270288.581084:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754176 00000100:00100000:1.0:1788270288.581095:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754048 00000100:00100000:1.0:1788270288.581101:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754048 00000100:00100000:3.0:1788270288.581129:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788270288.581136:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788270288.581138:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262754176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270288.581149:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262754048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270288.581163:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00002000:00000024:1.0:1788270288.581163:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270288.581216:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262754176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270288.581216:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262754048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.581229:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788270288.581234:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788270288.581347:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262754304:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581376:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.581393:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262754816:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581411:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.581420:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262755328:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581434:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.581451:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262754176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270288.581469:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788270288.581472:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262754688:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581485:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.581495:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262755200:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581505:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.581521:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755328 00000100:00100000:3.0:1788270288.581523:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755328 00000100:00100000:3.0:1788270288.581543:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754688 00000100:00100000:3.0:1788270288.581544:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754688 00000100:00100000:3.0:1788270288.581553:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755200 00000100:00100000:3.0:1788270288.581555:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755200 00000100:00100000:3.0:1788270288.581565:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1788270288.581569:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262755328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581592:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262755328:12345-0@lo:400:kworker.0 Request processed in 23us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.581596:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1788270288.581605:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1788270288.581609:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262754688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581635:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262754688:12345-0@lo:400:kworker.0 Request processed in 25us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.581643:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1788270288.581659:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1788270288.581666:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262755200:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788270288.581675:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270288.581681:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270288.581685:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270288.581698:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262755200:12345-0@lo:400:kworker.0 Request processed in 32us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.581706:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1788270288.581724:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262754688:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581740:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754304 00000100:00100000:2.0:1788270288.581741:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262755200:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581744:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754304 00000100:00100000:2.0:1788270288.581759:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262755328:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581769:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788270288.581774:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262754304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.581799:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262754304:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.581803:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788270288.581811:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262754304:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.581901:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262755712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270288.581921:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270288.581943:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754816 00000100:00100000:0.0:1788270288.581945:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754816 00000100:00100000:0.0:1788270288.581964:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788270288.581967:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262754816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.581987:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262754816:12345-0@lo:400:kworker.0 Request processed in 19us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270288.581991:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788270288.582009:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262754560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.582023:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270288.582034:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262755072:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.582063:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270288.582074:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262755584:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.582085:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270288.582094:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788270288.582097:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262754432:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.582107:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270288.582397:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755072 00000100:00100000:3.0:1788270288.582401:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755072 00000100:00100000:3.0:1788270288.582419:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755584 00000100:00100000:3.0:1788270288.582421:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755584 00000100:00100000:3.0:1788270288.582435:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1788270288.582439:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262755072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.582463:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262755072:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.582466:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1788270288.582474:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1788270288.582477:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262755584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.582490:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262755584:12345-0@lo:400:kworker.0 Request processed in 13us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.582493:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1788270288.582513:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754560 00000100:00100000:3.0:1788270288.582515:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754560 00000100:00080000:2.0:1788270288.582561:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270288.582566:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270288.582591:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788270288.582597:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262754560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270288.582612:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262754816:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.582631:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262754560:12345-0@lo:400:kworker.0 Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270288.582636:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755712 00000100:00100000:3.0:1788270288.582640:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788270288.582642:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755712 00000100:00100000:2.0:1788270288.582676:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788270288.582684:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262755712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270288.582701:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270288.582741:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262755712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270288.582749:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788270288.582761:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262755712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270288.583328:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262754944:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.583357:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270288.583419:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262755456:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.583436:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270288.583461:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262754560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.583468:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262755072:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.583474:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262755584:0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.583504:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754432 00000100:00100000:0.0:1788270288.583507:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754432 00000100:00100000:0.0:1788270288.583526:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788270288.583531:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262754432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270288.583554:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262754432:12345-0@lo:400:kworker.0 Request processed in 23us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270288.583560:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788270288.583576:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262754432:0@lo:400:kworker.0 00000100:00100000:1.0:1788270288.584433:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262754048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270288.585655:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755456 00000100:00100000:2.0:1788270288.585665:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755456 00000100:00080000:0.0:1788270288.585747:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270288.585752:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1788270288.585760:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262755456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270288.585854:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262755456:12345-0@lo:400:kworker.0 Request processed in 93us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270288.585862:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1788270288.585873:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262755456:0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.586134:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262754944 00000100:00100000:3.0:1788270288.586138:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262754944 00000100:00080000:0.0:1788270288.586234:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270288.586304:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788270288.586313:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262754944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270288.586361:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262754944:12345-0@lo:400:kworker.0 Request processed in 50us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270288.586368:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788270288.586417:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262754944:0@lo:400:kworker.0 00000040:00080000:3.0:1788270289.170279:0:55344:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270289.170287:0:55344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270289.170938:0:55344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270289.170950:0:55344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270289.348773:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270289.604290:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270289.604301:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270289.604724:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:2.0:1788270289.604734:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788270290.373161:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270290.373190:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270290.373195:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270290.373658:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270290.373668:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:3.0:1788270290.565447:0:55396:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270290.565458:0:55396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270290.566531:0:55396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270290.566542:0:55396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270290.631566:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262755840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270290.631636:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270290.631737:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755840 00000100:00100000:0.0:1788270290.631744:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755840 00000100:00100000:0.0:1788270290.631877:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788270290.631890:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262755840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270290.631918:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270290.631967:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262755840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270290.631974:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788270290.631999:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262755840:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788270290.632018:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270291.140531:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270291.140884:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262755968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270291.140953:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270291.141201:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262755968 00000100:00100000:0.0:1788270291.141209:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262755968 00000100:00100000:0.0:1788270291.141261:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788270291.141274:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262755968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270291.141309:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270291.141369:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262755968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270291.141380:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788270291.141454:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262755968:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270291.396298:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270292.061194:0:55447:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270292.061203:0:55447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270292.061766:0:55447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270292.061774:0:55447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270292.420368:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270293.188419:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270293.188476:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262756096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270293.188549:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270293.188840:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756096 00000100:00100000:0.0:1788270293.188850:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756096 00000100:00100000:0.0:1788270293.188939:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788270293.188951:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262756096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270293.188987:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270293.189078:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262756096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.189086:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788270293.189128:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262756096:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270293.445563:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270293.505654:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270293.505718:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374592 00000100:00100000:2.0:1788270293.505728:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374592 00000100:00100000:0.0:1788270293.505743:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270293.505801:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 474 00000100:00100000:2.0:1788270293.505813:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253374592:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270293.505832:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270293.505867:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374848 00000100:00100000:0.0:1788270293.505871:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374848 00000100:00100000:2.0:1788270293.505879:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253374592:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270293.505887:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 474 00000100:00100000:0.0:1788270293.505902:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:0.0:1788270293.505909:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253374848:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270293.505933:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253374848:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.505939:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00080000:1.0:1788270293.506085:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270293.506090:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270293.506445:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374464 00000100:00100000:3.0:1788270293.506451:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374464 00000100:00100000:3.0:1788270293.506493:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 250 00000100:00100000:3.0:1788270293.506502:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253374464:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270293.507445:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253374464:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270293.507456:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 250 00000100:00100000:1.0:1788270293.508201:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270293.508238:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270293.508261:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270293.508278:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374976 00000100:00100000:3.0:1788270293.508280:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253374720 00000100:00100000:0.0:1788270293.508286:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374976 00000100:00100000:3.0:1788270293.508287:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253374720 00000100:00100000:1.0:1788270293.508294:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270293.508319:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375232 00000100:00100000:1.0:1788270293.508323:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375232 00000100:00100000:3.0:1788270293.508356:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375104 00000100:00100000:0.0:1788270293.508361:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:3.0:1788270293.508362:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375104 00000100:00100000:1.0:1788270293.508367:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 475 00000100:00100000:0.0:1788270293.508378:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253374976:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270293.508380:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253374720:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270293.508399:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 476 00000100:00100000:3.0:1788270293.508409:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253375232:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270293.508446:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253374976:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270293.508448:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253374720:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270293.508451:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253375232:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270293.508468:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 475 00000100:00100000:0.0:1788270293.508468:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:3.0:1788270293.508478:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 476 00000100:00100000:1.0:1788270293.508495:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 477 00000100:00100000:1.0:1788270293.508505:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253375104:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788270293.508519:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270293.508525:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270293.508528:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270293.508537:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253375104:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270293.508544:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 477 00000040:00080000:3.0:1788270293.527236:0:55498:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270293.527245:0:55498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270293.527699:0:55498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270293.527706:0:55498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270293.700390:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262756224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270293.700407:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262756608:0@lo:400:kworker.0 00000100:00100000:3.0:1788270293.700468:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270293.700468:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270293.700520:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756608 00000100:00100000:0.0:1788270293.700529:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756608 00000100:00100000:3.0:1788270293.700541:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262756736:0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.700560:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262756352:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.700562:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262757120:0@lo:400:kworker.0 00000100:00100000:3.0:1788270293.700571:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270293.700586:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788270293.700597:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262757248:0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.700599:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262756608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.700604:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270293.700630:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270293.700639:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270293.700642:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262756864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270293.700663:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262757632:0@lo:400:kworker.0 00000100:00100000:3.0:1788270293.700672:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262757760:0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.700682:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270293.700688:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262756608:12345-0@lo:400:kworker.0 Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.700698:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788270293.700710:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262757376:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.700711:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270293.700718:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756736 00000100:00100000:0.0:1788270293.700720:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757248 00000100:00100000:3.0:1788270293.700724:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756736 00000100:00100000:0.0:1788270293.700727:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757248 00000100:00100000:1.0:1788270293.700742:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270293.700754:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788270293.700763:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262757248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.700764:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262757888:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.700769:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262756608:0@lo:400:kworker.0 00000100:00100000:3.0:1788270293.700775:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757376 00000100:00100000:3.0:1788270293.700780:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757376 00000100:00100000:1.0:1788270293.700794:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270293.700806:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788270293.700815:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788270293.700817:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262756480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270293.700821:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262757248:12345-0@lo:400:kworker.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270293.700829:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262756736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.700834:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788270293.700854:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270293.700869:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757120 00000100:00100000:0.0:1788270293.700874:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757120 00000100:00100000:3.0:1788270293.700884:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262756736:12345-0@lo:400:kworker.0 Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270293.700884:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262756992:0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.700889:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756352 00000100:00100000:1.0:1788270293.700895:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756352 00000100:00100000:3.0:1788270293.700899:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788270293.700906:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757632 00000100:00100000:0.0:1788270293.700912:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757632 00000100:00100000:3.0:1788270293.700924:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788270293.700928:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270293.700937:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262757376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.700940:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788270293.700945:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757888 00000100:00100000:0.0:1788270293.700950:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757888 00000100:00100000:1.0:1788270293.700954:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262756352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.700956:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262757504:0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.700983:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1788270293.700991:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262757376:12345-0@lo:400:kworker.0 Request processed in 56us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.700997:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262757120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270293.701003:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788270293.701006:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262756352:12345-0@lo:400:kworker.0 Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270293.701010:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270293.701017:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788270293.701021:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756992 00000100:00100000:3.0:1788270293.701027:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756992 00000100:00100000:2.0:1788270293.701059:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262758016:0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.701068:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756224 00000100:00100000:1.0:1788270293.701072:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756224 00000100:00100000:3.0:1788270293.701078:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788270293.701080:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262757120:12345-0@lo:400:kworker.0 Request processed in 87us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270293.701089:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262756992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.701094:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756864 00000100:00100000:0.0:1788270293.701098:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1788270293.701099:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756864 00000100:00100000:2.0:1788270293.701107:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270293.701114:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262756480 00000100:00100000:1.0:1788270293.701117:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262756480 00000100:00100000:0.0:1788270293.701119:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757504 00000100:00100000:0.0:1788270293.701124:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757504 00000100:00100000:1.0:1788270293.701131:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788270293.701142:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262756224:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270293.701144:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758016 00000100:00100000:0.0:1788270293.701148:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758016 00002000:00000024:1.0:1788270293.701166:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270293.701167:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1788270293.701176:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262757632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.702001:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262757120:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.702022:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262756992:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.702069:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788270293.702079:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262756864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270293.702103:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262756992:12345-0@lo:400:kworker.0 Request processed in 1018us (1180us total) trans 0 rc 0/0 00002000:00000024:2.0:1788270293.702162:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270293.702298:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262756864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270293.702309:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788270293.702317:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788270293.702335:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788270293.702344:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1788270293.702346:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262756480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270293.702356:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262757888:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788270293.702358:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270293.702371:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262756224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1231us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270293.702380:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788270293.702382:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262757632:12345-0@lo:400:kworker.0 Request processed in 1202us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.702392:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1788270293.702399:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262756480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270293.702409:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788270293.702409:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1788270293.702418:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1788270293.702421:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262757504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.702431:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262758016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.702449:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262757504:12345-0@lo:400:kworker.0 Request processed in 32us (1445us total) trans 0 rc 0/0 00000100:00080000:2.0:1788270293.702451:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270293.702455:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00080000:2.0:1788270293.702458:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270293.702462:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270293.702465:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270293.702481:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270293.702490:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262756352:0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.702499:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262758016:12345-0@lo:400:kworker.0 Request processed in 69us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.702508:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1788270293.702509:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262756864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270293.702528:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262756224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270293.702528:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262757376:0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.702529:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262757760 00000100:00100000:0.0:1788270293.702536:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262757760 00000100:00100000:0.0:1788270293.702577:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1788270293.702586:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262757760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.702591:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262756480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270293.702600:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262757504:0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.702607:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262758016:0@lo:400:kworker.0 00000100:00100000:1.0:1788270293.702618:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262757632:0@lo:400:kworker.0 00000100:00100000:0.0:1788270293.702625:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262757760:12345-0@lo:400:kworker.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270293.702632:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00080000:0.0:1788270293.702649:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270293.702694:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262756736:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.702707:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262757248:0@lo:400:kworker.0 00000100:00100000:2.0:1788270293.702716:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262757760:0@lo:400:kworker.0 00000100:00100000:3.0:1788270293.702938:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262757888:12345-0@lo:400:kworker.0 Request processed in 585us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270293.702945:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1788270293.702978:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262757888:0@lo:400:kworker.0 00010000:00010000:3.0:1788270294.468428:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270295.018114:0:55549:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270295.018123:0:55549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270295.021210:0:55549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270295.021226:0:55549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270295.493300:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270295.748279:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262758144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270295.748350:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270295.748433:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758144 00000100:00100000:2.0:1788270295.748442:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758144 00000100:00100000:2.0:1788270295.748511:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788270295.748523:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262758144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270295.748548:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270295.748597:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262758144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270295.748605:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1788270295.748660:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270295.748778:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262758144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270296.260510:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270296.260537:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262758272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270296.260603:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270296.260758:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758272 00000100:00100000:2.0:1788270296.260766:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758272 00000100:00100000:2.0:1788270296.260814:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788270296.260824:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262758272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270296.260854:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270296.260904:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262758272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270296.260911:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788270296.260944:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262758272:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788270296.421858:0:55600:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270296.421866:0:55600:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270296.422360:0:55600:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270296.422369:0:55600:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270296.516381:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270297.540286:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270297.809978:0:55652:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270297.809988:0:55652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270297.810587:0:55652:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270297.810597:0:55652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270298.308927:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270298.308954:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262758400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270298.309068:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270298.309155:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758400 00000100:00100000:0.0:1788270298.309167:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758400 00000100:00100000:0.0:1788270298.309260:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788270298.309274:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262758400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270298.309318:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270298.309395:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262758400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270298.309404:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788270298.309447:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262758400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270298.566488:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270298.625737:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270298.625855:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270298.625885:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270298.625918:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270298.625963:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375360 00000100:00100000:3.0:1788270298.625975:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375360 00000100:00100000:3.0:1788270298.626032:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 252 00000100:00100000:3.0:1788270298.626076:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253375360:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270298.626165:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253375360:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270298.626172:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 252 00000100:00100000:1.0:1788270298.627566:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375744 00000100:00100000:1.0:1788270298.627579:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375744 00000100:00100000:1.0:1788270298.627667:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00100000:1.0:1788270298.627678:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253375744:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270298.627742:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253375744:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.627750:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00080000:3.0:1788270298.628092:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270298.629681:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270298.629969:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375488 00000100:00100000:2.0:1788270298.629981:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375488 00000100:00100000:2.0:1788270298.631487:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375616 00000100:00100000:2.0:1788270298.631501:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375616 00000100:00080000:3.0:1788270298.631698:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270298.631703:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270298.631745:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 484 00000100:00100000:3.0:1788270298.631756:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253375488:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270298.631850:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253375488:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 98us (6128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270298.631857:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 484 00000100:00100000:2.0:1788270298.632129:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 485 00000100:00100000:2.0:1788270298.632138:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253375616:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270298.632176:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253375616:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (6256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270298.632183:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 485 00000100:00100000:0.0:1788270298.632651:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270298.632748:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270298.632833:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376000 00000100:00100000:1.0:1788270298.632841:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376000 00000100:00100000:1.0:1788270298.632887:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376128 00000100:00100000:1.0:1788270298.632891:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376128 00000100:00100000:1.0:1788270298.632916:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 486 00000100:00100000:1.0:1788270298.632925:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253376000:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270298.632972:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253376000:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 48us (3301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.632980:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 486 00000100:00100000:1.0:1788270298.632996:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 487 00000100:00100000:1.0:1788270298.633002:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253376128:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270298.633029:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253376128:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.633035:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 487 00000100:00080000:0.0:1788270298.633210:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270298.633214:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270298.633818:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253375872 00000100:00100000:2.0:1788270298.633825:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253375872 00000100:00100000:2.0:1788270298.633931:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:2.0:1788270298.633942:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253375872:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270298.634116:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253375872:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 164us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270298.634125:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00080000:0.0:1788270298.634218:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270298.820369:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262758656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270298.820463:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270298.820582:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758656 00000100:00100000:3.0:1788270298.820593:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758656 00000100:00100000:3.0:1788270298.820672:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788270298.820684:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262758656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270298.820722:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270298.820777:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262758528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.820821:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.820901:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262758912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270298.820930:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.820951:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270298.820957:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262758784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270298.820980:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.821002:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758912 00000100:00100000:2.0:1788270298.821006:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758912 00000100:00100000:2.0:1788270298.821028:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758784 00000100:00100000:2.0:1788270298.821030:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758784 00000100:00100000:2.0:1788270298.821065:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788270298.821073:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262758912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270298.821091:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270298.821137:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262758912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270298.821145:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788270298.821167:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788270298.821174:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262758784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270298.821184:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270298.821213:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262758784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270298.821221:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788270298.821263:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262758784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270298.821277:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262758912:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788270298.821325:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270298.821329:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270298.821344:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262758528 00000100:00100000:2.0:1788270298.821347:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262758528 00000100:00100000:2.0:1788270298.821375:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788270298.821381:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262758528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.821409:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262758528:12345-0@lo:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270298.821415:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788270298.821440:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262758528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.823929:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262759040:0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.823960:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262759424:0@lo:400:kworker.0 00000100:00100000:0.0:1788270298.824036:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262759168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824162:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.824208:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262759552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824232:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.824271:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759040 00000100:00100000:2.0:1788270298.824278:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759040 00000100:00100000:1.0:1788270298.824325:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.824326:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759552 00000100:00100000:2.0:1788270298.824329:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759552 00000100:00100000:1.0:1788270298.824352:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262759936:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824356:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759424 00000100:00100000:2.0:1788270298.824359:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759424 00000100:00100000:1.0:1788270298.824376:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.824380:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1788270298.824388:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262759040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824390:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788270298.824395:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262759296:0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824420:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.824437:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262759040:12345-0@lo:400:kworker.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.824438:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262759808:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824445:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788270298.824460:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270298.824461:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759936 00000100:00100000:2.0:1788270298.824464:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759936 00000100:00100000:2.0:1788270298.824478:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759808 00000100:00100000:2.0:1788270298.824481:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759808 00000100:00100000:1.0:1788270298.824481:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759296 00000100:00100000:1.0:1788270298.824483:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759296 00000100:00100000:2.0:1788270298.824493:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1788270298.824498:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262759552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824513:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788270298.824520:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262759296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824526:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262759552:12345-0@lo:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270298.824533:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1788270298.824545:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1788270298.824551:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262759424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824552:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262759296:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.824558:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788270298.824590:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262759424:12345-0@lo:400:kworker.0 Request processed in 39us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.824594:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262759296:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824596:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1788270298.824605:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262759424:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824607:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1788270298.824613:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262759936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824638:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1788270298.824642:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262759936:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.824645:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262759808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824648:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00080000:2.0:1788270298.824666:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270298.824671:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270298.824673:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270298.824691:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262759552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.824701:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262759040:0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824705:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262759808:12345-0@lo:400:kworker.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270298.824710:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1788270298.824735:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262759808:0@lo:400:kworker.0 00000100:00100000:1.0:1788270298.824745:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262759936:0@lo:400:kworker.0 00000100:00100000:3.0:1788270298.824800:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262758656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4117us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270298.824810:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788270298.825173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270298.825269:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262759680:0@lo:400:kworker.0 00000100:00100000:3.0:1788270298.825291:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759168 00000100:00100000:3.0:1788270298.825297:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759168 00000100:00100000:0.0:1788270298.825297:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270298.825347:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788270298.825350:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262759680 00000100:00100000:0.0:1788270298.825355:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262758656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270298.825357:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262759680 00000100:00100000:3.0:1788270298.825358:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262759168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.825398:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00080000:0.0:1788270298.825403:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270298.825410:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262759680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270298.825428:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262759168:12345-0@lo:400:kworker.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270298.825437:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788270298.825439:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262759168:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.825461:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262759680:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270298.825461:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262759680:0@lo:400:kworker.0 00000100:00100000:2.0:1788270298.825474:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000040:00080000:1.0:1788270299.257872:0:55703:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270299.257881:0:55703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270299.260554:0:55703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270299.260572:0:55703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270299.589362:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270299.844258:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788270299.844267:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270299.844930:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:3.0:1788270299.844940:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788270300.612301:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270300.612356:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270300.612361:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270300.613214:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270300.613227:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:1.0:1788270300.700655:0:55754:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270300.700666:0:55754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270300.701459:0:55754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270300.701470:0:55754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270300.868419:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270300.868730:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262760064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270300.868811:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270300.868905:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760064 00000100:00100000:2.0:1788270300.868914:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760064 00000100:00100000:2.0:1788270300.868987:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788270300.869000:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262760064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270300.869028:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00080000:0.0:1788270300.869574:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270300.869693:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262760064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 697us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270300.869703:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788270300.869739:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262760064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270301.380531:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262760192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270301.380589:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270301.380678:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760192 00000100:00100000:2.0:1788270301.380685:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760192 00000100:00100000:2.0:1788270301.380740:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788270301.380748:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262760192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270301.380773:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270301.382890:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262760192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2137us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270301.382900:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788270301.383768:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262760192:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270301.636361:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270302.158667:0:55805:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270302.158674:0:55805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270302.159126:0:55805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270302.159133:0:55805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270302.660285:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270303.429376:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262760320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270303.429438:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270303.429497:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760320 00000100:00100000:3.0:1788270303.429505:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760320 00000100:00100000:3.0:1788270303.429568:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788270303.429576:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262760320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270303.429602:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270303.429650:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262760320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270303.429658:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788270303.429832:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262760320:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788270303.566757:0:55856:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270303.566768:0:55856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270303.567630:0:55856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270303.567640:0:55856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270303.684522:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270303.745970:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270303.746060:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270303.746086:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270303.746114:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376256 00000100:00100000:0.0:1788270303.746120:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270303.746124:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376256 00000100:00100000:0.0:1788270303.746156:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270303.746172:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 254 00000100:00100000:1.0:1788270303.746180:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253376256:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270303.746199:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376768 00000100:00100000:0.0:1788270303.746205:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376768 00000100:00100000:1.0:1788270303.746235:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253376256:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270303.746241:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 254 00000100:00100000:0.0:1788270303.746255:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00100000:0.0:1788270303.746265:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253376768:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270303.746298:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253376768:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.746305:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00080000:0.0:1788270303.746338:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270303.746388:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376384 00000100:00100000:1.0:1788270303.746392:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376384 00000100:00100000:1.0:1788270303.746423:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376512 00000100:00100000:1.0:1788270303.746426:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376512 00000100:00100000:1.0:1788270303.746445:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377024 00000100:00100000:1.0:1788270303.746448:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377024 00000100:00100000:1.0:1788270303.746467:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 494 00000100:00100000:1.0:1788270303.746474:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253376384:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270303.746507:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253376384:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270303.746514:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 494 00000100:00100000:1.0:1788270303.746526:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 495 00000100:00100000:1.0:1788270303.746532:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253376512:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:0.0:1788270303.746544:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270303.746549:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270303.746560:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253376512:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270303.746568:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 495 00000100:00100000:0.0:1788270303.746576:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 496 00000100:00100000:0.0:1788270303.746586:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253377024:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270303.746614:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253377024:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.746621:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 496 00000100:00100000:0.0:1788270303.747738:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270303.747785:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376640 00000100:00100000:2.0:1788270303.747790:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376640 00000100:00100000:0.0:1788270303.747821:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270303.747832:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 243 00000100:00100000:2.0:1788270303.747840:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253376640:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270303.747869:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253376640:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270303.747873:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 243 00000100:00100000:2.0:1788270303.747890:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253376896 00000100:00100000:2.0:1788270303.747892:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253376896 00000100:00100000:2.0:1788270303.747914:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 497 00000100:00100000:2.0:1788270303.747919:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253376896:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270303.747937:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253376896:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 19us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270303.747941:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 497 00000100:00080000:1.0:1788270303.747993:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270303.747996:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270303.940217:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270303.940240:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262760448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270303.940240:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262760576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270303.940381:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262760704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270303.940437:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262760960:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.940775:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.940834:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262761088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.940862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.940882:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262761600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.940903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.940920:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262762112:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.940942:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.940963:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788270303.940970:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262761216:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.940994:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.941010:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262761728:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941067:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.941084:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262762240:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941106:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.941135:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762112 00000100:00100000:0.0:1788270303.941142:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762112 00000100:00100000:0.0:1788270303.941195:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761216 00000100:00100000:0.0:1788270303.941198:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761216 00000100:00100000:0.0:1788270303.941217:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761728 00000100:00100000:0.0:1788270303.941220:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761728 00000100:00100000:0.0:1788270303.941230:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762240 00000100:00100000:0.0:1788270303.941232:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762240 00000100:00100000:0.0:1788270303.941247:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1788270303.941254:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262762112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941305:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262762112:12345-0@lo:400:kworker.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.941313:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1788270303.941329:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1788270303.941335:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262761216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941362:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262761216:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.941368:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1788270303.941378:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1788270303.941384:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262761728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941406:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262761728:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.941412:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1788270303.941421:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1788270303.941426:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262762240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941466:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262762240:12345-0@lo:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.941471:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00080000:0.0:1788270303.941493:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270303.941497:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270303.941509:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761088 00000100:00100000:0.0:1788270303.941513:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761088 00000100:00100000:0.0:1788270303.941540:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761600 00000100:00100000:0.0:1788270303.941543:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761600 00000100:00100000:0.0:1788270303.941565:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788270303.941571:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262761088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941601:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262761088:12345-0@lo:400:kworker.0 Request processed in 30us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.941683:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788270303.941711:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788270303.941717:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262761600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941745:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262761600:12345-0@lo:400:kworker.0 Request processed in 29us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.941750:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1788270303.941767:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270303.941799:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262761216:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941809:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262761728:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941817:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262762240:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941825:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262761088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941833:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262761600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941840:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262762112:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.941904:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760576 00000100:00100000:0.0:1788270303.941907:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760576 00000100:00100000:0.0:1788270303.941939:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788270303.941945:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262760576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270303.941963:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788270303.941968:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270303.942027:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262760576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.942034:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788270303.942061:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760448 00000100:00100000:0.0:1788270303.942065:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760448 00000100:00100000:0.0:1788270303.942082:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788270303.942088:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262760448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270303.942104:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270303.942119:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262760832:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942135:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262760448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.942141:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1788270303.942157:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270303.942165:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.942186:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262760576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270303.942198:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262761344:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942224:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760832 00000100:00100000:2.0:1788270303.942228:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.942230:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760832 00000100:00100000:2.0:1788270303.942250:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262761856:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942261:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788270303.942274:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270303.942274:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262760832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270303.942301:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262760448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270303.942319:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262760832:12345-0@lo:400:kworker.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270303.942326:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262760832:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942328:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788270303.942357:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761344 00000100:00100000:2.0:1788270303.942362:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761344 00000100:00100000:0.0:1788270303.942383:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761856 00000100:00100000:0.0:1788270303.942388:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761856 00000100:00100000:2.0:1788270303.942397:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788270303.942407:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262761344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942423:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1788270303.942432:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262761856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270303.942442:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262761344:12345-0@lo:400:kworker.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270303.942450:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788270303.942470:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262761856:12345-0@lo:400:kworker.0 Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.942477:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1788270303.942485:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262761344:0@lo:400:kworker.0 00000100:00080000:0.0:1788270303.942496:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270303.942499:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262761856:0@lo:400:kworker.0 00000100:00100000:1.0:1788270303.942589:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270303.942597:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270303.942635:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262761472:0@lo:400:kworker.0 00000100:00100000:3.0:1788270303.942661:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270303.942676:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760960 00000100:00100000:2.0:1788270303.942685:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760960 00000100:00100000:3.0:1788270303.942687:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262761984:0@lo:400:kworker.0 00000100:00100000:3.0:1788270303.942713:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270303.942755:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761984 00000100:00100000:3.0:1788270303.942759:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761984 00000100:00100000:2.0:1788270303.942776:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262761472 00000100:00100000:2.0:1788270303.942782:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262761472 00000100:00100000:1.0:1788270303.942784:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788270303.942793:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262760704 00000100:00100000:0.0:1788270303.942798:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262760704 00000100:00100000:1.0:1788270303.942799:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262760960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270303.942806:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1788270303.942818:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262761984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270303.942820:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788270303.942826:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788270303.942834:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262761472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942839:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262760704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270303.942851:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270303.942855:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262760960:12345-0@lo:400:kworker.0 Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270303.942862:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788270303.942878:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262761984:12345-0@lo:400:kworker.0 Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270303.942888:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1788270303.942890:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262761472:12345-0@lo:400:kworker.0 Request processed in 58us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270303.942900:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788270303.942902:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262760960:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942906:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262760704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270303.942914:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:3.0:1788270303.942919:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270303.942924:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1428fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262761472:0@lo:400:kworker.0 00000100:00080000:3.0:1788270303.942926:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270303.942944:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262761984:0@lo:400:kworker.0 00000100:00100000:0.0:1788270303.942969:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262760704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788270304.708468:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270304.963838:0:55908:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270304.963848:0:55908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270304.964811:0:55908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270304.964823:0:55908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270305.732372:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270305.994136:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270305.994203:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262762368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270305.994259:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270305.994346:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762368 00000100:00100000:0.0:1788270305.994353:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762368 00000100:00080000:3.0:1788270305.994414:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270305.994449:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788270305.994460:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262762368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270305.994488:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270305.994532:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262762368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270305.994539:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788270305.994581:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262762368:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788270306.417638:0:55959:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270306.417648:0:55959:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270306.418147:0:55959:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270306.418157:0:55959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270306.500210:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262762496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270306.500278:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270306.500390:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762496 00000100:00100000:1.0:1788270306.500399:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762496 00000100:00100000:1.0:1788270306.500446:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788270306.500453:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262762496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270306.500479:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270306.500518:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262762496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270306.500522:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788270306.500566:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262762496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270306.757467:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270307.783937:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270307.812748:0:56010:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270307.812757:0:56010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270307.813329:0:56010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270307.813337:0:56010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270308.548264:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262762624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270308.548332:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270308.548373:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762624 00000100:00100000:2.0:1788270308.548382:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762624 00000100:00100000:2.0:1788270308.548595:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788270308.548607:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262762624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270308.548639:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270308.548683:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262762624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270308.548695:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788270308.548715:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262762624:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270308.804353:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270308.867004:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867084:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867126:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867159:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867181:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867200:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867244:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270308.867273:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377408 00000100:00100000:0.0:1788270308.867290:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377408 00000100:00100000:0.0:1788270308.867342:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377920 00000100:00100000:0.0:1788270308.867346:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377920 00000100:00100000:0.0:1788270308.867363:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377280 00000100:00100000:0.0:1788270308.867366:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377280 00000100:00100000:0.0:1788270308.867377:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377792 00000100:00100000:0.0:1788270308.867378:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377792 00000100:00100000:0.0:1788270308.867389:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 504 00000100:00100000:0.0:1788270308.867395:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253377408:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270308.867457:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253377408:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 61us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270308.867464:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 504 00000100:00100000:0.0:1788270308.867482:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 505 00000100:00100000:0.0:1788270308.867488:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253377920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270308.867512:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253377920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270308.867518:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 505 00000100:00100000:0.0:1788270308.867529:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 506 00000100:00100000:0.0:1788270308.867535:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253377280:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270308.867557:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253377280:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270308.867563:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 506 00000100:00100000:0.0:1788270308.867575:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 507 00000100:00100000:0.0:1788270308.867581:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253377792:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270308.867601:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253377792:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270308.867606:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 507 00000100:00100000:1.0:1788270308.867655:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377152 00000100:00100000:1.0:1788270308.867661:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377152 00000100:00100000:1.0:1788270308.867704:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:1.0:1788270308.867712:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253377152:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270308.867742:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253377152:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270308.867749:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:1.0:1788270308.867783:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377664 00000100:00100000:1.0:1788270308.867787:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377664 00000100:00100000:1.0:1788270308.867818:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253377536 00000100:00100000:1.0:1788270308.867821:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253377536 00000100:00100000:1.0:1788270308.867841:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00100000:1.0:1788270308.867848:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253377664:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270308.867915:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 249 00000100:00100000:2.0:1788270308.867939:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253377536:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270308.868101:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253377664:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 252us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270308.868108:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 248 00000100:00080000:1.0:1788270308.868137:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270308.868142:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270308.868145:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270308.868147:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270308.868670:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253377536:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 745us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270308.868678:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 249 00000100:00100000:2.0:1788270309.060249:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262762752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270309.060320:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270309.060386:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262762880:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788270309.060407:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000100:00100000:2.0:1788270309.060413:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788270309.060414:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788270309.060437:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262763008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270309.060459:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270309.060496:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270309.060503:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262763136:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.060537:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270309.060538:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262763264:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.060571:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262763520:0@lo:400:kworker.0 00000100:00100000:0.0:1788270309.060586:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270309.060606:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270309.060621:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262763776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.060634:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763264 00000100:00100000:2.0:1788270309.060635:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262764032:0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.060644:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763264 00000100:00100000:0.0:1788270309.060654:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270309.060675:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270309.060679:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788270309.060687:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262763392:0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.060695:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763776 00000100:00100000:1.0:1788270309.060700:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763776 00000100:00100000:2.0:1788270309.060709:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788270309.060718:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262763648:0@lo:400:kworker.0 00000100:00100000:0.0:1788270309.060721:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270309.060727:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764032 00000100:00100000:1.0:1788270309.060730:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764032 00000100:00100000:0.0:1788270309.060753:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262763904:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.060757:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270309.060764:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1788270309.060776:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262763264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.060779:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262764160:0@lo:400:kworker.0 00000100:00100000:0.0:1788270309.060784:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270309.060814:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763648 00000100:00100000:2.0:1788270309.060815:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270309.060820:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763648 00000100:00100000:1.0:1788270309.060842:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262763264:12345-0@lo:400:kworker.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270309.060845:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762752 00000100:00100000:0.0:1788270309.060848:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763904 00000100:00100000:2.0:1788270309.060851:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762752 00000100:00100000:1.0:1788270309.060851:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1788270309.060855:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763904 00000100:00100000:1.0:1788270309.060869:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764160 00000100:00100000:1.0:1788270309.060873:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764160 00000100:00100000:2.0:1788270309.060885:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262762880 00000100:00100000:2.0:1788270309.060890:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262762880 00000100:00100000:0.0:1788270309.060891:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1788270309.060898:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1788270309.060903:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262763776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.060910:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262764032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.060915:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763008 00000100:00100000:2.0:1788270309.060919:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763008 00000100:00100000:2.0:1788270309.060964:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788270309.060973:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262763776:12345-0@lo:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270309.060974:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262762752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270309.060985:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262764032:12345-0@lo:400:kworker.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270309.060989:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1788270309.060999:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00002000:00000024:2.0:1788270309.061004:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270309.061012:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1788270309.061023:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262763648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.061035:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1788270309.061058:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262762752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270309.061068:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788270309.061073:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262763904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061086:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788270309.061095:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262762880:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270309.061111:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262763904:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00002000:00000024:2.0:1788270309.061112:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270309.061123:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1788270309.061143:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262763648:12345-0@lo:400:kworker.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270309.061145:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1788270309.061155:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262762880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270309.061158:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1788270309.061159:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262764160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061170:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788270309.061190:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788270309.061196:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763392 00000100:00100000:2.0:1788270309.061198:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25eb1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262763008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270309.061203:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763392 00000100:00100000:1.0:1788270309.061205:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262764160:12345-0@lo:400:kworker.0 Request processed in 49us (389us total) trans 0 rc 0/0 00002000:00000024:2.0:1788270309.061214:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270309.061215:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00080000:1.0:1788270309.061243:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270309.061243:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788270309.061248:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25eb1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262763008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (785us total) trans 0 rc 0/0 00000100:00080000:1.0:1788270309.061250:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270309.061257:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270309.061257:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262763392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061259:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1788270309.061263:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270309.061306:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262763904:0@lo:400:kworker.0 00000100:00100000:0.0:1788270309.061314:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262763392:12345-0@lo:400:kworker.0 Request processed in 57us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270309.061323:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788270309.061329:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262763776:0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.061346:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262763264:0@lo:400:kworker.0 00000100:00100000:0.0:1788270309.061371:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763520 00000100:00100000:0.0:1788270309.061376:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763520 00000100:00100000:1.0:1788270309.061388:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262763392:0@lo:400:kworker.0 00000100:00100000:0.0:1788270309.061421:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788270309.061430:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262763520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270309.061432:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262763136 00000100:00100000:1.0:1788270309.061438:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262763136 00000100:00100000:0.0:1788270309.061474:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262763520:12345-0@lo:400:kworker.0 Request processed in 45us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270309.061475:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788270309.061485:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788270309.061490:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262763136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788270309.061516:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270309.061532:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262763136:12345-0@lo:400:kworker.0 Request processed in 47us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270309.061540:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788270309.061555:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262762752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270309.061558:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262763648:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061575:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262764160:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061586:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262764032:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061597:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262763520:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061607:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262763136:0@lo:400:kworker.0 00000100:00100000:2.0:1788270309.061621:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262762880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270309.061633:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262763008:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788270309.062356:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:3.0:1788270309.062365:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:1.0:1788270309.302598:0:56061:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270309.302606:0:56061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270309.303326:0:56061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270309.303335:0:56061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270309.828226:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270310.852208:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270310.852216:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270310.852756:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270310.852765:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270310.855360:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270310.904607:0:56112:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270310.904615:0:56112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270310.905653:0:56112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270310.905661:0:56112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270311.108949:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262764288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270311.109083:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270311.109150:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764288 00000100:00100000:2.0:1788270311.109159:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764288 00000100:00100000:2.0:1788270311.109880:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788270311.109908:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262764288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270311.109937:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00080000:3.0:1788270311.111121:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270311.113357:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262764288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3463us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270311.113367:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788270311.113687:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262764288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270311.620233:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262764416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270311.620324:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270311.620497:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764416 00000100:00100000:0.0:1788270311.620504:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764416 00000100:00100000:0.0:1788270311.620553:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788270311.620559:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262764416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270311.620586:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270311.620627:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262764416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270311.620632:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788270311.620667:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262764416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270311.878016:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270312.890526:0:56164:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270312.890536:0:56164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270312.891314:0:56164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270312.891324:0:56164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270312.909272:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270313.669009:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262764544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270313.669190:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270313.669245:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764544 00000100:00100000:0.0:1788270313.669255:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764544 00000100:00100000:0.0:1788270313.669347:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788270313.669361:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262764544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270313.669400:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270313.676209:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262764544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6841us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.676225:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788270313.676530:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262764544:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270313.924357:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270313.992925:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.992978:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.993022:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.993093:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.993115:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.993135:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.993163:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270313.993191:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378304 00000100:00100000:0.0:1788270313.993201:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378304 00000100:00100000:0.0:1788270313.993257:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378816 00000100:00100000:0.0:1788270313.993260:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378816 00000100:00100000:0.0:1788270313.993278:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378176 00000100:00100000:0.0:1788270313.993281:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378176 00000100:00100000:0.0:1788270313.993293:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378688 00000100:00100000:0.0:1788270313.993296:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378688 00000100:00100000:0.0:1788270313.993312:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 514 00000100:00100000:0.0:1788270313.993322:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253378304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270313.993393:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253378304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 73us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.993401:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 514 00000100:00100000:0.0:1788270313.993478:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 515 00000100:00100000:0.0:1788270313.993485:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253378816:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270313.993515:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253378816:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.993521:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 515 00000100:00100000:0.0:1788270313.993534:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 516 00000100:00100000:0.0:1788270313.993540:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253378176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270313.993563:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253378176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.993570:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 516 00000100:00100000:0.0:1788270313.993581:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 517 00000100:00100000:0.0:1788270313.993587:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253378688:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270313.993611:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253378688:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.993617:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 517 00000100:00100000:0.0:1788270313.993639:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378560 00000100:00100000:0.0:1788270313.993643:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378560 00000100:00100000:0.0:1788270313.993671:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378432 00000100:00100000:0.0:1788270313.993675:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378432 00000100:00100000:0.0:1788270313.993695:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 251 00000100:00100000:0.0:1788270313.993702:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253378560:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270313.993727:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253378560:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.993733:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 251 00000100:00100000:0.0:1788270313.993745:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 252 00000100:00100000:0.0:1788270313.993751:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253378432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270313.993775:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253378432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270313.993782:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 252 00000100:00080000:0.0:1788270313.993798:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270313.993801:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270313.993803:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270313.993805:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270313.994018:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378048 00000100:00100000:2.0:1788270313.994023:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378048 00000100:00100000:2.0:1788270313.994082:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 258 00000100:00100000:2.0:1788270313.994090:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253378048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270313.994123:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253378048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270313.994130:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 258 00000100:00100000:0.0:1788270314.181290:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788270314.181353:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262764672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270314.181809:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270314.182193:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764672 00000100:00100000:0.0:1788270314.182269:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764672 00000100:00100000:0.0:1788270314.182328:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788270314.182338:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262764672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270314.182369:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270314.182446:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262764672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270314.182454:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1788270314.182497:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270314.182577:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27fb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262764672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270314.185684:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262764800:0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.186141:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262764928:0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.186175:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270314.186212:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270314.186216:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262765440:0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.186237:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270314.186261:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262765952:0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.186285:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270314.186698:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764928 00000100:00100000:0.0:1788270314.186708:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764928 00000100:00100000:0.0:1788270314.186769:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765440 00000100:00100000:0.0:1788270314.186772:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765440 00000100:00100000:0.0:1788270314.186795:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788270314.186804:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262764928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.186868:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262764928:12345-0@lo:400:kworker.0 Request processed in 64us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270314.186875:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788270314.186891:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788270314.186897:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262765440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.186924:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262765440:12345-0@lo:400:kworker.0 Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270314.186930:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:0.0:1788270314.186953:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270314.187014:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270314.187033:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765952 00000100:00100000:0.0:1788270314.187058:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765952 00000100:00100000:0.0:1788270314.187090:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1788270314.187096:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262765952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.187191:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262765952:12345-0@lo:400:kworker.0 Request processed in 95us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270314.187198:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00080000:0.0:1788270314.187217:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270314.187229:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262765056:0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.187254:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270314.187277:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765056 00000100:00100000:0.0:1788270314.187280:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765056 00000100:00100000:0.0:1788270314.187302:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1788270314.187307:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262765056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.187338:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262765056:12345-0@lo:400:kworker.0 Request processed in 30us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270314.187343:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1788270314.187374:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262765184:0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.187400:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270314.187422:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765184 00000100:00100000:0.0:1788270314.187425:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765184 00000100:00100000:2.0:1788270314.188847:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262764800 00000100:00100000:2.0:1788270314.188854:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262764800 00000100:00100000:2.0:1788270314.188889:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788270314.188899:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262764800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.188945:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262764800:12345-0@lo:400:kworker.0 Request processed in 49us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270314.188950:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788270314.189183:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788270314.189190:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262765184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270314.189216:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262765184:12345-0@lo:400:kworker.0 Request processed in 28us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270314.189220:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788270314.190358:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262764800:0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.190400:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262765312:0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.190482:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270314.191232:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262765952:0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.191280:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765312 00000100:00100000:2.0:1788270314.191287:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765312 00000100:00100000:2.0:1788270314.191344:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788270314.191347:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262764928:0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.191357:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262765312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.191407:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262765312:12345-0@lo:400:kworker.0 Request processed in 54us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270314.191409:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262765440:0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.191417:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:2.0:1788270314.191437:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270314.191480:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270314.191488:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262766336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270314.191556:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270314.191611:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766336 00000100:00100000:2.0:1788270314.191615:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766336 00000100:00100000:2.0:1788270314.191640:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788270314.191646:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262766336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270314.191667:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270314.191698:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262766336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270314.191704:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788270314.191828:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262766336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270314.192021:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262765056:0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.192108:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262765568:0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.192155:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270314.192176:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262766080:0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.192197:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270314.192220:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270314.192227:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262766208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270314.192249:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270314.192333:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765568 00000100:00100000:1.0:1788270314.192337:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765568 00000100:00100000:2.0:1788270314.192350:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262765312:0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.192370:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766080 00000100:00100000:2.0:1788270314.192371:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262765824:0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.192374:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766080 00000100:00100000:1.0:1788270314.192425:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1788270314.192432:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262765568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.192440:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270314.192487:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765824 00000100:00100000:2.0:1788270314.192511:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765824 00000100:00100000:3.0:1788270314.192568:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766208 00000100:00100000:3.0:1788270314.192572:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766208 00000100:00100000:3.0:1788270314.192600:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788270314.192607:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262766208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270314.192619:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270314.192685:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262765568:12345-0@lo:400:kworker.0 Request processed in 252us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270314.192692:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1788270314.192709:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1788270314.192726:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262766080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.192742:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262766208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270314.192769:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788270314.192882:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262766208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270314.192908:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262766080:12345-0@lo:400:kworker.0 Request processed in 182us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270314.192909:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262765568:0@lo:400:kworker.0 00000100:00100000:3.0:1788270314.192938:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262766080:0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.193250:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1788270314.193272:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.193334:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262765824:12345-0@lo:400:kworker.0 Request processed in 64us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270314.193341:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00080000:1.0:1788270314.193394:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270314.193489:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262765184:0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.193498:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262765696:0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.193525:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270314.193556:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262765696 00000100:00100000:1.0:1788270314.193577:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262765696 00000100:00100000:1.0:1788270314.193638:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1788270314.193644:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262765696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270314.193706:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262765696:12345-0@lo:400:kworker.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270314.193723:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00080000:1.0:1788270314.193751:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270314.193783:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262765696:0@lo:400:kworker.0 00000100:00100000:2.0:1788270314.196328:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1788270314.196567:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262765824:0@lo:400:kworker.0 00000040:00080000:3.0:1788270314.923378:0:56215:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270314.923387:0:56215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270314.924749:0:56215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270314.924761:0:56215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270314.953943:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270315.974722:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270316.228784:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270316.228816:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262766464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270316.228884:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270316.229123:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766464 00000100:00100000:0.0:1788270316.229131:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766464 00000100:00100000:0.0:1788270316.229200:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788270316.229210:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262766464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270316.229239:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270316.229284:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262766464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270316.229292:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1788270316.229403:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270316.229441:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262766464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270316.745220:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270316.745243:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262766592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270316.745319:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270316.745363:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766592 00000100:00100000:1.0:1788270316.745373:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766592 00000100:00100000:1.0:1788270316.745436:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788270316.745447:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262766592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270316.745480:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270316.745539:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262766592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270316.745546:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788270316.745720:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262766592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270316.996193:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270317.003593:0:56266:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270317.003615:0:56266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270317.004674:0:56266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270317.004686:0:56266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270318.022197:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270318.803901:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270318.803925:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262766720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270318.803995:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270318.804079:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766720 00000100:00100000:1.0:1788270318.804087:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766720 00000100:00100000:1.0:1788270318.804499:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788270318.804509:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262766720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270318.804542:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270318.805158:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262766720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 649us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270318.805166:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788270318.808348:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262766720:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788270318.864726:0:56318:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270318.864733:0:56318:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270318.865873:0:56318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270318.865883:0:56318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270319.046936:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270319.264885:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270319.264943:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270319.264981:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270319.265279:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253378944 00000100:00100000:1.0:1788270319.265289:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253378944 00000100:00100000:1.0:1788270319.265344:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 260 00000100:00100000:1.0:1788270319.265355:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253378944:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270319.265421:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253378944:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270319.265429:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 260 00000100:00100000:2.0:1788270319.265952:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379200 00000100:00100000:2.0:1788270319.265958:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379200 00000100:00100000:2.0:1788270319.266028:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 524 00000100:00100000:2.0:1788270319.266067:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253379200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270319.266112:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253379200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270319.266120:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 524 00000100:00080000:2.0:1788270319.266138:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270319.266719:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270319.267371:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379456 00000100:00100000:3.0:1788270319.267378:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379456 00000100:00100000:3.0:1788270319.267441:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:3.0:1788270319.267449:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253379456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270319.267493:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253379456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (2512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.267500:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 256 00000100:00100000:0.0:1788270319.267872:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379712 00000100:00100000:0.0:1788270319.267877:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379712 00000100:00100000:0.0:1788270319.267915:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 525 00000100:00100000:0.0:1788270319.267923:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253379712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270319.267954:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253379712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270319.267961:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 525 00000100:00100000:1.0:1788270319.268363:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00080000:2.0:1788270319.268440:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788270319.268446:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270319.268616:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270319.268655:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270319.268707:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379328 00000100:00100000:2.0:1788270319.268711:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379328 00000100:00100000:2.0:1788270319.268783:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 257 00000100:00100000:2.0:1788270319.268793:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253379328:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270319.268831:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253379328:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270319.268837:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 257 00000100:00080000:2.0:1788270319.268855:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270319.285549:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379072 00000100:00100000:3.0:1788270319.285565:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379072 00000100:00100000:3.0:1788270319.285646:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379584 00000100:00100000:3.0:1788270319.285650:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379584 00000100:00100000:3.0:1788270319.285679:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 526 00000100:00100000:3.0:1788270319.285688:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253379072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270319.285892:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 527 00000100:00100000:1.0:1788270319.285902:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253379584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270319.285961:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253379072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 274us (17598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.285969:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 526 00000100:00080000:0.0:1788270319.288365:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270319.289280:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253379584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3372us (20616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270319.289296:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 527 00000100:00100000:3.0:1788270319.300521:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262766848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270319.300595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788270319.300758:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788270319.300764:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270319.301524:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:3.0:1788270319.301535:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788270319.301611:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766848 00000100:00100000:3.0:1788270319.301619:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766848 00000100:00100000:3.0:1788270319.301676:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788270319.301686:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262766848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270319.301717:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00080000:0.0:1788270319.302177:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270319.302189:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270319.302202:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262766976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270319.302544:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262767232:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304395:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262767360:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304427:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304452:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262767872:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304472:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304490:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262768384:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304515:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304534:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788270319.304540:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262767488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304564:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304579:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262768000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304602:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304621:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262768512:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304641:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304676:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1448f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262767104:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.304705:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.304728:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262767616:0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.304902:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262766976 00000100:00100000:3.0:1788270319.304910:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262766976 00000100:00100000:3.0:1788270319.304960:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788270319.304969:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262766976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788270319.304990:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:3.0:1788270319.305158:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262766976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 189us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.305165:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788270319.305188:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768384 00000100:00100000:3.0:1788270319.305191:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768384 00000100:00100000:3.0:1788270319.305214:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767488 00000100:00100000:3.0:1788270319.305217:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767488 00000100:00100000:3.0:1788270319.305296:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768000 00000100:00100000:3.0:1788270319.305299:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768000 00000100:00100000:3.0:1788270319.305312:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768512 00000100:00100000:3.0:1788270319.305314:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768512 00000100:00100000:3.0:1788270319.305327:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1788270319.305333:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262768384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.305362:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262768384:12345-0@lo:400:kworker.0 Request processed in 30us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.305371:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1788270319.305382:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1788270319.305388:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262767488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.305412:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262767488:12345-0@lo:400:kworker.0 Request processed in 25us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.305418:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1788270319.305427:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1788270319.305432:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262768000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.305452:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262768000:12345-0@lo:400:kworker.0 Request processed in 20us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.305457:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1788270319.305466:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1788270319.305471:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262768512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.305491:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262768512:12345-0@lo:400:kworker.0 Request processed in 20us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.305496:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1788270319.305525:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767104 00000100:00100000:3.0:1788270319.305528:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767104 00000100:00100000:3.0:1788270319.305549:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788270319.305554:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262767104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.305579:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262767104:12345-0@lo:400:kworker.0 Request processed in 24us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.305584:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788270319.306346:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.306392:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262768128:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.306423:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.306443:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262768640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270319.306466:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270319.306504:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1448f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262767104:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.306534:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767360 00000100:00100000:0.0:1788270319.306539:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767360 00000100:00100000:0.0:1788270319.306572:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767872 00000100:00100000:0.0:1788270319.306576:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767872 00000100:00100000:0.0:1788270319.306600:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788270319.306608:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262767360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.306643:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262767360:12345-0@lo:400:kworker.0 Request processed in 37us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270319.306650:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788270319.306663:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788270319.306670:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262767872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.306699:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262767872:12345-0@lo:400:kworker.0 Request processed in 30us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270319.306705:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788270319.306729:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768128 00000100:00100000:0.0:1788270319.306733:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768128 00000100:00100000:2.0:1788270319.307164:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262766848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5467us (6556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270319.307172:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788270319.307196:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768640 00000100:00100000:2.0:1788270319.307200:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768640 00000100:00100000:2.0:1788270319.307218:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788270319.307224:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262768640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270319.307257:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270319.307295:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262768640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270319.307302:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788270319.307337:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262768640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270319.307831:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270319.307865:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262767744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.307889:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270319.307904:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262768256:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.307930:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270319.307972:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768256 00000100:00100000:1.0:1788270319.307976:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768256 00000100:00100000:1.0:1788270319.308169:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1788270319.308178:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262768256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308215:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262768256:12345-0@lo:400:kworker.0 Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270319.308221:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1788270319.308316:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262768256:0@lo:400:kworker.0 00000100:00080000:1.0:1788270319.308360:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270319.308364:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270319.308366:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270319.308369:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270319.308395:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262767488:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308406:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262768000:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308416:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262768512:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308426:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262767360:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308438:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262767872:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308448:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262768384:0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308462:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262766976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270319.308475:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262766848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270319.308521:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767744 00000100:00100000:1.0:1788270319.308524:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767744 00000100:00100000:1.0:1788270319.308552:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788270319.308557:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270319.308590:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262767744:12345-0@lo:400:kworker.0 Request processed in 32us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270319.308596:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:1.0:1788270319.308608:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270319.308621:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262767744:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.308721:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1788270319.308730:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262768128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.309127:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262768128:12345-0@lo:400:kworker.0 Request processed in 397us (2701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270319.309135:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1788270319.309165:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262768128:0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.309257:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767616 00000100:00100000:3.0:1788270319.309262:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767616 00000100:00100000:3.0:1788270319.309300:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262767232 00000100:00100000:3.0:1788270319.309304:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262767232 00000100:00100000:3.0:1788270319.309320:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788270319.309326:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.309364:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262767616:12345-0@lo:400:kworker.0 Request processed in 38us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.309370:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788270319.309382:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788270319.309388:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262767232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270319.309418:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262767232:12345-0@lo:400:kworker.0 Request processed in 30us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270319.309423:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788270319.309447:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262767232:0@lo:400:kworker.0 00000100:00100000:0.0:1788270319.310020:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262767616:0@lo:400:kworker.0 00000040:00080000:2.0:1788270320.068211:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270320.068231:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270320.068971:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270320.068984:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270320.069114:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270320.977580:0:56369:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270320.977589:0:56369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270320.978399:0:56369:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270320.978409:0:56369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270321.092920:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270321.350780:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270321.350804:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262768768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270321.350883:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270321.350989:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768768 00000100:00100000:3.0:1788270321.350998:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768768 00000100:00100000:3.0:1788270321.351106:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788270321.351118:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262768768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788270321.351159:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270321.351211:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262768768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270321.351220:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788270321.351571:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262768768:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788270321.351653:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270321.861591:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270321.861618:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262768896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270321.861735:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270321.861956:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262768896 00000100:00100000:3.0:1788270321.861966:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262768896 00000100:00100000:3.0:1788270321.862020:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788270321.862030:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262768896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270321.862099:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270321.862258:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262768896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 229us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270321.862266:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788270321.866694:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262768896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270322.123522:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270322.687841:0:56420:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270322.687850:0:56420:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270322.689313:0:56420:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270322.689330:0:56420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270323.140321:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270323.909962:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270323.911977:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262769024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270323.912845:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270323.913324:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769024 00000100:00100000:2.0:1788270323.913336:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769024 00000100:00100000:2.0:1788270323.913437:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788270323.913449:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262769024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270323.913507:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270323.913610:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262769024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270323.913618:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788270323.913863:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262769024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270324.164803:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270324.230419:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270324.230490:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270324.231215:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379840 00000100:00100000:1.0:1788270324.231234:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379840 00000100:00100000:1.0:1788270324.231328:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 262 00000100:00100000:1.0:1788270324.231341:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253379840:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270324.231444:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253379840:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 105us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270324.231453:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 262 00000100:00100000:3.0:1788270324.231616:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253379968 00000100:00100000:3.0:1788270324.231621:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253379968 00000100:00100000:3.0:1788270324.231691:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 534 00000100:00100000:3.0:1788270324.231701:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253379968:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270324.231751:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253379968:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 52us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270324.231758:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 534 00000100:00080000:1.0:1788270324.231862:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270324.233483:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270324.233533:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270324.233611:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380096 00000100:00100000:3.0:1788270324.233619:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380096 00000100:00100000:3.0:1788270324.233704:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 535 00000100:00100000:3.0:1788270324.233714:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253380096:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270324.233792:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253380096:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270324.233800:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 535 00000100:00080000:1.0:1788270324.233899:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270324.234367:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380224 00000100:00100000:0.0:1788270324.234373:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380224 00000100:00100000:0.0:1788270324.234433:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 261 00000100:00100000:0.0:1788270324.234443:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253380224:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270324.234495:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253380224:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 54us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.234502:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 261 00000100:00080000:1.0:1788270324.234561:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270324.237520:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270324.237569:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270324.237605:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270324.237701:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380480 00000100:00100000:3.0:1788270324.237713:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380480 00000100:00100000:3.0:1788270324.237790:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380608 00000100:00100000:3.0:1788270324.237793:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380608 00000100:00100000:3.0:1788270324.237817:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 536 00000100:00100000:3.0:1788270324.237827:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253380480:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270324.237912:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253380480:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270324.237924:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 536 00000100:00100000:3.0:1788270324.237943:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 537 00000100:00100000:3.0:1788270324.237949:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253380608:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270324.237975:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253380608:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270324.237981:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 537 00000100:00080000:1.0:1788270324.238112:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270324.238118:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270324.238221:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380352 00000100:00100000:2.0:1788270324.238226:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380352 00000100:00100000:2.0:1788270324.238285:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 262 00000100:00100000:2.0:1788270324.238294:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253380352:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270324.238322:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253380352:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270324.238328:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 262 00000100:00080000:1.0:1788270324.238645:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270324.420533:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262769152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270324.420607:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.420674:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262769664:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.420702:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.420720:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262770176:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.420741:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.420765:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262770688:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.420788:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.420812:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788270324.420818:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262769280:0@lo:400:kworker.0 00000100:00100000:3.0:1788270324.421020:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770688 00000100:00100000:3.0:1788270324.421028:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770688 00000100:00100000:3.0:1788270324.421119:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1788270324.421129:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262770688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.421396:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262769536:0@lo:400:kworker.0 00000100:00080000:3.0:1788270324.426747:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270324.426826:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262770688:12345-0@lo:400:kworker.0 Request processed in 5695us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270324.426837:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1788270324.432911:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.433213:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262769792:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.433269:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.433493:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262770304:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.433514:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270324.433574:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270324.433594:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262770048:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433611:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270324.433623:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262770560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433644:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262769408:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433678:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270324.433694:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262769920:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433710:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270324.433724:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262770432:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433777:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769664 00000100:00100000:0.0:1788270324.433784:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769664 00000100:00100000:0.0:1788270324.433833:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770176 00000100:00100000:0.0:1788270324.433836:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770176 00000100:00100000:0.0:1788270324.433847:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769536 00000100:00100000:0.0:1788270324.433849:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769536 00000100:00100000:0.0:1788270324.433859:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770048 00000100:00100000:0.0:1788270324.433861:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770048 00000100:00100000:0.0:1788270324.433872:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788270324.433879:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262769664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433924:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262769664:12345-0@lo:400:kworker.0 Request processed in 45us (13222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.433930:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788270324.433944:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788270324.433948:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262770176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.433967:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262770176:12345-0@lo:400:kworker.0 Request processed in 19us (13226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.433972:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788270324.433979:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788270324.433984:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262769536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.434004:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262769536:12345-0@lo:400:kworker.0 Request processed in 20us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.434009:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788270324.434016:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788270324.434020:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262770048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.434052:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262770048:12345-0@lo:400:kworker.0 Request processed in 17us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.434058:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788270324.434074:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769408 00000100:00100000:0.0:1788270324.434077:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769408 00000100:00100000:0.0:1788270324.434095:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769920 00000100:00100000:0.0:1788270324.434097:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769920 00000100:00100000:0.0:1788270324.434105:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788270324.434110:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262769408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.434138:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262769408:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.434142:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788270324.434151:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788270324.434156:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262769920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.434179:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262769920:12345-0@lo:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.434184:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1788270324.434201:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270324.434205:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270324.434243:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769152 00000100:00100000:0.0:1788270324.434246:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769152 00000100:00100000:0.0:1788270324.434266:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788270324.434271:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262769152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270324.434291:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270324.434318:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262769152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (13712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270324.434323:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788270324.442339:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769280 00000100:00100000:2.0:1788270324.442350:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769280 00000100:00100000:2.0:1788270324.442407:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788270324.442415:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262769280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270324.442492:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262769280:12345-0@lo:400:kworker.0 Request processed in 78us (9588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270324.442499:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788270324.444144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270324.444194:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262769792 00000100:00100000:3.0:1788270324.444202:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262769792 00000100:00100000:2.0:1788270324.444279:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770304 00000100:00100000:2.0:1788270324.444284:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770304 00000100:00100000:2.0:1788270324.444311:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1788270324.444318:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262769792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270324.444372:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262769792:12345-0@lo:400:kworker.0 Request processed in 55us (11102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270324.444377:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1788270324.444390:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1788270324.444395:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262770304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270324.444414:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262770304:12345-0@lo:400:kworker.0 Request processed in 19us (10899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270324.444418:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1788270324.453611:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262770304:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.453625:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262770816:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.454753:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262770944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270324.454809:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.454847:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262769408:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.454859:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262769920:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.454873:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270324.454879:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262771072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270324.454898:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.454933:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770432 00000100:00100000:1.0:1788270324.454939:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770432 00000100:00100000:1.0:1788270324.454994:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1788270324.455001:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262770432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.455056:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262770432:12345-0@lo:400:kworker.0 Request processed in 55us (10915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270324.455062:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1788270324.455082:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270324.455109:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262769536:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.455118:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262770048:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.455135:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770944 00000100:00100000:1.0:1788270324.455137:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770944 00000100:00100000:1.0:1788270324.455155:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771072 00000100:00100000:1.0:1788270324.455157:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771072 00000100:00100000:1.0:1788270324.455169:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788270324.455175:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262770944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270324.455192:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270324.455222:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262770944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270324.455229:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788270324.455240:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788270324.455245:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262771072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270324.455260:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270324.455282:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262771072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270324.455288:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:1.0:1788270324.455310:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270324.455330:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262771072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270324.455339:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262770432:0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.455348:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262770944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270324.455368:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770560 00000100:00100000:1.0:1788270324.455371:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770560 00000100:00080000:1.0:1788270324.455382:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270324.455401:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1788270324.455406:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262770560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270324.455433:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262770560:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270324.455438:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1788270324.455457:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262770560:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.455683:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270324.455772:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262769152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270324.455783:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262769664:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.455791:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262770176:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.455811:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262770688:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.455831:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262769280:0@lo:400:kworker.0 00000100:00100000:0.0:1788270324.455841:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262769792:0@lo:400:kworker.0 00000100:00100000:3.0:1788270324.464182:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262770816 00000100:00100000:3.0:1788270324.464197:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262770816 00000100:00100000:3.0:1788270324.464281:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1788270324.464291:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262770816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270324.464375:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262770816:12345-0@lo:400:kworker.0 Request processed in 86us (8692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270324.464382:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1788270324.464431:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262770816:0@lo:400:kworker.0 00000100:00080000:0.0:1788270324.464487:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788270324.696368:0:56471:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270324.696378:0:56471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270324.696904:0:56471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270324.696913:0:56471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270325.188361:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270326.214715:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270326.486329:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262771200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270326.486433:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270326.491834:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771200 00000100:00100000:0.0:1788270326.491850:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771200 00000100:00100000:0.0:1788270326.491926:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788270326.491938:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262771200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270326.491990:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270326.498357:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262771200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6408us (11910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270326.498377:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1788270326.498438:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270326.503403:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262771200:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788270326.973893:0:56523:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270326.973906:0:56523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270326.975582:0:56523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270326.975606:0:56523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270326.981202:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270326.981233:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262771328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270326.981326:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270326.981529:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771328 00000100:00100000:2.0:1788270326.981539:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771328 00000100:00100000:2.0:1788270326.981668:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788270326.981681:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262771328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270326.981725:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270326.981784:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262771328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270326.981794:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788270326.981950:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15342f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262771328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270327.240062:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270328.261837:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270329.028314:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14ad95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262771456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270329.028421:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270329.028534:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771456 00000100:00100000:0.0:1788270329.028543:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771456 00000100:00100000:0.0:1788270329.028739:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788270329.028750:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262771456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270329.028794:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270329.028850:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262771456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270329.028858:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788270329.028919:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14ad95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262771456:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788270329.280415:0:56574:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270329.280427:0:56574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270329.281173:0:56574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270329.281185:0:56574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270329.285306:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270329.347533:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270329.347730:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270329.347767:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270329.347805:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270329.347838:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381248 00000100:00100000:3.0:1788270329.347852:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381248 00000100:00100000:3.0:1788270329.348131:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:3.0:1788270329.348146:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253381248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270329.348607:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253381248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 461us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270329.348618:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:3.0:1788270329.348657:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380992 00000100:00100000:3.0:1788270329.348663:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380992 00000100:00100000:3.0:1788270329.348698:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381504 00000100:00100000:3.0:1788270329.348702:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381504 00000100:00100000:3.0:1788270329.348729:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 544 00000100:00100000:3.0:1788270329.348737:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253380992:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270329.348773:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253380992:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 38us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270329.348785:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 544 00000100:00100000:3.0:1788270329.348799:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 545 00000100:00100000:3.0:1788270329.348806:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253381504:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270329.348834:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253381504:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270329.348841:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 545 00000100:00080000:3.0:1788270329.348858:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270329.348863:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270329.377717:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380736 00000100:00100000:2.0:1788270329.377738:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380736 00000100:00100000:2.0:1788270329.377993:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:2.0:1788270329.378007:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253380736:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270329.378128:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253380736:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 124us (30611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270329.378137:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:2.0:1788270329.378231:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270329.378816:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270329.378850:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270329.378879:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253380864 00000100:00100000:2.0:1788270329.378886:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253380864 00000100:00100000:2.0:1788270329.379092:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381376 00000100:00100000:2.0:1788270329.379096:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381376 00000100:00100000:2.0:1788270329.379120:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 546 00000100:00100000:2.0:1788270329.379128:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15342f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253380864:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270329.379188:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15342f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253380864:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 61us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270329.379195:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 546 00000100:00100000:2.0:1788270329.379210:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 547 00000100:00100000:2.0:1788270329.379216:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253381376:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270329.379243:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253381376:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270329.379248:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 547 00000100:00080000:2.0:1788270329.379266:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270329.385131:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381120 00000100:00100000:1.0:1788270329.385155:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381120 00000100:00100000:1.0:1788270329.385251:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00100000:1.0:1788270329.385265:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1530c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253381120:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270329.385368:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1530c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253381120:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 107us (6554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270329.385398:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00080000:1.0:1788270329.385638:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788270329.543701:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788270329.543717:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270329.544289:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:2.0:1788270329.544307:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788270330.156602:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262771840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270330.156704:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.156770:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262772352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.156800:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.156823:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262772864:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.156846:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.156868:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262773376:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.157368:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262771584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270330.157407:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.157518:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262772096:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.157546:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.157588:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262772608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.157612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.157631:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262773120:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.157665:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262771968:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.157699:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.157723:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262772480:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.157798:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772352 00000100:00100000:0.0:1788270330.157808:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772352 00000100:00100000:0.0:1788270330.157883:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772864 00000100:00100000:0.0:1788270330.157887:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772864 00000100:00100000:1.0:1788270330.157993:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.158051:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788270330.158060:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262771712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270330.158088:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.158108:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262772224:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.158132:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.158150:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262772736:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.158175:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.158267:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262773248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.158294:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270330.158327:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771840 00000100:00100000:1.0:1788270330.158332:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771840 00000100:00100000:1.0:1788270330.158361:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771584 00000100:00100000:1.0:1788270330.158364:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771584 00000100:00100000:1.0:1788270330.158516:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771712 00000100:00100000:1.0:1788270330.158519:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771712 00000100:00100000:1.0:1788270330.158536:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788270330.158546:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262771840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270330.158598:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270330.158654:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262771840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270330.158663:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788270330.158686:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270330.158692:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262771584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270330.158713:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270330.158745:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1875136262771584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270330.158752:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788270330.158763:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788270330.158770:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262771712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270330.158780:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270330.158805:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262771712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270330.158812:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788270330.158831:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772224 00000100:00100000:1.0:1788270330.158835:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772224 00000100:00100000:1.0:1788270330.158851:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772736 00000100:00100000:1.0:1788270330.158854:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772736 00000100:00100000:1.0:1788270330.158868:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788270330.158874:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262772352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.158970:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788270330.158980:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262772864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159079:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262772864:12345-0@lo:400:kworker.0 Request processed in 101us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.159086:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788270330.159105:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788270330.159111:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262772224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159142:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262772224:12345-0@lo:400:kworker.0 Request processed in 32us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.159149:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788270330.159160:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788270330.159166:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262772736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159210:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262772736:12345-0@lo:400:kworker.0 Request processed in 44us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.159217:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788270330.159246:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772096 00000100:00100000:0.0:1788270330.159251:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772096 00000100:00100000:0.0:1788270330.159281:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772608 00000100:00100000:0.0:1788270330.159284:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772608 00000100:00100000:0.0:1788270330.159300:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788270330.159306:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262772096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159343:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14ad95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262772096:12345-0@lo:400:kworker.0 Request processed in 37us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.159350:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788270330.159362:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788270330.159368:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262772608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159397:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262772608:12345-0@lo:400:kworker.0 Request processed in 30us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.159403:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788270330.159551:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262771968 00000100:00100000:0.0:1788270330.159566:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262771968 00000100:00100000:0.0:1788270330.159602:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788270330.159610:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262771968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159647:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262771968:12345-0@lo:400:kworker.0 Request processed in 38us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.159653:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788270330.159691:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270330.159696:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270330.159714:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.159751:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262772992:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159781:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.159801:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262773504:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.159874:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262771968:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.159982:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270330.160034:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262771584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270330.160086:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262772096:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160098:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262772608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160141:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773376 00000100:00100000:0.0:1788270330.160146:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773376 00000100:00100000:0.0:1788270330.160256:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773248 00000100:00100000:0.0:1788270330.160260:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773248 00000100:00100000:0.0:1788270330.160276:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772480 00000100:00100000:0.0:1788270330.160279:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772480 00000100:00100000:0.0:1788270330.160290:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262772992 00000100:00100000:0.0:1788270330.160292:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262772992 00000100:00100000:0.0:1788270330.160302:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1788270330.160309:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262773376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160350:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262773376:12345-0@lo:400:kworker.0 Request processed in 42us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.160357:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1788270330.160369:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773504 00000100:00100000:0.0:1788270330.160373:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773504 00000100:00100000:0.0:1788270330.160388:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773120 00000100:00100000:0.0:1788270330.160390:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773120 00000100:00100000:0.0:1788270330.160405:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1788270330.160410:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262773248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160780:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262773248:12345-0@lo:400:kworker.0 Request processed in 368us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.160788:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1788270330.160802:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1788270330.160808:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262772480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160841:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262772480:12345-0@lo:400:kworker.0 Request processed in 34us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.160847:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1788270330.160856:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1788270330.160860:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262772992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160882:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262772992:12345-0@lo:400:kworker.0 Request processed in 22us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.160887:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1788270330.160962:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1788270330.160969:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262773504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.160996:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262773504:12345-0@lo:400:kworker.0 Request processed in 29us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.161001:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1788270330.161012:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1788270330.161016:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262773120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.161067:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c265e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262773120:12345-0@lo:400:kworker.0 Request processed in 51us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270330.161073:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00080000:0.0:1788270330.161102:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270330.161106:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270330.161129:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262772480:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.161140:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262772992:0@lo:400:kworker.0 00000100:00100000:0.0:1788270330.161150:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262773504:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161302:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262772352:12345-0@lo:400:kworker.0 Request processed in 2425us (4499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270330.161311:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788270330.161363:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262771712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270330.161379:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262772224:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161392:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262772736:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161405:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262773248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161420:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262771840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270330.161508:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262773120:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161788:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262772352:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161802:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262772864:0@lo:400:kworker.0 00000100:00100000:1.0:1788270330.161815:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262773376:0@lo:400:kworker.0 00000040:00080000:3.0:1788270330.308393:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270330.308409:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270330.308954:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270330.308966:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270330.309629:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270331.335273:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270331.459757:0:56625:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270331.459768:0:56625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270331.461456:0:56625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270331.461475:0:56625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788270331.589192:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270331.589224:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262773632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270331.589320:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270331.589381:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773632 00000100:00100000:2.0:1788270331.589391:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773632 00000100:00100000:2.0:1788270331.589453:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788270331.589464:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262773632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270331.589504:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270331.589572:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262773632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270331.589583:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788270331.589640:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262773632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270332.100428:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262773760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270332.100558:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270332.100957:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773760 00000100:00100000:2.0:1788270332.100969:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773760 00000100:00100000:2.0:1788270332.101073:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788270332.101086:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262773760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270332.101135:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270332.101221:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262773760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270332.101229:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788270332.101356:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262773760:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270332.356318:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270333.384203:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270333.801315:0:56677:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270333.801324:0:56677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270333.803319:0:56677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270333.803338:0:56677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270334.148309:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788270334.148337:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262773888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270334.148409:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270334.148725:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262773888 00000100:00100000:0.0:1788270334.148734:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262773888 00000100:00100000:0.0:1788270334.148788:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788270334.148797:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262773888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270334.148834:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270334.148900:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262773888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270334.148908:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788270334.149292:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262773888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788270334.405167:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270334.470031:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270334.470213:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381632 00000100:00100000:3.0:1788270334.470225:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381632 00000100:00100000:2.0:1788270334.470241:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270334.470279:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:3.0:1788270334.470289:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253381632:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270334.470369:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253381632:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270334.470378:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:2.0:1788270334.470681:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270334.470790:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270334.470851:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382144 00000100:00100000:3.0:1788270334.470857:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382144 00000100:00100000:3.0:1788270334.470908:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 273 00000100:00100000:3.0:1788270334.470915:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253382144:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270334.470955:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2400:x1875136253382144:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 41us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270334.470961:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 273 00000100:00080000:3.0:1788270334.470991:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270334.475592:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270334.475742:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381888 00000100:00100000:1.0:1788270334.475753:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381888 00000100:00100000:1.0:1788270334.475830:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382400 00000100:00100000:1.0:1788270334.475834:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382400 00000100:00100000:1.0:1788270334.475905:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 554 00000100:00100000:1.0:1788270334.476659:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253381888:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270334.476741:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2400:x1875136253381888:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (6500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270334.476750:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 554 00000100:00100000:1.0:1788270334.476776:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 555 00000100:00100000:1.0:1788270334.476782:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253382400:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270334.476811:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253382400:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (6042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270334.476816:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 555 00000100:00080000:3.0:1788270334.476924:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270334.477572:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270334.477630:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270334.477791:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382016 00000100:00100000:3.0:1788270334.477799:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382016 00000100:00100000:3.0:1788270334.477911:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:3.0:1788270334.477950:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253382016:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270334.478094:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2400:x1875136253382016:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 147us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270334.478138:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:1.0:1788270334.478399:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253381760 00000100:00100000:1.0:1788270334.478404:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253381760 00000100:00100000:1.0:1788270334.478446:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382272 00000100:00100000:1.0:1788270334.478450:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382272 00000100:00100000:1.0:1788270334.478489:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 556 00000100:00100000:1.0:1788270334.478506:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253381760:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270334.478542:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2400:x1875136253381760:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 38us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270334.478549:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 556 00000100:00100000:1.0:1788270334.478563:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 557 00000100:00100000:1.0:1788270334.478570:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253382272:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270334.478595:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2400:x1875136253382272:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270334.478601:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 557 00000100:00080000:2.0:1788270334.481571:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270334.481583:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270335.172211:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270335.172235:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262774016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270335.172309:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270335.172374:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774016 00000100:00100000:1.0:1788270335.172381:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774016 00000100:00100000:1.0:1788270335.172434:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788270335.172444:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262774016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270335.172511:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270335.172558:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262774016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.172565:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788270335.172608:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262774016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270335.173226:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262774144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270335.173261:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270335.174573:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262774272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270335.174643:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270335.177782:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774144 00000100:00100000:1.0:1788270335.177797:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774144 00000100:00100000:1.0:1788270335.177842:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774272 00000100:00100000:1.0:1788270335.177845:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774272 00000100:00100000:1.0:1788270335.177865:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788270335.177875:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262774144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270335.177909:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270335.180228:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262774144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2344us (6956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.180244:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788270335.180283:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788270335.180295:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262774272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270335.180319:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00080000:2.0:1788270335.180450:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270335.180456:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270335.183762:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262774272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3456us (9104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.183782:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788270335.183848:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262774400:0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.183923:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270335.184059:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262774144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270335.184353:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774400 00000100:00100000:3.0:1788270335.184361:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774400 00000100:00100000:3.0:1788270335.184414:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788270335.184423:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262774400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270335.184487:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262774400:12345-0@lo:400:kworker.0 Request processed in 65us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270335.184497:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788270335.184842:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262774400:0@lo:400:kworker.0 00000100:00100000:0.0:1788270335.184929:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c276267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262774272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270335.185354:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262774528:0@lo:400:kworker.0 00000100:00100000:0.0:1788270335.185398:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270335.185486:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774528 00000100:00100000:1.0:1788270335.185493:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774528 00000100:00100000:1.0:1788270335.185541:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788270335.185549:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262774528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.185798:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262774528:12345-0@lo:400:kworker.0 Request processed in 249us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.185806:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788270335.185858:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262774656:0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.185891:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270335.185983:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262774784:0@lo:400:kworker.0 00000100:00100000:3.0:1788270335.186015:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270335.186079:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774656 00000100:00100000:1.0:1788270335.186084:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774656 00000100:00100000:1.0:1788270335.186113:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1788270335.186119:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262774656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.186155:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262774656:12345-0@lo:400:kworker.0 Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.186161:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1788270335.186303:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774784 00000100:00100000:2.0:1788270335.186308:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774784 00000100:00100000:2.0:1788270335.186336:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788270335.186342:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262774784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270335.186460:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262774528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.186557:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262774784:12345-0@lo:400:kworker.0 Request processed in 214us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270335.186565:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788270335.186595:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262774656:0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.186655:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262774912:0@lo:400:kworker.0 00000100:00100000:0.0:1788270335.187330:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270335.187426:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262775040:0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.187456:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270335.187504:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775040 00000100:00100000:2.0:1788270335.187509:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775040 00000100:00100000:2.0:1788270335.187542:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1788270335.187549:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262775040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.187587:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262775040:12345-0@lo:400:kworker.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270335.187593:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1788270335.187620:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262775040:0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.187648:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262775168:0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.187848:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262774912 00000100:00100000:1.0:1788270335.187853:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262774912 00000100:00100000:1.0:1788270335.187893:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788270335.187899:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262774912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.187945:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788270335.187989:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270335.188000:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775168 00000100:00100000:2.0:1788270335.188004:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775168 00000100:00100000:2.0:1788270335.188031:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1788270335.188059:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262775168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.188095:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262775168:12345-0@lo:400:kworker.0 Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270335.188102:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00080000:2.0:1788270335.188116:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270335.188134:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262775168:0@lo:400:kworker.0 00000100:00100000:3.0:1788270335.188275:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262774784:0@lo:400:kworker.0 00000100:00100000:3.0:1788270335.188292:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262775296:0@lo:400:kworker.0 00000100:00100000:3.0:1788270335.188319:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270335.188476:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262774912:12345-0@lo:400:kworker.0 Request processed in 568us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.188483:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788270335.188505:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775296 00000100:00100000:1.0:1788270335.188509:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775296 00000100:00100000:1.0:1788270335.188541:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1788270335.188548:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.188583:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262775296:12345-0@lo:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270335.188589:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1788270335.188614:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262775296:0@lo:400:kworker.0 00000100:00080000:2.0:1788270335.196023:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270335.196155:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270335.196179:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262775552:0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.196257:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270335.196314:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775552 00000100:00100000:2.0:1788270335.196321:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775552 00000100:00100000:2.0:1788270335.196377:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1788270335.196386:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.196434:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262775552:12345-0@lo:400:kworker.0 Request processed in 50us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270335.196441:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:2.0:1788270335.196461:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270335.196501:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262775552:0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.196645:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270335.196657:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262775424:0@lo:400:kworker.0 00000100:00100000:1.0:1788270335.196703:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270335.196826:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775424 00000100:00100000:2.0:1788270335.196831:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775424 00000100:00100000:2.0:1788270335.196872:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1788270335.196879:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262775424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270335.196916:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262775424:12345-0@lo:400:kworker.0 Request processed in 38us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270335.196922:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1788270335.196946:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262775424:0@lo:400:kworker.0 00000100:00080000:3.0:1788270335.197032:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270335.204435:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262774912:0@lo:400:kworker.0 00010000:00010000:3.0:1788270335.432200:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270335.673418:0:56728:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270335.673427:0:56728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270335.674027:0:56728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270335.674071:0:56728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270336.452517:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270336.708812:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262775680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270336.708886:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270336.708990:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775680 00000100:00100000:0.0:1788270336.709007:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775680 00000100:00100000:0.0:1788270336.709080:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788270336.709092:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262775680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270336.709123:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270336.709181:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262775680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270336.709189:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788270336.709281:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262775680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270337.222125:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270337.222150:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262775808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788270337.222224:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270337.222318:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775808 00000100:00100000:3.0:1788270337.222327:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775808 00000100:00100000:3.0:1788270337.222385:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788270337.222396:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262775808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270337.222586:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270337.222653:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262775808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 258us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270337.222660:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788270337.222743:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262775808:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270337.483244:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270337.532245:0:56779:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270337.532255:0:56779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270337.532793:0:56779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270337.532804:0:56779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270338.500269:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270339.272510:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262775936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270339.272595:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270339.272762:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262775936 00000100:00100000:2.0:1788270339.272771:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262775936 00000100:00100000:2.0:1788270339.273033:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788270339.273067:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262775936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270339.273103:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270339.273162:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262775936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270339.273169:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788270339.273504:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262775936:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270339.526284:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270339.583558:0:56830:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270339.583567:0:56830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270339.585273:0:56830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270339.585289:0:56830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270339.600503:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600547:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600574:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600596:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600614:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600634:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600658:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270339.600690:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382784 00000100:00100000:0.0:1788270339.600699:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382784 00000100:00100000:0.0:1788270339.600763:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383296 00000100:00100000:0.0:1788270339.600766:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383296 00000100:00100000:0.0:1788270339.600785:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382656 00000100:00100000:0.0:1788270339.600788:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382656 00000100:00100000:0.0:1788270339.600799:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383168 00000100:00100000:0.0:1788270339.600802:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383168 00000100:00100000:0.0:1788270339.600817:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 564 00000100:00100000:0.0:1788270339.600827:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253382784:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270339.600949:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253382784:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 123us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270339.600956:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 564 00000100:00100000:0.0:1788270339.600975:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 565 00000100:00100000:0.0:1788270339.600981:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253383296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270339.601007:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253383296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270339.601013:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 565 00000100:00100000:0.0:1788270339.601028:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 566 00000100:00100000:0.0:1788270339.601034:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253382656:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270339.601085:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253382656:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 51us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270339.601091:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 566 00000100:00100000:0.0:1788270339.601103:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 567 00000100:00100000:0.0:1788270339.601109:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253383168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270339.601133:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253383168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270339.601138:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 567 00000100:00100000:0.0:1788270339.601160:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383040 00000100:00100000:0.0:1788270339.601163:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383040 00000100:00100000:0.0:1788270339.601192:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382912 00000100:00100000:0.0:1788270339.601195:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382912 00000100:00100000:0.0:1788270339.601216:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:0.0:1788270339.601223:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253383040:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270339.601250:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253383040:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270339.601256:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:0.0:1788270339.601267:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:0.0:1788270339.601274:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253382912:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270339.601296:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253382912:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270339.601302:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00080000:0.0:1788270339.601331:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270339.601335:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270339.601338:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270339.601340:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270339.601678:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253382528 00000100:00100000:3.0:1788270339.601684:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253382528 00000100:00100000:3.0:1788270339.601729:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00100000:3.0:1788270339.601737:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253382528:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270339.601770:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253382528:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270339.601777:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 268 00000040:00080000:1.0:1788270339.781579:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270339.781589:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270339.782629:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270339.782644:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788270340.292349:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262776064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270340.292453:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270340.292522:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270340.292529:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262776192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270340.292556:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270340.292591:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776064 00000100:00100000:3.0:1788270340.292599:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776064 00000100:00100000:3.0:1788270340.292650:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776192 00000100:00100000:3.0:1788270340.292653:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776192 00000100:00100000:3.0:1788270340.292670:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788270340.292681:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262776064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270340.292710:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:3.0:1788270340.292753:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262776064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270340.292760:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788270340.292778:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788270340.292784:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262776192:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270340.292966:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270340.292976:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270340.293007:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270340.293059:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776320 00000100:00100000:1.0:1788270340.293063:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776320 00000100:00100000:1.0:1788270340.293087:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788270340.293094:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262776320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270340.293370:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262776448:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293416:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270340.293453:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776448 00000100:00100000:2.0:1788270340.293457:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776448 00000100:00100000:2.0:1788270340.293489:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788270340.293496:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293532:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262776448:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270340.293539:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788270340.293580:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262776448:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293613:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270340.293623:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262776576:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270340.293687:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776576 00000100:00100000:2.0:1788270340.293691:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776576 00000100:00100000:2.0:1788270340.293722:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788270340.293729:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262776576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293768:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262776576:12345-0@lo:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00080000:0.0:1788270340.293771:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270340.293776:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:0.0:1788270340.293777:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270340.293811:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262776064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270340.293823:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262776576:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293885:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262776832:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293912:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270340.293972:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262776960:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.293998:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270340.294080:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262777344:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294107:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270340.294137:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777344 00000100:00100000:2.0:1788270340.294142:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777344 00000100:00100000:2.0:1788270340.294178:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788270340.294185:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262777344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294222:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262777344:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270340.294228:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788270340.294257:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262777344:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294294:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262777472:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294317:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270340.294343:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777472 00000100:00100000:2.0:1788270340.294347:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777472 00000100:00100000:2.0:1788270340.294373:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788270340.294392:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262777472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294426:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262777472:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270340.294432:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788270340.294463:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262777472:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294512:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776832 00000100:00100000:2.0:1788270340.294515:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776832 00000100:00100000:2.0:1788270340.294538:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788270340.294545:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262776832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.294580:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262776832:12345-0@lo:400:kworker.0 Request processed in 35us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270340.294586:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788270340.294613:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262776832:0@lo:400:kworker.0 00000100:00080000:0.0:1788270340.294859:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270340.294862:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788270340.294873:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262776704:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.294903:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270340.294924:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262777216:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.294943:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270340.294961:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788270340.294967:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262777088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.294988:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270340.295005:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262777600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295027:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270340.295068:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776704 00000100:00100000:0.0:1788270340.295073:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776704 00000100:00100000:0.0:1788270340.295098:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777216 00000100:00100000:0.0:1788270340.295102:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777216 00000100:00100000:0.0:1788270340.295138:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777088 00000100:00100000:0.0:1788270340.295141:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777088 00000100:00100000:0.0:1788270340.295151:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777600 00000100:00100000:0.0:1788270340.295154:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777600 00000100:00100000:0.0:1788270340.295170:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1788270340.295176:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295212:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262776704:12345-0@lo:400:kworker.0 Request processed in 36us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270340.295219:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1788270340.295233:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1788270340.295240:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262777216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295264:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1494a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262777216:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270340.295270:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1788270340.295282:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1788270340.295288:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262777088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295312:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262777088:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270340.295318:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1788270340.295330:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00002000:00000024:3.0:1788270340.295333:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270340.295337:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262777600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295364:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1532fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262777600:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270340.295370:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1788270340.295401:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262776192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2614us (2842us total) trans 0 rc 0/0 00000100:00080000:0.0:1788270340.295404:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270340.295409:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788270340.295412:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788270340.295445:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262777088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295456:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262777600:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295465:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262776704:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.295473:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262777216:0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.296256:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262776192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270340.296292:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262776960 00000100:00100000:0.0:1788270340.296298:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262776960 00000100:00100000:0.0:1788270340.296336:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788270340.296343:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262776960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270340.296400:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1451c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262776960:12345-0@lo:400:kworker.0 Request processed in 58us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270340.296408:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00002000:00000024:1.0:1788270340.299966:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270340.300088:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262776320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6990us (7076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270340.300099:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:3.0:1788270340.300400:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270340.300671:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262776960:0@lo:400:kworker.0 00000100:00100000:2.0:1788270340.300696:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262776320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788270340.548538:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270340.548539:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270340.548547:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270340.549224:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270340.549238:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270341.575206:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270341.621345:0:56882:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270341.621366:0:56882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270341.621908:0:56882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270341.621917:0:56882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270341.839236:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270341.839261:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262777728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270341.839338:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270341.839509:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777728 00000100:00100000:0.0:1788270341.839517:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777728 00000100:00100000:0.0:1788270341.839575:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788270341.839584:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262777728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270341.839614:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270341.839657:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262777728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270341.839664:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788270341.839711:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262777728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270342.340439:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262777856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270342.340521:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270342.340878:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777856 00000100:00100000:3.0:1788270342.340887:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777856 00000100:00100000:3.0:1788270342.340961:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788270342.340971:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262777856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270342.341019:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270342.341097:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262777856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270342.341105:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788270342.341225:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262777856:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788270342.596331:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788270343.629669:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270343.637529:0:56933:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270343.637538:0:56933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270343.639448:0:56933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270343.639464:0:56933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270344.389148:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270344.389174:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262777984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270344.389247:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270344.389525:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262777984 00000100:00100000:3.0:1788270344.389534:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262777984 00000100:00100000:3.0:1788270344.392430:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788270344.392453:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262777984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270344.392493:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270344.392587:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262777984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270344.392593:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788270344.392706:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262777984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270344.644245:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270344.718735:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718789:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718828:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718861:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718885:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718904:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718947:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270344.718977:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383680 00000100:00100000:0.0:1788270344.718986:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383680 00000100:00100000:2.0:1788270344.719068:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383936 00000100:00100000:2.0:1788270344.719073:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383936 00000100:00100000:0.0:1788270344.719076:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384192 00000100:00100000:0.0:1788270344.719079:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384192 00000100:00100000:0.0:1788270344.719096:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383552 00000100:00100000:0.0:1788270344.719098:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383552 00000100:00100000:2.0:1788270344.719103:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383808 00000100:00100000:2.0:1788270344.719105:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383808 00000100:00100000:0.0:1788270344.719109:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384064 00000100:00100000:0.0:1788270344.719111:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384064 00000100:00100000:0.0:1788270344.719125:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 574 00000100:00100000:2.0:1788270344.719134:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 279 00000100:00100000:0.0:1788270344.719135:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253383680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270344.719141:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253383936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270344.719208:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253383936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270344.719216:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 279 00000100:00100000:2.0:1788270344.719233:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 280 00000100:00100000:2.0:1788270344.719239:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253383808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270344.719265:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253383808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270344.719271:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 280 00000100:00100000:1.0:1788270344.719283:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 575 00000100:00100000:1.0:1788270344.719292:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253384192:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270344.719331:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253384192:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270344.719337:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 575 00000100:00100000:1.0:1788270344.719353:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 576 00000100:00100000:1.0:1788270344.719360:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253383552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270344.719382:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253383552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270344.719389:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 576 00000100:00100000:1.0:1788270344.719400:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 577 00000100:00100000:1.0:1788270344.719407:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253384064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270344.719444:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253384064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270344.719450:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 577 00000100:00100000:0.0:1788270344.720407:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253383680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1268us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270344.721386:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 574 00000100:00100000:2.0:1788270344.724093:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253383424 00000100:00100000:2.0:1788270344.724113:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253383424 00000100:00100000:2.0:1788270344.724178:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 270 00000100:00080000:3.0:1788270344.724189:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270344.724192:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253383424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788270344.724197:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270344.724200:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270344.724203:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270344.725071:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253383424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 849us (6316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270344.725085:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 270 00000100:00100000:1.0:1788270345.412479:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270345.412515:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262778112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270345.412612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270345.412684:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778112 00000100:00100000:1.0:1788270345.412692:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778112 00000100:00100000:1.0:1788270345.412748:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788270345.412758:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262778112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788270345.412789:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270345.412833:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262778112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.412841:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:1.0:1788270345.412862:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788270345.412909:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262778112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270345.413443:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270345.413454:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262778240:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.414243:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.414639:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270345.414649:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262778368:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.414701:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.414728:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778368 00000100:00100000:3.0:1788270345.414733:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778368 00000100:00100000:3.0:1788270345.414771:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788270345.414778:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.414821:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262778368:12345-0@lo:400:kworker.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270345.414828:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788270345.414859:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262778368:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.414887:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262778496:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.414923:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.414949:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778496 00000100:00100000:3.0:1788270345.414953:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778496 00000100:00100000:3.0:1788270345.414981:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788270345.414987:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262778496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.415029:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262778496:12345-0@lo:400:kworker.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270345.415035:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788270345.415082:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262778496:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.415112:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262778624:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.415144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.415178:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270345.415183:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262778752:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.415202:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.415220:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778752 00000100:00100000:3.0:1788270345.415223:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778752 00000100:00100000:3.0:1788270345.415240:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788270345.415245:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262778752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.415364:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778624 00000100:00100000:1.0:1788270345.415368:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778624 00000100:00100000:1.0:1788270345.415395:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1788270345.415401:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262778624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.415437:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262778624:12345-0@lo:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.415446:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:1.0:1788270345.415464:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270345.415480:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262778624:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416394:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262778752:12345-0@lo:400:kworker.0 Request processed in 1146us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270345.416403:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788270345.416449:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270345.416456:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262778880:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416479:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.416580:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778880 00000100:00100000:3.0:1788270345.416585:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778880 00000100:00100000:3.0:1788270345.416615:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788270345.416621:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262778880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416654:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262778880:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270345.416660:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788270345.416684:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262778880:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416708:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262779008:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416727:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.416767:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270345.416772:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262779392:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416791:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.416819:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262779520:0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.416838:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270345.417096:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779008 00000100:00100000:1.0:1788270345.417100:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779008 00000100:00100000:1.0:1788270345.417128:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788270345.417134:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262779008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.417173:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262779008:12345-0@lo:400:kworker.0 Request processed in 39us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.417179:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788270345.417233:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779392 00000100:00100000:1.0:1788270345.417236:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779392 00000100:00100000:1.0:1788270345.417267:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779520 00000100:00100000:1.0:1788270345.417270:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779520 00000100:00100000:1.0:1788270345.417301:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1788270345.417307:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262779392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.417341:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262779392:12345-0@lo:400:kworker.0 Request processed in 34us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.417346:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1788270345.417358:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1788270345.417363:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262779520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.417386:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262779520:12345-0@lo:400:kworker.0 Request processed in 24us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.417391:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00080000:1.0:1788270345.417448:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270345.417452:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270345.417455:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270345.417456:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270345.417476:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262779136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.418656:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270345.418706:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262779648:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.418742:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270345.418778:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262778752:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.418801:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270345.418807:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262779264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.418830:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270345.418865:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779136 00000100:00100000:1.0:1788270345.418871:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779136 00000100:00100000:1.0:1788270345.418901:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779648 00000100:00100000:1.0:1788270345.418904:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779648 00000100:00100000:1.0:1788270345.418931:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1788270345.418938:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262779136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.418981:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262779136:12345-0@lo:400:kworker.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.418987:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1788270345.418999:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779264 00000100:00100000:1.0:1788270345.419002:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779264 00000100:00100000:1.0:1788270345.419022:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1788270345.419028:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262779648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.419074:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262779648:12345-0@lo:400:kworker.0 Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.419080:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1788270345.419091:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1788270345.419096:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262779264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.419148:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262779264:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270345.419155:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00080000:1.0:1788270345.419178:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270345.419182:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270345.419207:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262779520:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.419220:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262779392:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.419231:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262779008:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.422109:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262779264:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.422136:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262779136:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.422148:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262779648:0@lo:400:kworker.0 00000100:00100000:1.0:1788270345.422170:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270345.422187:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262779776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270345.422241:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270345.425155:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262779904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270345.425230:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270345.425355:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779776 00000100:00100000:3.0:1788270345.425363:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779776 00000100:00100000:3.0:1788270345.425413:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262779904 00000100:00100000:3.0:1788270345.425428:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262779904 00000100:00100000:3.0:1788270345.425446:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788270345.425456:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262779776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788270345.425488:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270345.426466:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788270345.426481:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262779904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270345.426500:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270345.427817:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262778240 00000100:00100000:2.0:1788270345.427828:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262778240 00000100:00100000:2.0:1788270345.427893:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788270345.427902:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270345.430781:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262779776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5315us (8528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270345.430796:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788270345.430881:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262779776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270345.438121:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262779904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11634us (12880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270345.438136:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788270345.438251:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262779904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270345.446603:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262778240:12345-0@lo:400:kworker.0 Request processed in 18691us (32351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270345.446618:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788270345.446761:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262778240:0@lo:400:kworker.0 00010000:00010000:1.0:1788270345.668620:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270345.769952:0:56984:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270345.769961:0:56984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270345.780877:0:56984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270345.780896:0:56984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270346.693616:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270346.948331:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262780032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270346.948407:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270346.948564:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780032 00000100:00100000:2.0:1788270346.948574:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780032 00000100:00100000:2.0:1788270346.948675:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788270346.948686:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262780032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270346.948707:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270346.948764:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262780032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270346.948772:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788270346.948842:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262780032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270347.463951:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270347.463979:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262780160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270347.464100:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270347.464152:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780160 00000100:00100000:1.0:1788270347.464159:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780160 00000100:00100000:1.0:1788270347.464215:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788270347.464225:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262780160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270347.464287:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270347.464335:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262780160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270347.464343:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788270347.464386:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262780160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270347.724724:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270347.806740:0:57038:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270347.806751:0:57038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270347.808292:0:57038:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270347.808306:0:57038:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270348.741461:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270349.509289:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262780288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270349.509502:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270349.510339:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780288 00000100:00100000:3.0:1788270349.510351:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780288 00000100:00100000:3.0:1788270349.510440:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788270349.510451:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262780288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270349.510485:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270349.511541:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262780288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1089us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270349.512126:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262780288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270349.513054:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:3.0:1788270349.764321:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270349.844981:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270349.845059:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270349.845081:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384320 00000100:00100000:1.0:1788270349.845087:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270349.845092:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384320 00000100:00100000:1.0:1788270349.845107:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270349.845124:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270349.845143:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270349.845146:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 272 00000100:00100000:3.0:1788270349.845158:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253384320:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270349.845165:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270349.845186:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384576 00000100:00100000:1.0:1788270349.845190:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384576 00000100:00100000:1.0:1788270349.845240:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385088 00000100:00100000:1.0:1788270349.845243:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385088 00000100:00100000:3.0:1788270349.845258:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253384320:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 103us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270349.845259:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384448 00000100:00100000:3.0:1788270349.845266:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 272 00000100:00100000:3.0:1788270349.845302:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384832 00000100:00100000:3.0:1788270349.845306:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384832 00000100:00100000:3.0:1788270349.845335:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384704 00000100:00100000:3.0:1788270349.845338:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384704 00000100:00100000:3.0:1788270349.845358:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:3.0:1788270349.845366:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253384832:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270349.845394:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253384832:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270349.845401:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:1.0:1788270349.846752:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384448 00000100:00100000:1.0:1788270349.846795:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253384960 00000100:00100000:1.0:1788270349.846798:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253384960 00000100:00100000:1.0:1788270349.846819:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 584 00000100:00100000:1.0:1788270349.846827:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253384576:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270349.846884:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253384576:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 57us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270349.846891:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 584 00000100:00100000:1.0:1788270349.846906:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 585 00000100:00100000:1.0:1788270349.846913:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253385088:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270349.846934:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253385088:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270349.846940:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 585 00000100:00100000:1.0:1788270349.846951:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 586 00000100:00100000:1.0:1788270349.846957:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253384448:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270349.846979:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253384448:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270349.846985:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 586 00000100:00100000:1.0:1788270349.846997:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 587 00000100:00100000:1.0:1788270349.847003:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253384960:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270349.847024:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253384960:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270349.847030:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 587 00000100:00080000:1.0:1788270349.847075:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270349.847080:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270349.847082:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270349.847084:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270349.847516:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 285 00000100:00100000:3.0:1788270349.847529:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253384704:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270349.847560:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253384704:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270349.856078:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 285 00000040:00080000:3.0:1788270350.024616:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788270350.024624:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270350.025225:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:3.0:1788270350.025234:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788270350.073976:0:57089:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270350.073985:0:57089:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270350.076665:0:57089:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270350.076687:0:57089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270350.533101:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262780544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270350.533264:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270350.533346:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788270350.533354:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262780416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270350.533380:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270350.533425:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780544 00000100:00100000:0.0:1788270350.533433:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780544 00000100:00100000:0.0:1788270350.533487:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780416 00000100:00100000:0.0:1788270350.533491:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780416 00000100:00100000:0.0:1788270350.533508:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788270350.533517:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262780544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270350.533551:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270350.533596:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262780544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270350.533603:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788270350.533622:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788270350.533628:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262780416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270350.533645:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270350.533668:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262780416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270350.533677:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:0.0:1788270350.533703:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270350.533707:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270350.533736:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262780416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270350.533747:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262780544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270350.534019:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262780800:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534065:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.534088:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262781312:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534107:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.534120:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262781824:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534155:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.534172:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788270350.534177:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262780672:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534220:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.534244:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262781184:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534265:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.534293:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262781696:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534316:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.534344:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780800 00000100:00100000:1.0:1788270350.534349:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780800 00000100:00100000:1.0:1788270350.534378:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781184 00000100:00100000:1.0:1788270350.534381:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781184 00000100:00100000:1.0:1788270350.534396:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788270350.534403:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262780800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534445:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262780800:12345-0@lo:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.534451:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788270350.534463:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788270350.534469:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262781184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534493:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262781184:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.534498:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788270350.534513:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781312 00000100:00100000:1.0:1788270350.534516:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781312 00000100:00100000:1.0:1788270350.534543:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788270350.534548:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262781312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534574:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262781312:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.534579:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788270350.534594:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781824 00000100:00100000:1.0:1788270350.534597:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781824 00000100:00100000:1.0:1788270350.534618:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781696 00000100:00100000:1.0:1788270350.534620:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781696 00000100:00100000:1.0:1788270350.534634:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1788270350.534639:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262781824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534664:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262781824:12345-0@lo:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.534670:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1788270350.534679:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1788270350.534753:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262781696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534780:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262781696:12345-0@lo:400:kworker.0 Request processed in 96us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.534786:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1788270350.534819:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780672 00000100:00100000:1.0:1788270350.534823:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780672 00000100:00100000:1.0:1788270350.534860:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788270350.534867:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262780672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534894:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3610:x1875136262780672:12345-0@lo:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.534900:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788270350.534956:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5051c9b2-4d56-4172-904c-6f13b6100451:3610:1875136262780672:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534967:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262781184:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534975:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262781696:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.534995:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262780800:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.535007:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262781312:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.535016:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262781824:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535186:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262780928:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535230:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270350.535256:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262781440:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535278:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270350.535302:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262781952:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535324:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270350.535345:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788270350.535351:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262781056:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535373:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270350.535389:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262781568:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535410:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270350.535446:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781440 00000100:00100000:2.0:1788270350.535451:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781440 00000100:00100000:2.0:1788270350.535478:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781952 00000100:00100000:2.0:1788270350.535482:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781952 00000100:00100000:2.0:1788270350.535499:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781056 00000100:00100000:2.0:1788270350.535501:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781056 00000100:00100000:2.0:1788270350.535511:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262781568 00000100:00100000:2.0:1788270350.535513:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262781568 00000100:00100000:2.0:1788270350.535525:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1788270350.535531:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262781440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535566:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875136262781440:12345-0@lo:400:kworker.0 Request processed in 35us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270350.535573:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1788270350.535586:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1788270350.535592:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262781952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535617:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875136262781952:12345-0@lo:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270350.535622:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1788270350.535632:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1788270350.535638:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262781056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.535664:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262781056:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270350.535670:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1788270350.535681:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1788270350.535831:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262781056:0@lo:400:kworker.0 00000100:00100000:3.0:1788270350.535842:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875136262781440:0@lo:400:kworker.0 00000100:00100000:3.0:1788270350.535851:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1875136262781952:0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.535919:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262780928 00000100:00100000:1.0:1788270350.535923:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262780928 00000100:00100000:1.0:1788270350.535964:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788270350.535972:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262780928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270350.536011:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262780928:12345-0@lo:400:kworker.0 Request processed in 40us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270350.536017:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788270350.536064:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262780928:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.536133:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262781568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.536175:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875136262781568:12345-0@lo:400:kworker.0 Request processed in 488us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270350.536182:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00080000:0.0:1788270350.536328:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270350.536333:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270350.536335:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270350.536338:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270350.536348:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262782080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270350.536376:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270350.536473:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3607:1875136262781568:0@lo:400:kworker.0 00000100:00100000:2.0:1788270350.536532:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782080 00000100:00100000:2.0:1788270350.536536:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782080 00000100:00100000:2.0:1788270350.536610:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788270350.536618:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262782080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270350.536633:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270350.536678:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262782080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270350.536695:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788270350.536753:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262782080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788270350.789957:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270350.790451:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270350.790457:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270350.791005:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270350.791025:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270351.812903:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270352.057184:0:57140:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270352.057195:0:57140:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270352.064503:0:57140:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270352.064522:0:57140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270352.068265:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270352.068311:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262782208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270352.068389:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270352.068449:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782208 00000100:00100000:0.0:1788270352.068456:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782208 00000100:00100000:0.0:1788270352.068521:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788270352.068532:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262782208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788270352.068554:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00080000:1.0:1788270352.068590:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270352.068601:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262782208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270352.068609:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788270352.068656:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262782208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270352.580638:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270352.580662:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262782336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270352.580736:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270352.584376:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782336 00000100:00100000:1.0:1788270352.584393:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782336 00000100:00100000:1.0:1788270352.584699:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788270352.584711:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262782336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788270352.584760:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1788270352.584852:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262782336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270352.584859:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788270352.585079:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c24821aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262782336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270352.836468:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788270353.864581:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270354.203225:0:57191:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270354.203233:0:57191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270354.203622:0:57191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270354.203628:0:57191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270354.628557:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262782464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270354.628642:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270354.628693:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782464 00000100:00100000:0.0:1788270354.628703:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782464 00000100:00100000:0.0:1788270354.628757:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788270354.628768:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262782464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270354.628801:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270354.628855:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262782464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270354.628862:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788270354.629181:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262782464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270354.886112:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270354.950359:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270354.950419:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270354.950583:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270354.950641:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385472 00000100:00100000:1.0:1788270354.950657:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385472 00000100:00100000:2.0:1788270354.950754:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385216 00000100:00100000:2.0:1788270354.950760:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385216 00000100:00100000:3.0:1788270354.950791:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270354.950836:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788270354.950846:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:2.0:1788270354.950878:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253385216:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270354.950882:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270354.950948:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385984 00000100:00100000:1.0:1788270354.950953:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385984 00000100:00100000:3.0:1788270354.951016:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270354.951136:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385344 00000100:00100000:1.0:1788270354.951142:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385344 00000100:00100000:1.0:1788270354.951163:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385856 00000100:00100000:0.0:1788270354.951166:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385728 00000100:00100000:1.0:1788270354.951167:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385856 00000100:00100000:0.0:1788270354.951184:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385728 00000100:00100000:1.0:1788270354.951197:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 594 00000100:00100000:1.0:1788270354.951211:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253385472:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270354.951258:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253385600 00000100:00100000:0.0:1788270354.951262:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253385600 00000100:00100000:0.0:1788270354.951289:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 288 00000100:00100000:0.0:1788270354.951299:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253385728:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270354.952483:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 595 00000100:00100000:3.0:1788270354.952496:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253385984:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270354.952559:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253385216:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1502us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270354.952560:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253385984:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 59us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270354.952589:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 595 00000100:00100000:3.0:1788270354.952616:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 596 00000100:00100000:3.0:1788270354.952623:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253385344:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270354.952644:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253385344:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270354.952650:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 596 00000100:00100000:3.0:1788270354.952661:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 597 00000100:00100000:3.0:1788270354.952666:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253385856:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270354.952684:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253385856:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 18us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270354.952690:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 597 00000100:00100000:2.0:1788270354.952704:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 274 00000100:00100000:3.0:1788270354.952843:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 289 00000100:00100000:3.0:1788270354.952852:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2810e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253385600:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270354.952882:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2810e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253385600:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270354.952889:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 289 00000100:00080000:3.0:1788270354.952917:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270354.952922:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270354.952924:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270354.952927:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270354.961492:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24821aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253385472:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 10266us (11052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270354.961512:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 594 00000100:00100000:0.0:1788270354.963821:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253385728:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 12510us (13234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270354.963838:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 288 00000100:00100000:0.0:1788270355.652248:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262782592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270355.652321:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270355.652697:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262782720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270355.652728:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270355.652770:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782592 00000100:00100000:0.0:1788270355.652777:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782592 00000100:00100000:0.0:1788270355.652823:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782720 00000100:00100000:0.0:1788270355.652826:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782720 00000100:00100000:0.0:1788270355.652846:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788270355.652855:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262782592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270355.652883:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270355.652925:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262782592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270355.652932:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788270355.652963:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788270355.652971:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262782720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270355.652981:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270355.653009:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262782720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270355.653015:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:0.0:1788270355.653030:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270355.653081:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262782720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270355.653126:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262782592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270355.655392:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270355.655416:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262782848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270355.655496:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270355.655551:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782848 00000100:00100000:2.0:1788270355.655558:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782848 00000100:00100000:2.0:1788270355.655605:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788270355.655616:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262782848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270355.655643:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270355.655684:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c276266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262782848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270355.655691:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1788270355.655714:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270355.655745:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262782848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270355.657335:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262782976:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.657398:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270355.657492:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262782976 00000100:00100000:2.0:1788270355.657499:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262782976 00000100:00100000:2.0:1788270355.657545:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788270355.657553:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262782976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.659144:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262783104:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.659200:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270355.659380:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262782976:12345-0@lo:400:kworker.0 Request processed in 1824us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270355.659392:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788270355.659444:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783104 00000100:00100000:2.0:1788270355.659450:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783104 00000100:00100000:2.0:1788270355.659651:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788270355.659660:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262783104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270355.659714:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262783104:12345-0@lo:400:kworker.0 Request processed in 56us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270355.659721:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788270355.659791:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262782976:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.659836:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262783104:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.660542:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262783360:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.660585:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270355.660612:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262783872:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.660636:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270355.660659:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788270355.660665:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262783232:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.660686:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270355.660705:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262783744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.660724:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270355.660751:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783360 00000100:00100000:1.0:1788270355.660756:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783360 00000100:00100000:1.0:1788270355.660789:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788270355.660796:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262783360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.660843:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262783360:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270355.660849:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788270355.660870:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783872 00000100:00100000:1.0:1788270355.660873:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783872 00000100:00100000:1.0:1788270355.660910:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783232 00000100:00100000:1.0:1788270355.660913:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783232 00000100:00100000:1.0:1788270355.660930:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783744 00000100:00100000:1.0:1788270355.660932:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783744 00000100:00100000:1.0:1788270355.660965:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1788270355.660971:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262783872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.661002:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262783872:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270355.661007:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1788270355.661018:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1788270355.661023:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262783232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.661075:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1875136262783232:12345-0@lo:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270355.661080:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1788270355.661091:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1788270355.661097:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262783744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.661253:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262783744:12345-0@lo:400:kworker.0 Request processed in 156us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270355.661260:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00080000:1.0:1788270355.661290:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270355.661294:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270355.661317:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1875136262783232:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.661327:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262783744:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.661335:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262783360:0@lo:400:kworker.0 00000100:00100000:1.0:1788270355.661342:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262783872:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661421:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262783616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661448:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270355.661482:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262784128:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661502:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270355.661518:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788270355.661524:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262783488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661545:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270355.661559:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262784000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661578:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270355.661601:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783488 00000100:00100000:0.0:1788270355.661605:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783488 00000100:00100000:0.0:1788270355.661642:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788270355.661649:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262783488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661685:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262783488:12345-0@lo:400:kworker.0 Request processed in 36us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270355.661690:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788270355.661711:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262783616 00000100:00100000:0.0:1788270355.661716:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262783616 00000100:00100000:0.0:1788270355.661733:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784128 00000100:00100000:0.0:1788270355.661736:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784128 00000100:00100000:0.0:1788270355.661757:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784000 00000100:00100000:0.0:1788270355.661760:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784000 00000100:00100000:0.0:1788270355.661772:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788270355.661778:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262783616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661807:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262783616:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270355.661813:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788270355.661825:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1788270355.661831:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262784128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661857:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262784128:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270355.661862:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1788270355.661874:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1788270355.661880:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262784000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661902:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262784000:12345-0@lo:400:kworker.0 Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270355.661908:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:0.0:1788270355.661924:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270355.661927:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788270355.661929:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270355.661960:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262783488:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661969:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262784000:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661977:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262783616:0@lo:400:kworker.0 00000100:00100000:0.0:1788270355.661985:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262784128:0@lo:400:kworker.0 00010000:00010000:0.0:1788270355.913326:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270355.992753:0:57243:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270355.992761:0:57243:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270355.993601:0:57243:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270355.993613:0:57243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270356.932266:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270357.193245:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262784256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788270357.193315:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270357.193368:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784256 00000100:00100000:2.0:1788270357.193375:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784256 00000100:00100000:2.0:1788270357.193429:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788270357.193439:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262784256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270357.193461:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270357.193513:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d7df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262784256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270357.193520:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788270357.193543:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270357.193580:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262784256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270357.700164:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270357.700188:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262784384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270357.700256:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270357.700322:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784384 00000100:00100000:3.0:1788270357.700330:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784384 00000100:00100000:3.0:1788270357.700373:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788270357.700395:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262784384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270357.700427:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270357.700474:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262784384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270357.700482:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788270357.700527:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262784384:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788270357.897304:0:57294:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270357.897314:0:57294:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270357.899316:0:57294:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270357.899337:0:57294:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270357.959311:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788270358.980461:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270359.582227:0:57345:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270359.582236:0:57345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270359.582774:0:57345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270359.582783:0:57345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270359.748170:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270359.748193:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262784512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788270359.748260:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270359.749565:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784512 00000100:00100000:2.0:1788270359.749577:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784512 00000100:00100000:2.0:1788270359.749683:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788270359.749694:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262784512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788270359.749769:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788270359.749846:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262784512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270359.749854:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788270359.749925:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262784512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788270360.004241:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788270360.006328:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270360.006337:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270360.006900:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270360.006912:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270360.068746:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069211:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069233:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069269:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069294:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069313:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069337:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270360.069366:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386240 00000100:00100000:3.0:1788270360.069392:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386240 00000100:00100000:3.0:1788270360.069452:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386752 00000100:00100000:3.0:1788270360.069456:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386752 00000100:00100000:3.0:1788270360.069488:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386368 00000100:00100000:3.0:1788270360.069492:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386368 00000100:00100000:3.0:1788270360.069505:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386880 00000100:00100000:3.0:1788270360.069507:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386880 00000100:00100000:3.0:1788270360.069523:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 604 00000100:00100000:3.0:1788270360.069532:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253386240:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270360.069604:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253386240:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 73us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.069612:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 604 00000100:00100000:3.0:1788270360.069631:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 605 00000100:00100000:3.0:1788270360.069638:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253386752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270360.069674:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253386752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.069681:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 605 00000100:00100000:3.0:1788270360.069694:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 606 00000100:00100000:3.0:1788270360.069701:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253386368:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270360.069725:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253386368:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.069731:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 606 00000100:00100000:3.0:1788270360.069743:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 607 00000100:00100000:3.0:1788270360.069749:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253386880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270360.069792:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253386880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 43us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.069798:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 607 00000100:00100000:3.0:1788270360.069822:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386496 00000100:00100000:3.0:1788270360.069825:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386496 00000100:00100000:3.0:1788270360.069850:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 291 00000100:00100000:3.0:1788270360.069856:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253386496:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270360.069879:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253386496:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.069896:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 291 00000100:00100000:3.0:1788270360.069907:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386624 00000100:00100000:3.0:1788270360.069910:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386624 00000100:00100000:3.0:1788270360.069932:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 292 00000100:00100000:3.0:1788270360.069939:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253386624:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270360.069962:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253386624:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.069967:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 292 00000100:00080000:3.0:1788270360.069999:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270360.070003:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270360.070005:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270360.070007:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788270360.078629:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253386112 00000100:00100000:1.0:1788270360.078646:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253386112 00000100:00100000:0.0:1788270360.078832:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 276 00000100:00100000:0.0:1788270360.078844:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253386112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270360.079286:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2400:x1875136253386112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 442us (10548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270360.079296:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 276 00000040:00080000:0.0:1788270360.260323:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788270360.260332:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270360.260852:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:0.0:1788270360.260862:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788270360.772244:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270360.772323:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262784768:0@lo:400:kworker.0 00000100:00100000:1.0:1788270360.772412:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270360.772482:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788270360.772488:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262784896:0@lo:400:kworker.0 00000100:00100000:1.0:1788270360.772515:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270360.772554:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784768 00000100:00100000:1.0:1788270360.772561:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784768 00000100:00100000:1.0:1788270360.772612:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788270360.772622:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262784768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270360.772675:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262784768:12345-0@lo:400:kworker.0 Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270360.772682:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788270360.772717:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784896 00000100:00100000:1.0:1788270360.772721:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784896 00000100:00100000:1.0:1788270360.772925:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788270360.772932:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262784896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270360.773082:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262784896:12345-0@lo:400:kworker.0 Request processed in 150us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270360.773089:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788270360.773126:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262784896:0@lo:400:kworker.0 00000100:00100000:1.0:1788270360.773137:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262784768:0@lo:400:kworker.0 00000100:00080000:1.0:1788270360.773197:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270360.774096:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270360.774108:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262785280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270360.774149:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270360.774186:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785280 00000100:00100000:0.0:1788270360.774193:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785280 00000100:00100000:0.0:1788270360.774235:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788270360.774243:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262785280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270360.774272:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270360.774312:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262785280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270360.774319:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788270360.774543:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262785280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788270360.774562:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270360.774658:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262785152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270360.774685:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270360.774715:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785152 00000100:00100000:0.0:1788270360.774719:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785152 00000100:00100000:0.0:1788270360.774739:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788270360.774745:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262785152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270360.774762:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270360.774792:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262785152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270360.774798:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788270360.774825:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262785152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270360.774846:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262785024:0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.774871:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270360.774889:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262784640:0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.774912:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270360.774945:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785024 00000100:00100000:0.0:1788270360.774948:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785024 00000100:00100000:0.0:1788270360.774970:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788270360.774975:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262785024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.775006:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875136262785024:12345-0@lo:400:kworker.0 Request processed in 31us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270360.775012:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788270360.775113:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262784640 00000100:00100000:0.0:1788270360.775117:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262784640 00000100:00100000:0.0:1788270360.775142:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788270360.775149:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262784640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.775179:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262784640:12345-0@lo:400:kworker.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270360.775184:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788270360.775218:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1875136262785024:0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.775226:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262784640:0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.775287:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262785408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270360.775311:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270360.775335:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785408 00000100:00100000:0.0:1788270360.775338:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785408 00000100:00100000:0.0:1788270360.776901:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788270360.776911:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262785408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788270360.776932:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:0.0:1788270360.776994:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262785408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270360.777001:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1788270360.777729:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788270360.777776:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262785408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270360.783534:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262785536:0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.783676:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270360.783708:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785536 00000100:00100000:2.0:1788270360.783717:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785536 00000100:00100000:2.0:1788270360.783769:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1788270360.783780:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262785536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.786388:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875136262785536:12345-0@lo:400:kworker.0 Request processed in 2602us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.786403:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1788270360.787365:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262785920:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787421:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270360.787449:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262786432:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787468:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270360.787487:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788270360.787493:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c147209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262785792:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787580:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270360.787600:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787618:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270360.787645:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785792 00000100:00100000:2.0:1788270360.787651:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785792 00000100:00100000:2.0:1788270360.787700:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788270360.787708:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262785792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787751:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262785792:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.787758:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:2.0:1788270360.787778:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270360.787807:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262785792:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787848:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785920 00000100:00100000:2.0:1788270360.787852:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785920 00000100:00100000:2.0:1788270360.787876:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786432 00000100:00100000:2.0:1788270360.787878:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786432 00000100:00100000:2.0:1788270360.787896:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786304 00000100:00100000:2.0:1788270360.787909:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786304 00000100:00100000:2.0:1788270360.787927:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1788270360.787933:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262785920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.787964:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1875136262785920:12345-0@lo:400:kworker.0 Request processed in 32us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.787970:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1788270360.787981:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1788270360.787987:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262786432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.788009:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1875136262786432:12345-0@lo:400:kworker.0 Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.788014:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1788270360.788284:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1788270360.788292:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262786304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.788329:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1875136262786304:12345-0@lo:400:kworker.0 Request processed in 38us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.788335:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00080000:2.0:1788270360.788360:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270360.788364:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270360.788384:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1875136262786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.788394:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c147208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1875136262785920:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.788403:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1875136262786432:0@lo:400:kworker.0 00000100:00100000:3.0:1788270360.789289:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262785664:0@lo:400:kworker.0 00000100:00100000:3.0:1788270360.789343:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270360.789379:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262786176:0@lo:400:kworker.0 00000100:00100000:3.0:1788270360.789403:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270360.789427:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270360.789434:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262786048:0@lo:400:kworker.0 00000100:00100000:3.0:1788270360.789456:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270360.789489:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786176 00000100:00100000:3.0:1788270360.789495:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786176 00000100:00100000:3.0:1788270360.789533:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786048 00000100:00100000:3.0:1788270360.789536:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786048 00000100:00100000:3.0:1788270360.789557:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1788270360.789564:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262786176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.789639:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262785664 00000100:00100000:2.0:1788270360.789645:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262785664 00000100:00100000:2.0:1788270360.789675:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788270360.789683:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262785664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.789728:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262785664:12345-0@lo:400:kworker.0 Request processed in 43us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.789734:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788270360.789771:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1788270360.789778:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262786048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.789808:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262786048:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270360.789815:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00080000:2.0:1788270360.789835:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270360.789839:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270360.789879:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262786048:0@lo:400:kworker.0 00000100:00100000:2.0:1788270360.789893:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262785664:0@lo:400:kworker.0 00000100:00100000:3.0:1788270360.790174:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262786176:12345-0@lo:400:kworker.0 Request processed in 610us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270360.790181:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1788270360.790247:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c271ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262786176:0@lo:400:kworker.0 00000100:00100000:0.0:1788270360.790712:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875136262785536:0@lo:400:kworker.0 00010000:00010000:2.0:1788270361.032146:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270361.398826:0:57396:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270361.398836:0:57396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270361.400890:0:57396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270361.400907:0:57396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788270362.060278:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270362.308802:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270362.308826:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262786560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270362.308904:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270362.309025:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786560 00000100:00100000:1.0:1788270362.309033:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786560 00000100:00100000:1.0:1788270362.309112:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788270362.309122:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262786560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270362.309151:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270362.309200:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262786560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270362.309206:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788270362.309249:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262786560:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788270362.309378:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270362.821393:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270362.821427:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262786688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788270362.821506:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270362.827545:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786688 00000100:00100000:0.0:1788270362.827561:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786688 00000100:00100000:0.0:1788270362.828575:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788270362.828590:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262786688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270362.828626:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270362.828721:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262786688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (7214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270362.828728:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788270362.828831:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262786688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788270363.076833:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270363.228341:0:57448:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270363.228353:0:57448:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270363.228757:0:57448:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270363.228764:0:57448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270364.100604:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270364.868353:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788270364.868387:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c153642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262786816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270364.868464:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270364.868707:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786816 00000100:00100000:1.0:1788270364.868716:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786816 00000100:00100000:1.0:1788270364.868776:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788270364.868787:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262786816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270364.868821:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270364.868875:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262786816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270364.868882:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788270364.869013:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c153642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262786816:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788270365.053204:0:57499:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788270365.053214:0:57499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788270365.053885:0:57499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:2.0:1788270365.053899:0:57499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788270365.129077:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270365.188526:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188571:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188597:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188625:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188644:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188662:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188686:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270365.188713:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387392 00000100:00100000:1.0:1788270365.188722:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387392 00000100:00100000:1.0:1788270365.188782:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387520 00000100:00100000:1.0:1788270365.188786:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387520 00000100:00100000:1.0:1788270365.188807:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 296 00000100:00100000:1.0:1788270365.188818:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253387392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.188883:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253387392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.188891:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 296 00000100:00100000:1.0:1788270365.188907:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:1.0:1788270365.188914:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253387520:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.188936:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253387520:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.188954:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:1.0:1788270365.188971:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387136 00000100:00100000:1.0:1788270365.188974:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387136 00000100:00100000:1.0:1788270365.188998:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387648 00000100:00100000:1.0:1788270365.189001:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387648 00000100:00100000:1.0:1788270365.189015:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387264 00000100:00100000:1.0:1788270365.189017:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387264 00000100:00100000:1.0:1788270365.189028:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387776 00000100:00100000:1.0:1788270365.189031:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387776 00000100:00100000:1.0:1788270365.189069:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 614 00000100:00100000:1.0:1788270365.189076:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253387136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.189103:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253387136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.189109:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 614 00000100:00100000:1.0:1788270365.189120:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 615 00000100:00100000:1.0:1788270365.189126:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253387648:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.189146:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253387648:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.189151:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 615 00000100:00100000:1.0:1788270365.189160:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 616 00000100:00100000:1.0:1788270365.189166:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c153641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253387264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.189185:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c153641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253387264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 19us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.189190:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 616 00000100:00100000:1.0:1788270365.189200:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 617 00000100:00100000:1.0:1788270365.189205:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253387776:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.189225:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253387776:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 19us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.189231:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 617 00000100:00100000:1.0:1788270365.189247:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387008 00000100:00100000:1.0:1788270365.189250:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387008 00000100:00100000:1.0:1788270365.189275:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 278 00000100:00100000:1.0:1788270365.189281:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253387008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270365.189301:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253387008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 20us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.189307:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 278 00000100:00080000:1.0:1788270365.189337:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788270365.189340:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270365.189343:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270365.189345:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788270365.892577:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788270365.892602:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262787072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270365.892674:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270365.892812:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262786944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788270365.892846:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.892971:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787072 00000100:00100000:1.0:1788270365.892980:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787072 00000100:00100000:1.0:1788270365.893067:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262786944 00000100:00100000:1.0:1788270365.893071:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262786944 00000100:00100000:1.0:1788270365.893088:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788270365.893096:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262787072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270365.893125:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270365.893169:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262787072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.893175:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788270365.893190:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788270365.893207:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262786944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270365.893221:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270365.893252:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262786944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.893257:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788270365.893300:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262786944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270365.893328:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c26b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262787072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788270365.893439:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270365.893444:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270365.894015:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262787328:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894073:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270365.894110:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14409b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262787840:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894135:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270365.894150:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262788352:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894173:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270365.894213:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788270365.894220:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262787456:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894248:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270365.894263:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262787968:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894285:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270365.894308:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262788480:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894328:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270365.894352:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787968 00000100:00100000:2.0:1788270365.894356:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787968 00000100:00100000:2.0:1788270365.894396:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788270365.894403:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262787968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.894452:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262787968:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270365.894458:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1788270365.894475:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788270365.894506:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262787968:0@lo:400:kworker.0 00000100:00100000:3.0:1788270365.894646:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787328 00000100:00100000:3.0:1788270365.894651:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787328 00000100:00100000:3.0:1788270365.894691:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788270365.894699:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262787328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270365.894735:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262787328:12345-0@lo:400:kworker.0 Request processed in 37us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270365.894741:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788270365.895166:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788352 00000100:00100000:1.0:1788270365.895171:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788352 00000100:00100000:1.0:1788270365.895228:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788480 00000100:00100000:1.0:1788270365.895231:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788480 00000100:00100000:1.0:1788270365.895253:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1788270365.895261:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262788352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895310:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875136262788352:12345-0@lo:400:kworker.0 Request processed in 50us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.895317:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1788270365.895329:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1788270365.895336:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262788480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895364:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c147209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875136262788480:12345-0@lo:400:kworker.0 Request processed in 29us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.895370:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1788270365.895389:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787840 00000100:00100000:1.0:1788270365.895392:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787840 00000100:00100000:1.0:1788270365.895412:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787456 00000100:00100000:1.0:1788270365.895416:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787456 00000100:00100000:1.0:1788270365.895427:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788270365.895432:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262787840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895463:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262787840:12345-0@lo:400:kworker.0 Request processed in 30us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.895469:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788270365.895479:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788270365.895485:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262787456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895519:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c271ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262787456:12345-0@lo:400:kworker.0 Request processed in 34us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.895526:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788270365.895572:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c275905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262787200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270365.895605:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.895627:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262787712:0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895651:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.895669:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262788224:0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895693:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.895714:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788270365.895720:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262787584:0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895743:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.895767:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262788096:0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895788:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.895818:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262788608:0@lo:400:kworker.0 00000100:00100000:1.0:1788270365.895840:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270365.895867:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787712 00000100:00100000:1.0:1788270365.895871:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787712 00000100:00100000:1.0:1788270365.895891:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788224 00000100:00100000:1.0:1788270365.895894:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788224 00000100:00100000:1.0:1788270365.895909:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788096 00000100:00100000:1.0:1788270365.895911:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788096 00000100:00100000:1.0:1788270365.896068:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788608 00000100:00100000:1.0:1788270365.896072:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788608 00000100:00100000:1.0:1788270365.896092:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1788270365.896099:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262787712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270365.896210:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787200 00000100:00100000:0.0:1788270365.896215:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787200 00000100:00100000:0.0:1788270365.896247:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788270365.896253:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262787200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788270365.896266:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270365.896353:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262787456:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.896365:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1875136262788480:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.896374:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262787328:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.896384:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14409b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262787840:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.896393:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1875136262788352:0@lo:400:kworker.0 00000100:00100000:2.0:1788270365.896445:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262787584 00000100:00100000:2.0:1788270365.896448:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262787584 00000100:00100000:2.0:1788270365.896474:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788270365.896480:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262787584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270365.899166:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1788270365.899195:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262788224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270365.899799:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875136262787200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3543us (4190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270365.899823:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788270365.899885:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1788270365.899894:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262788096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270365.899959:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262788096:12345-0@lo:400:kworker.0 Request processed in 66us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270365.899966:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1788270365.899984:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1788270365.899992:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262788608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270365.900024:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262788608:12345-0@lo:400:kworker.0 Request processed in 34us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270365.900030:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1788270365.900096:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262788096:0@lo:400:kworker.0 00000100:00100000:0.0:1788270365.900108:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262788608:0@lo:400:kworker.0 00000100:00100000:0.0:1788270365.900126:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c275905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262787200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788270365.900138:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262787712:0@lo:400:kworker.0 00000100:00080000:0.0:1788270365.900225:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270365.900231:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270365.900234:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788270365.905369:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262787712:12345-0@lo:400:kworker.0 Request processed in 9255us (9701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270365.905386:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1788270365.905647:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262787584:12345-0@lo:400:kworker.0 Request processed in 9165us (9901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270365.905656:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788270365.905762:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262787584:0@lo:400:kworker.0 00000100:00100000:3.0:1788270365.907761:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875136262788224:12345-0@lo:400:kworker.0 Request processed in 8573us (12064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270365.907776:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1788270365.907976:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1875136262788224:0@lo:400:kworker.0 00010000:00010000:2.0:1788270366.148334:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270366.861791:0:57550:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270366.861804:0:57550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270366.862349:0:57550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270366.862360:0:57550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788270367.172223:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270367.428502:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262788736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788270367.428588:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270367.428852:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788736 00000100:00100000:2.0:1788270367.428862:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788736 00000100:00100000:2.0:1788270367.428964:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788270367.428984:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262788736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270367.429027:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270367.429103:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262788736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270367.429111:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:0.0:1788270367.429328:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270367.430713:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14a023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262788736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270367.940872:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788270367.940932:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c143835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262788864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270367.941011:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270367.941228:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788864 00000100:00100000:2.0:1788270367.941238:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788864 00000100:00100000:2.0:1788270367.941301:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788270367.941311:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262788864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788270367.941350:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1788270367.941473:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262788864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270367.941481:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788270367.942379:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c143835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262788864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270368.198262:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270368.599222:0:57601:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270368.599232:0:57601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270368.600144:0:57601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270368.600157:0:57601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270369.227590:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270369.988270:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788270369.988305:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262788992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270369.988384:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270369.988541:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262788992 00000100:00100000:1.0:1788270369.988549:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262788992 00000100:00100000:1.0:1788270369.988605:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788270369.988614:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262788992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788270369.988648:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788270369.988701:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262788992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270369.988708:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788270369.988748:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262788992:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788270370.244258:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270370.244268:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270370.244942:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270370.244952:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270370.246555:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788270370.308438:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308491:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308516:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308546:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308565:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308584:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308611:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270370.308639:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253387904 00000100:00100000:0.0:1788270370.308649:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253387904 00000100:00100000:0.0:1788270370.308693:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 280 00000100:00100000:0.0:1788270370.308704:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253387904:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270370.308768:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253387904:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270370.308779:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 280 00000100:00100000:0.0:1788270370.308811:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388160 00000100:00100000:0.0:1788270370.308815:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388160 00000100:00100000:0.0:1788270370.308844:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388672 00000100:00100000:0.0:1788270370.308847:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388672 00000100:00100000:0.0:1788270370.309157:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388032 00000100:00100000:0.0:1788270370.309161:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388032 00000100:00100000:0.0:1788270370.309174:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388544 00000100:00100000:0.0:1788270370.309176:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388544 00000100:00100000:0.0:1788270370.309328:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 624 00000100:00100000:1.0:1788270370.309531:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 625 00000100:00100000:1.0:1788270370.309540:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253388672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270370.309582:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c275905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253388672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270370.309590:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 625 00000100:00100000:1.0:1788270370.309606:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 626 00000100:00100000:1.0:1788270370.309613:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253388032:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270370.309639:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c248219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253388032:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270370.309649:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 626 00000100:00100000:1.0:1788270370.309661:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 627 00000100:00100000:1.0:1788270370.309668:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253388544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270370.309692:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253388544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270370.309698:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 627 00000100:00100000:1.0:1788270370.309718:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388416 00000100:00100000:1.0:1788270370.309723:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388416 00000100:00100000:1.0:1788270370.309758:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388288 00000100:00100000:1.0:1788270370.309761:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388288 00000100:00100000:1.0:1788270370.309784:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 300 00000100:00100000:1.0:1788270370.309790:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253388416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270370.309798:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 301 00000100:00100000:2.0:1788270370.309807:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253388288:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270370.309816:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253388416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270370.309823:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 300 00000100:00100000:2.0:1788270370.309829:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253388288:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270370.309835:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 301 00000100:00100000:0.0:1788270370.309960:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253388160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270370.309993:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253388160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 657us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270370.310000:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 624 00000100:00080000:0.0:1788270370.311302:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788270370.311308:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270370.311310:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270370.311312:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788270370.354647:0:57653:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270370.354658:0:57653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270370.357413:0:57653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270370.357432:0:57653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:3.0:1788270370.509099:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788270370.509112:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270370.509649:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:3.0:1788270370.509659:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788270371.012253:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270371.012280:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c14299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262789120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270371.012353:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270371.012394:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262789376:0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012412:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262789248:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012425:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.012440:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.012460:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262789760:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012460:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262789888:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012479:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.012481:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.012495:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262790272:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012495:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262790400:0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012513:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270371.012522:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789376 00000100:00100000:3.0:1788270371.012530:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262790784:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012531:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789376 00000100:00100000:3.0:1788270371.012551:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.012567:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788270371.012572:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262789632:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012572:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789888 00000100:00100000:1.0:1788270371.012575:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789888 00000100:00100000:1.0:1788270371.012590:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788270371.012594:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270371.012600:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262789376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012606:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262790144:0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012624:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.012637:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262790656:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.012646:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262789376:12345-0@lo:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270371.012654:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270371.012654:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788270371.012671:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788270371.012678:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262789888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012698:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789760 00000100:00100000:3.0:1788270371.012702:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789760 00000100:00100000:1.0:1788270371.012705:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3609:x1875136262789888:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270371.012711:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788270371.012725:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790272 00000100:00100000:1.0:1788270371.012726:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790784 00000100:00100000:3.0:1788270371.012728:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790272 00000100:00100000:1.0:1788270371.012728:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790784 00000100:00100000:3.0:1788270371.012741:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790656 00000100:00100000:3.0:1788270371.012743:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790656 00000100:00100000:1.0:1788270371.012748:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1788270371.012753:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262789760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012756:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1788270371.012760:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262790272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.012786:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875136262790272:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270371.012786:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875136262789760:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270371.012793:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1788270371.012861:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262789504:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.012890:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270371.012908:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262790016:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.012929:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270371.012944:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262790528:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.012961:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270371.013090:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789120 00000100:00100000:0.0:1788270371.013094:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789120 00000100:00100000:0.0:1788270371.013124:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788270371.013131:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262789120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788270371.013153:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:0.0:1788270371.013188:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262789120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270371.013195:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788270371.015105:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1788270371.015222:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790528 00000100:00100000:1.0:1788270371.015231:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790528 00000100:00100000:2.0:1788270371.015243:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788270371.015257:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262790912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270371.015269:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1788270371.015277:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262790784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.015307:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270371.015364:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1788270371.015376:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262790656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270371.019931:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1788270371.019962:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262790528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024104:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789248 00000100:00100000:2.0:1788270371.024120:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789248 00000100:00100000:2.0:1788270371.024190:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788270371.024201:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262789248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024287:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5051c9b2-4d56-4172-904c-6f13b6100451+24:3608:x1875136262789248:12345-0@lo:400:kworker.0 Request processed in 88us (11844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.024295:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788270371.024349:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789632 00000100:00100000:2.0:1788270371.024354:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789632 00000100:00100000:2.0:1788270371.024386:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790144 00000100:00100000:2.0:1788270371.024389:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790144 00000100:00100000:2.0:1788270371.024403:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262789504 00000100:00100000:2.0:1788270371.024406:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262789504 00000100:00100000:2.0:1788270371.024417:0:47281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790016 00000100:00100000:2.0:1788270371.024419:0:47281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790016 00000100:00100000:2.0:1788270371.024434:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788270371.024440:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262789632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024476:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262789632:12345-0@lo:400:kworker.0 Request processed in 36us (11880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.024482:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788270371.024493:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788270371.024499:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262790144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024525:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262790144:12345-0@lo:400:kworker.0 Request processed in 27us (11901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.024532:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788270371.024542:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788270371.024548:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262789504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024582:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262789504:12345-0@lo:400:kworker.0 Request processed in 35us (11692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.024588:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788270371.024599:0:47281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788270371.024605:0:47281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262790016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024630:0:47281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262790016:12345-0@lo:400:kworker.0 Request processed in 27us (11701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.024636:0:47281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788270371.024696:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262789504:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024709:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262790016:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024776:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262789632:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024785:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262790144:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024794:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5051c9b2-4d56-4172-904c-6f13b6100451:3608:1875136262789248:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024805:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875136262789760:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024817:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875136262790272:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024828:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1875136262790784:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.024862:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c14299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262789120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788270371.024915:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790912 00000100:00100000:2.0:1788270371.024919:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790912 00000100:00100000:2.0:1788270371.024944:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788270371.024950:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262790912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270371.024971:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270371.025005:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262790912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (9697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.025010:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:2.0:1788270371.025078:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788270371.025083:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788270371.025086:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788270371.025089:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270371.025106:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262791040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270371.025137:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270371.025162:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262790912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270371.025180:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791040 00000100:00100000:2.0:1788270371.025183:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791040 00000100:00100000:2.0:1788270371.025196:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788270371.025200:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262791040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788270371.025208:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270371.025231:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14409b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262791040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.025237:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788270371.025256:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262791040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270371.025301:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270371.025336:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262789376:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.025347:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262789888:0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.025365:0:45778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262790400 00000100:00100000:2.0:1788270371.025369:0:45778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262790400 00000100:00100000:2.0:1788270371.025398:0:45778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1788270371.025404:0:45778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262790400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270371.025440:0:45778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262790400:12345-0@lo:400:kworker.0 Request processed in 36us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270371.025447:0:45778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1788270371.025448:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262790656:12345-0@lo:400:kworker.0 Request processed in 10075us (12791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270371.025454:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00080000:2.0:1788270371.025462:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788270371.025477:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262790400:0@lo:400:kworker.0 00000100:00100000:3.0:1788270371.025480:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262790656:0@lo:400:kworker.0 00000100:00100000:1.0:1788270371.026572:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1448f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875136262790784:12345-0@lo:400:kworker.0 Request processed in 11290us (14014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270371.026584:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1788270371.028471:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1875136262790528:12345-0@lo:400:kworker.0 Request processed in 8522us (15503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270371.028483:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1788270371.028924:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1875136262790528:0@lo:400:kworker.0 00010000:00010000:1.0:1788270371.268805:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270372.042243:0:57704:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270372.042251:0:57704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270372.042809:0:57704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270372.042819:0:57704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270372.292345:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270372.555730:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262791168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270372.555804:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270372.555903:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791168 00000100:00100000:2.0:1788270372.555912:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791168 00000100:00100000:2.0:1788270372.557277:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788270372.557297:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262791168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270372.557329:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270372.557404:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262791168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270372.557411:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788270372.557517:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c144099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262791168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270373.060332:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270373.062915:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262791296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270373.062998:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270373.063190:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791296 00000100:00100000:3.0:1788270373.063206:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791296 00000100:00100000:3.0:1788270373.063325:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788270373.063336:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262791296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270373.063374:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270373.063434:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262791296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270373.063441:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788270373.063534:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262791296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270373.321519:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788270373.788977:0:57755:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788270373.788987:0:57755:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270373.790344:0:57755:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:1.0:1788270373.790364:0:57755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270374.340713:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788270375.108304:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262791424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270375.108383:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270375.108505:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791424 00000100:00100000:3.0:1788270375.108514:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791424 00000100:00100000:3.0:1788270375.108566:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788270375.108577:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262791424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788270375.108609:0:45781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788270375.109586:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262791424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1004us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270375.109598:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788270375.109685:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c25ef74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262791424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788270375.364231:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270375.433195:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270375.433234:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270375.433274:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270375.433295:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270375.433312:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270375.433349:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270375.433403:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788270375.433909:0:45768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388800 00000100:00100000:3.0:1788270375.433922:0:45768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388800 00000100:00100000:3.0:1788270375.433996:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 282 00000100:00100000:3.0:1788270375.434007:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253388800:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270375.434127:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2402:x1875136253388800:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 122us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270375.434135:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 282 00000100:00100000:3.0:1788270375.434174:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253388928 00000100:00100000:3.0:1788270375.434179:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253388928 00000100:00100000:3.0:1788270375.434216:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389056 00000100:00100000:3.0:1788270375.434218:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389056 00000100:00100000:3.0:1788270375.434236:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389568 00000100:00100000:3.0:1788270375.434238:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389568 00000100:00100000:3.0:1788270375.434265:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389440 00000100:00100000:3.0:1788270375.434268:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389440 00000100:00100000:3.0:1788270375.434285:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 634 00000100:00100000:3.0:1788270375.434291:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253388928:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270375.434341:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c25ef74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2402:x1875136253388928:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 49us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270375.434347:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 634 00000100:00100000:3.0:1788270375.434361:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 635 00000100:00100000:3.0:1788270375.434368:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253389056:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270375.434393:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2402:x1875136253389056:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270375.434399:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 635 00000100:00100000:3.0:1788270375.434411:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 636 00000100:00100000:3.0:1788270375.434417:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253389568:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270375.434440:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253389568:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270375.434448:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 636 00000100:00100000:3.0:1788270375.434460:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 637 00000100:00100000:3.0:1788270375.434466:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253389440:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270375.435187:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389312 00000100:00100000:1.0:1788270375.435194:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389312 00000100:00100000:1.0:1788270375.435230:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389184 00000100:00100000:1.0:1788270375.435233:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389184 00000100:00100000:1.0:1788270375.435966:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 306 00000100:00100000:1.0:1788270375.435978:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253389312:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270375.436030:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1428ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2402:x1875136253389312:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 56us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270375.436074:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 306 00000100:00100000:1.0:1788270375.436090:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 307 00000100:00100000:1.0:1788270375.436097:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253389184:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270375.440390:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27fb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2402:x1875136253389184:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4280us (7027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270375.440405:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 307 00000100:00100000:3.0:1788270375.440891:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2402:x1875136253389440:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 22us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270375.440905:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 637 00000100:00080000:3.0:1788270375.441182:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270375.441188:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788270375.441192:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270375.441195:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788270375.649460:0:57806:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270375.649470:0:57806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270375.651546:0:57806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270375.651565:0:57806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788270376.132690:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788270376.132690:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788270376.132716:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270376.132727:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262791552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788270376.132853:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788270376.132863:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1535c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262791808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788270376.133475:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262792064:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134533:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.134599:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262792320:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134630:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.134649:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262792832:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134683:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.134708:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262793344:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134729:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.134745:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788270376.134899:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1530c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262792192:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134927:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.134945:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262792704:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134965:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.134980:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262793216:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.134998:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.135035:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792320 00000100:00100000:3.0:1788270376.135057:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792320 00000100:00100000:3.0:1788270376.135108:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792832 00000100:00100000:3.0:1788270376.135111:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792832 00000100:00100000:3.0:1788270376.135128:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792192 00000100:00100000:3.0:1788270376.135131:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792192 00000100:00100000:3.0:1788270376.135157:0:48231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792704 00000100:00100000:3.0:1788270376.135160:0:48231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792704 00000100:00100000:3.0:1788270376.135176:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788270376.135184:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262792320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.135257:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14a49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262792320:12345-0@lo:400:kworker.0 Request processed in 73us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.135264:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788270376.135282:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788270376.135288:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262792832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.135316:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262792832:12345-0@lo:400:kworker.0 Request processed in 29us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.135322:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788270376.135334:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788270376.135351:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262792192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.135380:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262792192:12345-0@lo:400:kworker.0 Request processed in 41us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.135386:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788270376.135398:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788270376.135404:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262792704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.135430:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875136262792704:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.135439:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788270376.135659:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793344 00000100:00100000:3.0:1788270376.135665:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793344 00000100:00100000:3.0:1788270376.135694:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793216 00000100:00100000:3.0:1788270376.135697:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793216 00000100:00100000:3.0:1788270376.135714:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1788270376.135720:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262793344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.135913:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875136262793344:12345-0@lo:400:kworker.0 Request processed in 192us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.135920:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1788270376.135934:0:46770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1788270376.135941:0:46770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262793216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.135971:0:46770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875136262793216:12345-0@lo:400:kworker.0 Request processed in 31us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.135977:0:46770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00080000:3.0:1788270376.136006:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788270376.136010:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788270376.136013:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788270376.136014:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788270376.136442:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1530c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262792192:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.136516:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262792704:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.136533:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1875136262793216:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.136544:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262792320:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.136554:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262792832:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.136563:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1875136262793344:0@lo:400:kworker.0 00000100:00100000:2.0:1788270376.136964:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270376.136995:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791552 00000100:00100000:1.0:1788270376.137002:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791552 00000100:00100000:2.0:1788270376.137033:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262791936:0@lo:400:kworker.0 00000100:00100000:1.0:1788270376.137062:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791680 00000100:00100000:1.0:1788270376.137067:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791680 00000100:00100000:2.0:1788270376.137090:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270376.137091:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788270376.137102:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262791552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270376.137116:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791936 00000100:00100000:2.0:1788270376.137121:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791936 00002000:00000024:1.0:1788270376.137129:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270376.137153:0:45770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788270376.137160:0:45770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262791936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270376.137229:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262791552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270376.137234:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788270376.137249:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788270376.137256:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262791680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788270376.137274:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270376.137300:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262791680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270376.137304:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788270376.137331:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262791552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270376.137425:0:45770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27d710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5051c9b2-4d56-4172-904c-6f13b6100451+24:3609:x1875136262791936:12345-0@lo:400:kworker.0 Request processed in 263us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270376.137433:0:45770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788270376.137536:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.137591:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5051c9b2-4d56-4172-904c-6f13b6100451:3609:1875136262791936:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.137597:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262792448:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.137618:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.137635:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792448 00000100:00100000:3.0:1788270376.137638:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792448 00000100:00100000:3.0:1788270376.137657:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1788270376.137661:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.137680:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262792448:12345-0@lo:400:kworker.0 Request processed in 20us (62us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270376.137684:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1788270376.137701:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262792448:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.137706:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262792960:0@lo:400:kworker.0 00000100:00100000:3.0:1788270376.137719:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270376.137732:0:46770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792960 00000100:00100000:3.0:1788270376.137735:0:46770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792960 00000100:00100000:0.0:1788270376.138323:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270376.138355:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792064 00000100:00100000:0.0:1788270376.138358:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792064 00000100:00100000:0.0:1788270376.138379:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788270376.138383:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262792064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138409:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262792064:12345-0@lo:400:kworker.0 Request processed in 25us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270376.138412:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788270376.138432:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262792064:0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138439:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262792576:0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138472:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270376.138494:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262792576 00000100:00100000:0.0:1788270376.138498:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262792576 00000100:00100000:0.0:1788270376.138520:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788270376.138526:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262792576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138556:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3610:x1875136262792576:12345-0@lo:400:kworker.0 Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270376.138562:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788270376.138584:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262792576:0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138589:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262793088:0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138606:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270376.138620:0:48110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793088 00000100:00100000:0.0:1788270376.138622:0:48110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793088 00000100:00100000:0.0:1788270376.138644:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1788270376.138648:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262792960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138667:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262792960:12345-0@lo:400:kworker.0 Request processed in 19us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270376.138670:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1788270376.138677:0:48110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1788270376.138680:0:48110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262793088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788270376.138692:0:48110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1875136262793088:12345-0@lo:400:kworker.0 Request processed in 12us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270376.138696:0:48110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00080000:0.0:1788270376.138704:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788270376.138716:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1875136262793088:0@lo:400:kworker.0 00000100:00100000:2.0:1788270376.138877:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262791808 00000100:00100000:2.0:1788270376.138882:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262791808 00000100:00100000:2.0:1788270376.138916:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788270376.138924:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262791808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788270376.138936:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:2.0:1788270376.138970:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262791808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270376.138976:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788270376.139083:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1535c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262791808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270376.139309:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262792960:0@lo:400:kworker.0 00000100:00100000:2.0:1788270376.139319:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262793472:0@lo:400:kworker.0 00000100:00100000:2.0:1788270376.139348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270376.139378:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1483a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788270376.139470:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793472 00000100:00100000:1.0:1788270376.139474:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793472 00000100:00100000:1.0:1788270376.139518:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1788270376.139525:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262793472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270376.139560:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262793472:12345-0@lo:400:kworker.0 Request processed in 36us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270376.139567:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00080000:2.0:1788270376.139681:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270376.139702:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262793472:0@lo:400:kworker.0 00010000:00010000:1.0:1788270376.388528:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270377.399991:0:57858:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270377.400001:0:57858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270377.400555:0:57858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270377.400564:0:57858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270377.414395:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270377.672216:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270377.672242:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262793600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270377.672320:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270377.672510:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793600 00000100:00100000:2.0:1788270377.672520:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793600 00000100:00100000:2.0:1788270377.672583:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788270377.672594:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262793600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788270377.672623:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270377.672677:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875136262793600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270377.672684:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788270377.673024:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1875136262793600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788270378.185654:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788270378.185679:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262793728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788270378.185766:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270378.185991:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793728 00000100:00100000:0.0:1788270378.186002:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793728 00000100:00100000:0.0:1788270378.186283:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788270378.186294:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262793728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788270378.186331:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1788270378.186389:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3608:x1875136262793728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270378.186396:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788270378.186528:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1875136262793728:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788270378.436277:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788270379.241428:0:57909:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270379.241437:0:57909:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270379.241982:0:57909:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270379.241990:0:57909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1788270379.461631:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788270380.228306:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1535c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262793856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788270380.228403:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270380.228525:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793856 00000100:00100000:0.0:1788270380.228534:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793856 00000100:00100000:0.0:1788270380.228590:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788270380.228601:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262793856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270380.228635:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270380.230606:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262793856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1995us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270380.230607:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1535c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262793856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788270380.230626:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:3.0:1788270380.484314:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270380.486485:0:45810:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270380.486494:0:45810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270380.487021:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270380.487031:0:45810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270380.546237:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546340:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546377:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546407:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546431:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546452:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546476:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788270380.546506:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389952 00000100:00100000:0.0:1788270380.546516:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389952 00000100:00100000:0.0:1788270380.546571:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390464 00000100:00100000:0.0:1788270380.546574:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390464 00000100:00100000:0.0:1788270380.546604:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389824 00000100:00100000:0.0:1788270380.546607:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389824 00000100:00100000:0.0:1788270380.546620:0:45776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390336 00000100:00100000:0.0:1788270380.546621:0:45776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390336 00000100:00100000:0.0:1788270380.546633:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 644 00000100:00100000:0.0:1788270380.546640:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253389952:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270380.546731:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2403:x1875136253389952:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270380.546743:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 644 00000100:00100000:0.0:1788270380.546768:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 645 00000100:00100000:0.0:1788270380.546775:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253390464:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270380.546799:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253390464:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270380.546805:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 645 00000100:00100000:0.0:1788270380.546817:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 646 00000100:00100000:0.0:1788270380.546823:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253389824:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270380.546846:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2403:x1875136253389824:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270380.546853:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 646 00000100:00100000:0.0:1788270380.546864:0:45776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 647 00000100:00100000:0.0:1788270380.546875:0:45776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253390336:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270380.546897:0:45776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2403:x1875136253390336:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270380.546904:0:45776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 647 00000100:00100000:3.0:1788270380.546907:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390208 00000100:00100000:3.0:1788270380.546912:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390208 00000100:00080000:0.0:1788270380.546922:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788270380.546926:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788270380.546927:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270380.546940:0:48230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390080 00000100:00100000:3.0:1788270380.546942:0:48230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390080 00000100:00080000:0.0:1788270380.546964:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788270380.546967:0:48230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 312 00000100:00100000:3.0:1788270380.546974:0:48230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253390208:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270380.547002:0:48230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2403:x1875136253390208:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270380.547008:0:48230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 312 00000100:00100000:2.0:1788270380.547024:0:48231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 313 00000100:00100000:2.0:1788270380.547035:0:48231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253390080:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270380.547092:0:48231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2403:x1875136253390080:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 61us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270380.547099:0:48231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 313 00000100:00100000:1.0:1788270380.550172:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253389696 00000100:00100000:1.0:1788270380.550988:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253389696 00000100:00100000:0.0:1788270380.551262:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 284 00000100:00100000:0.0:1788270380.551274:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253389696:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788270380.553724:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2403:x1875136253389696:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2441us (7486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270380.553739:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 284 00000040:00080000:1.0:1788270380.741169:0:46530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788270380.741178:0:46530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788270380.741580:0:46530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 64768 count 1 00000040:00080000:1.0:1788270380.741587:0:46530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788270380.980423:0:57960:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788270380.980433:0:57960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788270380.980944:0:57960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:3.0:1788270380.980953:0:57960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788270381.256212:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788270381.256236:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262793984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788270381.256318:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.256775:0:47285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262793984 00000100:00100000:2.0:1788270381.256783:0:47285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262793984 00000100:00100000:2.0:1788270381.256838:0:47285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788270381.256858:0:47285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c15031ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262793984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788270381.256884:0:47285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:2.0:1788270381.256932:0:47285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c15031ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1875136262793984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.256939:0:47285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:0.0:1788270381.259073:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788270381.259945:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1875136262793984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788270381.260237:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788270381.260253:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262794112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788270381.260309:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262794240:0@lo:400:kworker.0 00000100:00100000:3.0:1788270381.260317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270381.260373:0:48822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794112 00000100:00100000:3.0:1788270381.260379:0:48822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794112 00000100:00100000:3.0:1788270381.260432:0:48822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788270381.260442:0:48822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1533f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262794112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788270381.260469:0:48822:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00080000:0.0:1788270381.260472:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788270381.260846:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.260911:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270381.260918:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262794368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788270381.260942:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261011:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262794752:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261034:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261102:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270381.261107:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27c309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262794880:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261130:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261167:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1451c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262795264:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261189:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261220:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788270381.261225:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262795392:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261268:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261328:0:45781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794752 00000100:00100000:2.0:1788270381.261332:0:45781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794752 00000100:00100000:2.0:1788270381.261361:0:45781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788270381.261368:0:45781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262794752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261405:0:45781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27c308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262794752:12345-0@lo:400:kworker.0 Request processed in 38us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261412:0:45781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788270381.261440:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1494a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262794752:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261458:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262794496:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261477:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261491:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262795008:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261506:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261517:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c152fb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262795520:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261534:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261547:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788270381.261551:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1532fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262794624:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261567:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261578:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262795136:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261604:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788270381.261625:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795264 00000100:00100000:2.0:1788270381.261628:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795264 00000100:00100000:2.0:1788270381.261650:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795392 00000100:00100000:2.0:1788270381.261652:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795392 00000100:00100000:2.0:1788270381.261675:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795008 00000100:00100000:2.0:1788270381.261678:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795008 00000100:00100000:2.0:1788270381.261688:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795520 00000100:00100000:2.0:1788270381.261690:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795520 00000100:00100000:2.0:1788270381.261700:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794624 00000100:00100000:2.0:1788270381.261702:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794624 00000100:00100000:2.0:1788270381.261709:0:52795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795136 00000100:00100000:2.0:1788270381.261711:0:52795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795136 00000100:00100000:2.0:1788270381.261722:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1788270381.261727:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262795264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261758:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875136262795264:12345-0@lo:400:kworker.0 Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261764:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1788270381.261774:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1788270381.261779:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262795392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261799:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875136262795392:12345-0@lo:400:kworker.0 Request processed in 20us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261804:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1788270381.261812:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1788270381.261816:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262795008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261837:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875136262795008:12345-0@lo:400:kworker.0 Request processed in 20us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261842:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1788270381.261850:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1788270381.261855:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262795520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261873:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875136262795520:12345-0@lo:400:kworker.0 Request processed in 19us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261878:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1788270381.261886:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1788270381.261891:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262794624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261909:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875136262794624:12345-0@lo:400:kworker.0 Request processed in 18us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261914:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1788270381.261922:0:52795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1788270381.261927:0:52795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262795136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261944:0:52795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875136262795136:12345-0@lo:400:kworker.0 Request processed in 18us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.261950:0:52795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1788270381.261971:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27a6a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1875136262795392:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261979:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1451c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1875136262795264:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.261997:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875136262794624:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.262004:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1875136262795136:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.262011:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1534ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875136262795008:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.262019:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c152fb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1875136262795520:0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.262073:0:47284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794880 00000100:00100000:2.0:1788270381.262076:0:47284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794880 00000100:00100000:2.0:1788270381.262101:0:47284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788270381.262106:0:47284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1534a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262794880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788270381.262134:0:47284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1534a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262794880:12345-0@lo:400:kworker.0 Request processed in 28us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270381.262139:0:47284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788270381.262157:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262794880:0@lo:400:kworker.0 00000100:00100000:1.0:1788270381.262972:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794496 00000100:00100000:1.0:1788270381.262978:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794496 00000100:00100000:1.0:1788270381.263014:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788270381.263020:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262794496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788270381.263098:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262794496:12345-0@lo:400:kworker.0 Request processed in 78us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270381.263104:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788270381.263121:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794368 00000100:00100000:1.0:1788270381.263125:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794368 00000100:00100000:1.0:1788270381.263146:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788270381.263152:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262794368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788270381.263165:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 263880384 pending 0 free 3776679936 avail 3545157632 00000100:00100000:1.0:1788270381.263193:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1483a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875136262794368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270381.263198:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788270381.263227:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262794368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788270381.263249:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1532ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262794496:0@lo:400:kworker.0 00000100:00100000:0.0:1788270381.264002:0:45770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262794240 00000100:00100000:0.0:1788270381.264009:0:45770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262794240 00000100:00080000:1.0:1788270381.265243:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788270381.265252:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270381.265256:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270381.265260:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788270381.265987:0:48822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1533f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875136262794112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5541us (5665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270381.266000:0:48822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788270381.267345:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1875136262794112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788270381.268075:0:45768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788270381.268206:0:45768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262794240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788270381.268353:0:45768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5051c9b2-4d56-4172-904c-6f13b6100451+24:3607:x1875136262794240:12345-0@lo:400:kworker.0 Request processed in 268us (7507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270381.268362:0:45768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788270381.268472:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c27c2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5051c9b2-4d56-4172-904c-6f13b6100451:3607:1875136262794240:0@lo:400:kworker.0 00010000:00010000:1.0:1788270381.514534:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270382.532503:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788270382.656587:0:58011:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788270382.656598:0:58011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788270382.657392:0:58011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 64768 count 1 00000040:00080000:0.0:1788270382.657403:0:58011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788270382.789238:0:3610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1533f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262795648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270382.789305:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788270382.789355:0:47286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795648 00000100:00100000:1.0:1788270382.789362:0:47286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795648 00000100:00100000:1.0:1788270382.789403:0:47286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788270382.789412:0:47286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262795648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788270382.789441:0:47286:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 183774912 pending 0 free 3839610880 avail 3608088576 00000100:00100000:1.0:1788270382.789488:0:47286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1875136262795648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270382.789496:0:47286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788270382.789539:0:3610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1533f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1875136262795648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788270383.301069:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c15031e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262795776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788270383.301151:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788270383.301255:0:46517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795776 00000100:00100000:3.0:1788270383.301265:0:46517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795776 00000100:00100000:3.0:1788270383.301333:0:46517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788270383.301344:0:46517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262795776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788270383.301377:0:46517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1788270383.301434:0:46517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1875136262795776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270383.301441:0:46517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788270383.301879:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c15031e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1875136262795776:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788270383.556545:0:45764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788270384.581194:0:45765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788270384.774890:0:58062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_13a: @@@@@@ FAIL: request on 0x2000032e1:0x33:0x0 is not SUCCEED on mds1 00000100:00100000:2.0:1788270385.348423:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c1535c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262795904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788270385.348500:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788270385.348872:0:45782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136262795904 00000100:00100000:0.0:1788270385.348881:0:45782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136262795904 00000100:00100000:0.0:1788270385.348961:0:45782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788270385.348971:0:45782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c152fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262795904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788270385.349002:0:45782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788270385.349141:0:45782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c152fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875136262795904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788270385.349149:0:45782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788270385.352747:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c1535c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1875136262795904:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788270385.607239:0:47309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788270385.672018:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672124:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672152:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672169:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672188:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672202:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672223:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788270385.672251:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390848 00000100:00100000:1.0:1788270385.672261:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390848 00000100:00100000:1.0:1788270385.672316:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253391360 00000100:00100000:1.0:1788270385.672319:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253391360 00000100:00100000:1.0:1788270385.672335:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390720 00000100:00100000:1.0:1788270385.672337:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390720 00000100:00100000:1.0:1788270385.672350:0:45777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253391232 00000100:00100000:1.0:1788270385.672353:0:45777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253391232 00000100:00100000:1.0:1788270385.672369:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 654 00000100:00100000:1.0:1788270385.672379:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253390848:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270385.672452:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+20:2401:x1875136253390848:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270385.672460:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 654 00000100:00100000:1.0:1788270385.672480:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 655 00000100:00100000:1.0:1788270385.672486:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253391360:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270385.672511:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253391360:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270385.672517:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 655 00000100:00100000:1.0:1788270385.672528:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 656 00000100:00100000:1.0:1788270385.672533:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253390720:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270385.672554:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+48:2401:x1875136253390720:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270385.672559:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 656 00000100:00100000:1.0:1788270385.672570:0:45777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 657 00000100:00100000:1.0:1788270385.672576:0:45777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253391232:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788270385.672611:0:45777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04ecb0d1-118e-4eab-bf07-e32490d1fd1f+5:2401:x1875136253391232:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788270385.672617:0:45777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 657 00000100:00080000:1.0:1788270385.672638:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788270385.672641:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788270385.672848:0:45771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390592 00000100:00100000:2.0:1788270385.672854:0:45771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390592 00000100:00100000:2.0:1788270385.672898:0:45771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 286 00000100:00100000:2.0:1788270385.672906:0:45771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253390592:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788270385.672938:0:45771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c143aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa52f0bf-08b6-495d-a5ae-358be8153494+13:2401:x1875136253390592:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788270385.672944:0:45771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 286 00000100:00100000:3.0:1788270385.673291:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253391104 00000100:00100000:3.0:1788270385.673297:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253391104 00000100:00100000:3.0:1788270385.673349:0:47283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136253390976 00000100:00100000:3.0:1788270385.673353:0:47283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136253390976 00000100:00100000:3.0:1788270385.673377:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 315 00000100:00100000:3.0:1788270385.673385:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253391104:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270385.673416:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+13:2401:x1875136253391104:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270385.673423:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 315 00000100:00100000:3.0:1788270385.673436:0:47283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 316 00000100:00100000:3.0:1788270385.673442:0:47283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1535c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253390976:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788270385.673466:0:47283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1535c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcd1a3aa-3199-40e8-84d1-6ffb32ef4b49+10:2401:x1875136253390976:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788270385.673472:0:47283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 316 00000100:00080000:1.0:1788270385.675160:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788270385.675170:0:45772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 75581 lines, 75581 kept, 0 dropped, 0 bad.